00000400:00080000:1.0F:1783144205.453707:0:83569:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1783144205.83171 00010000:02000000:0.0F:1783144205.453821:0:83171:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:05, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:1.0:1783144205.468794:0:83171:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc16288713e10 00100000:10000000:1.0:1783144205.468809:0:83171:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1783144205.470618:0:83159:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:0.0:1783144205.470668:0:83159:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83159:1869759501226112:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783144205.470766:0:83159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144205.470802:0:83159:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9234d80 going to sleep for 20 seconds 00000004:00080000:1.0:1783144205.470944:0:83157:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:1.0:1783144205.470966:0:83157:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83157:1869759501226240:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0F:1783144205.471015:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501226112 00000100:00100000:1.0:1783144205.471015:0:83157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144205.471030:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501226112 00000100:00100000:1.0:1783144205.471041:0:83157:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6bdc840 going to sleep for 20 seconds 00000100:00100000:0.0:1783144205.471058:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501226240 00000100:00080000:1.0:1783144205.471059:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144205.471063:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501226240 00000100:00100000:3.0:1783144205.471088:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904 00000100:00100000:1.0:1783144205.471100:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905 00000100:00100000:3.0:1783144205.471101:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:83159:x1869759501226112:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1783144205.471110:0:8602:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783144205.471115:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:83157:x1869759501226240:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1783144205.471121:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00080000:0.0:1783144205.471129:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1783144205.471136:0:8602:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -31 00002000:00080000:1.0:1783144205.471140:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -581 00002000:02000040:3.0:1783144205.471143:0:8602:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1697) 00002000:02000040:1.0:1783144205.471145:0:8438:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1697) 00002000:00010000:3.0:1783144205.471187:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.471194:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471208:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.471212:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.471219:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471233:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471243:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471251:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471270:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144205.471299:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.471307:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471317:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.471321:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471330:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471348:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471355:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d14849d/0xad8e53a423046c45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.471375:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.471376:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.471379:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.471383:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.471384:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471400:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.471404:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.471409:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471420:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471430:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471438:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471457:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144205.471492:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.471498:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471506:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.471509:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.471513:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471533:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471552:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471565:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471582:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144205.471601:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144205.471607:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471616:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.471620:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471627:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.471635:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.471640:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471642:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471657:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423046c4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471668:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.471673:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.471678:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471678:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.471685:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471703:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144205.471706:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471707:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471746:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471758:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471779:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471781:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471800:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7dc7d38/0xad8e53a423046c53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471815:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.471825:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144205.471829:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.471834:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471841:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.471845:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471852:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471862:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471869:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423046c5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.471877:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.471881:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.471885:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.471890:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.471894:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.471897:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.471906:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.471911:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471921:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471934:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471942:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.471955:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144205.472011:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.472020:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472028:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.472035:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.472040:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472055:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472062:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472074:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472090:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783144205.472133:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.472144:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472152:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.472155:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.472159:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472167:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144205.472176:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472176:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472199:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.472203:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472206:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472213:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472228:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472234:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472256:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003721db45/0xad8e53a423046c61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472257:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144205.472275:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144205.472279:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472286:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.472289:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.472297:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.472304:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472319:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472320:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.472327:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.472335:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472342:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472346:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472361:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000832cb507/0xad8e53a423046c68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472364:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0F:1783144205.472371:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144205.472382:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472387:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472388:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472393:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144205.472393:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.472400:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472406:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.472412:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472414:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.472420:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.472428:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144205.472428:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472434:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472437:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472456:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472464:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.472465:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472472:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144205.472473:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423046c6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472485:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472485:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423046c76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472496:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.472501:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.472506:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472510:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472514:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.472519:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472520:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472524:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472541:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144205.472546:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144205.472551:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472561:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.472565:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.472575:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.472584:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472591:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472594:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.472602:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.472611:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472614:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472622:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472626:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423046c7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472644:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472646:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472647:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.472651:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472658:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472658:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472680:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144205.472681:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144205.472687:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472694:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.472699:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472707:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.472716:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.472716:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472745:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472753:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.472756:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.472759:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472768:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472771:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472776:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472802:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472803:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423046c84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472828:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.472831:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472843:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144205.472844:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144205.472850:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472857:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.472860:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472869:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.472879:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.472882:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.472885:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.472897:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472898:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423046c8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472918:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.472922:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144205.472925:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472927:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.472929:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.472933:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.472941:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472950:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472957:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.472989:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144205.472997:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.473003:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473012:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.473016:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473024:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.473032:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.473033:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473045:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473045:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423046c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473067:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.473069:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.473071:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.473072:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.473079:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.473084:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473094:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473102:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473110:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473132:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144205.473186:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.473195:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473280:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.473284:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473293:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473304:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473312:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423046c99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473381:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.473383:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.473385:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783144205.473445:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.473451:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473466:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.473469:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.473474:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473483:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473498:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473512:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473574:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144205.473624:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.473629:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473637:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.473641:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.473645:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473663:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473671:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.473685:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473766:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144205.473772:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473787:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.473791:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473816:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473829:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473836:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423046ca0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473857:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.473861:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473867:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.473871:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473886:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473901:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.473909:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.473911:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.473918:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.474029:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.474034:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423046ca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.474130:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.474136:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474144:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.474147:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.474151:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474169:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474177:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474192:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474222:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.474227:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474234:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.474237:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474245:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474256:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474263:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.474265:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.474267:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.474334:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.474339:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423046cae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.474385:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.474391:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474419:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.474428:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.474433:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474442:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474451:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474459:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474540:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.474546:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474560:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.474563:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474578:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474608:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474617:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.474618:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.474620:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.474694:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.474699:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423046cb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.474779:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.474785:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474800:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.474803:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.474807:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474830:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474840:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.474848:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474901:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.474907:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474914:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.474917:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474934:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474945:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.474953:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.474955:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.474957:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.475026:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.475038:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423046cbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.475097:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.475109:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475117:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.475120:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.475124:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475140:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475161:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475175:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475209:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.475215:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475233:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.475236:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475250:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475262:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475270:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.475271:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.475273:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.475401:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.475406:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423046cc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.475484:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.475490:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475498:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.475501:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.475505:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475514:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475522:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475540:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475575:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.475580:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475587:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.475597:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475606:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475618:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475638:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.475640:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.475642:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.475709:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.475737:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423046cca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.475801:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.475806:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475821:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.475824:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.475828:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475838:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475852:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.475860:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475929:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.475933:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475940:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.475950:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475958:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475984:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.475992:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.475993:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.475995:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.476053:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.476058:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423046cd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.476117:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.476122:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476130:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.476132:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.476136:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476149:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476157:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476164:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476193:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.476197:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476203:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.476211:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476224:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476234:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476247:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.476248:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.476250:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.476302:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.476306:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423046cd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.476371:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.476376:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476383:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.476386:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.476389:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476405:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476412:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476419:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476498:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.476509:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476516:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.476520:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476528:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476546:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476553:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.476555:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.476556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.476630:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.476635:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423046cdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.476708:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.476713:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476751:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.476759:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.476763:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476771:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476783:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.476790:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476840:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.476845:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476857:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.476860:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476867:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476882:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.476889:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.476890:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.476892:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.476958:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.476962:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423046ce6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.477018:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.477023:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477030:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.477032:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.477036:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477049:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477056:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477063:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477090:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.477095:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477101:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.477104:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477111:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477130:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477138:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477139:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477141:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.477192:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.477196:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423046ced lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.477239:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.477244:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477252:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.477254:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.477258:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477266:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477283:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477289:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477315:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.477320:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477385:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.477388:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477396:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477405:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477412:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477414:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477415:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.477466:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.477471:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423046cf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.477513:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.477517:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477524:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.477527:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.477530:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477538:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477545:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477563:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477599:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.477603:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477618:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.477621:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477629:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477638:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477647:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477648:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.477698:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.477703:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423046cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.477763:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.477768:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477775:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.477778:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.477781:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477789:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477796:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.477803:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477848:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.477853:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477859:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.477862:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477869:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477879:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.477892:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477893:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.477895:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.477959:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.477963:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423046d02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.478035:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.478040:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478047:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.478050:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.478053:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478061:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478067:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478082:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478113:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.478118:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478124:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.478127:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478134:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478150:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478157:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.478159:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.478160:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.478221:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.478225:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a423046d09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.478287:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.478292:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478298:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.478301:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.478304:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478312:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478319:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478390:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478425:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.478435:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478442:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.478445:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478459:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478476:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478485:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.478487:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.478488:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.478554:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.478558:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a423046d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144205.478619:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.478624:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478647:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.478650:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.478654:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478663:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478677:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.478685:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478719:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.478747:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478754:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.478757:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478765:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478783:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.478791:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.478792:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.478794:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.478878:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144205.478884:0:8602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046d17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783144205.478922:0:8602:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:3.0:1783144205.479027:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:83159:x1869759501226112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7927us (8260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144205.479037:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904 00000100:00100000:3.0:1783144205.479093:0:83159:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83159:1869759501226112:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783144205.479108:0:83159:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6a1:0x0] from OST, last_created [0x2c0000401:0x6a1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:3.0:1783144205.479187:0:83159:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83159:1869759501226496:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783144205.479222:0:83159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144205.479249:0:83159:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9dca780 going to sleep for 20 seconds 00000100:00100000:3.0:1783144205.479267:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501226368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144205.479293:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144205.479391:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501226368 00000100:00100000:3.0:1783144205.479397:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501226368 00000100:00100000:3.0:1783144205.479429:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1783144205.479438:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501226368:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1783144205.479445:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783144205.479466:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144205.479502:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501226368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144205.479508:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1783144205.479537:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501226368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144205.479556:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501226496 00000100:00100000:3.0:1783144205.479560:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501226496 00000100:00100000:3.0:1783144205.479581:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4906 00000100:00100000:3.0:1783144205.479587:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:83159:x1869759501226496:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1783144205.479591:0:8602:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1783144205.479613:0:8602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1698 00010000:00010000:0.0:1783144205.480418:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144205.481657:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:83159:x1869759501226496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2068us (2433us total) trans 4294968821 rc 0/0 00000100:00100000:3.0:1783144205.481673:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4906 00000100:00100000:0.0:1783144205.481802:0:83159:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83159:1869759501226496:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783144205.481813:0:83159:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6a1:0x0]-[0x2c0000401:0x6c1:0x0] 00002000:00010000:1.0:1783144205.487098:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.487115:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487133:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.487137:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.487143:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487160:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487171:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487200:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487318:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144205.487426:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.487432:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487440:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.487443:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.487447:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487456:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487463:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.487470:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488378:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144205.488384:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488391:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.488395:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488402:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488414:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488419:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a423046d1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488436:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.488438:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488441:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.488443:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488457:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488462:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.488466:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.488467:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.488468:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.488558:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783144205.488562:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423046d25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144205.488743:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.488747:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488754:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.488756:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.488759:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488764:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488769:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488774:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488784:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144205.488789:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.488792:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488798:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47da00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.488801:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488816:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488827:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488835:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a423046d2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488849:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.488852:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.488854:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144205.488887:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.488890:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488896:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.488898:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.488900:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488906:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488910:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488919:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.488937:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144205.488988:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.488994:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489001:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.489003:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.489007:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489014:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489019:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489023:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489032:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144205.489036:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144205.489039:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489048:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.489050:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489055:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489061:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489065:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423046d33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489073:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.489075:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489079:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47ce00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.489080:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489084:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489089:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489096:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a423046d3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489103:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144205.489132:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.489135:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489140:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.489142:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.489144:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489150:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489154:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489158:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489166:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144205.489170:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.489179:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489185:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.489189:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489196:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489206:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489213:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a423046d41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489225:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489298:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489300:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489302:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144205.489342:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.489347:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489354:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.489357:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.489360:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489379:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489387:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489393:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489412:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144205.489440:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783144205.489448:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.489454:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489455:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489477:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.489479:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.489482:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.489487:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489491:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489503:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489507:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489519:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489528:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489537:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a423046d48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489553:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489557:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.489561:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.489564:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489574:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144205.489583:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.489587:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489593:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.489596:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489603:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489613:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489619:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe79e63/0xad8e53a423046d4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489631:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489633:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489634:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144205.489672:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.489685:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489692:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.489695:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.489698:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489707:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489713:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489734:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489750:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144205.489789:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.489791:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.489794:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489798:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489813:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.489817:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.489819:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.489823:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489825:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489847:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489865:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489867:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489878:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489889:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489896:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144205.489899:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a423046d56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489905:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.489911:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489917:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489918:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144205.489922:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489923:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.489926:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489936:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489947:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489954:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c4a0f8/0xad8e53a423046d5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.489967:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.489988:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144205.490027:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.490032:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490039:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.490042:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.490046:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490054:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490062:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490068:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490089:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144205.490109:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144205.490116:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.490125:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031a00 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:1.0:1783144205.490128:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.490129:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490138:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.490143:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490160:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.490162:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490164:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.490175:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490182:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.490203:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a423046d64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490208:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490224:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.490227:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.490231:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.490236:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.490236:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490578:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144205.490623:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.490628:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490635:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.490638:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.490641:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490649:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490656:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490672:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490689:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783144205.490760:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.490766:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490774:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.490776:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.490780:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490788:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490795:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490803:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490818:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783144205.490832:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783144205.490838:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490849:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.490853:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144205.490856:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.490860:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490863:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490870:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490888:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a423046d6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490889:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.490898:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.490903:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490922:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490923:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144205.490928:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490940:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490940:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.490945:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.490962:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490963:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.490999:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491005:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144205.491005:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423046d72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491017:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144205.491021:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.491024:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491028:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491029:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.491034:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491045:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.491049:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.491060:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.491073:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491074:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491099:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491111:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a423046d80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491113:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491120:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a423046d79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491122:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.491124:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.491128:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491137:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491140:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491141:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144205.491181:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.491187:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491196:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.491199:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.491204:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491311:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491318:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491328:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491341:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144205.491344:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144205.491357:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.491358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.491365:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.491369:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.491378:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.491379:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.491391:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.491397:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491403:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:2.0:1783144205.491411:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef6bd23/0xad8e53a423046d87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491411:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.491422:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.491433:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.491434:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.491437:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.491441:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.491448:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491457:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491473:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144205.491524:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.491529:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.491531:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491535:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491551:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.491557:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491559:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.491567:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144205.491575:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491576:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491600:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491601:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491619:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feb4b93f/0xad8e53a423046d8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491622:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491641:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491647:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491650:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491651:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.491664:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144205.491686:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144205.491691:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.491698:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144205.491702:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.491710:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.491711:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.491746:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.491756:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491757:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.491765:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.491774:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd59c869/0xad8e53a423046d95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491775:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491798:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491818:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491826:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491847:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144205.491874:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144205.491879:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491879:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.491887:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491887:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144205.491889:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491891:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.491892:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.491903:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491905:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491925:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.491928:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491930:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.491939:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491943:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e4aaf2b/0xad8e53a423046d9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491959:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.491964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491967:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.491982:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.491983:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.491993:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492020:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144205.492038:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144205.492043:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492048:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.492050:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.492058:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.492070:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492071:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492092:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492093:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.492101:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144205.492105:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006511cbfa/0xad8e53a423046da3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492109:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492115:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.492118:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.492119:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.492123:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492132:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492140:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492157:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144205.492170:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.492176:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492194:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.492198:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.492202:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144205.492206:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492210:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492395:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.492396:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492407:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f34644df/0xad8e53a423046daa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492409:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.492421:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492423:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.492426:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.492428:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.492436:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492447:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492454:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492470:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144205.492490:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144205.492494:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.492499:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144205.492502:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.492507:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.492514:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.492518:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a56553/0xad8e53a423046db1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.492527:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.492528:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.492529:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144205.492552:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.492560:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492569:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.492572:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.492576:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492585:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492593:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492606:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492621:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144205.492634:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.492638:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492644:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.492646:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492652:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.492661:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.492670:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492681:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:1.0:1783144205.492685:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492685:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.492695:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492699:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c0d884d/0xad8e53a423046db8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492718:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492747:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.492753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.492756:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.492759:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492774:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144205.492808:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.492813:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492827:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.492830:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.492835:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492841:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.492845:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492848:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492866:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492867:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.492873:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492883:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492888:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492905:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492911:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144205.492925:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058cf5147/0xad8e53a423046dbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492942:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144205.492946:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.492953:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8400 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:0.0:1783144205.492955:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144205.492958:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492962:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.492986:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.492989:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.492993:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.492998:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.493004:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493025:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493026:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493046:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493052:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493061:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000183e10e4/0xad8e53a423046dc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493065:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144205.493082:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144205.493088:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.493095:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.493095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.493097:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.493099:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493099:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144205.493111:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.493114:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493118:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.493130:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493132:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.493141:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144205.493143:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048fae549/0xad8e53a423046dcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493149:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.493155:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.493157:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.493160:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.493164:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493174:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493182:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493209:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144205.493444:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.493449:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493457:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.493460:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.493464:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493473:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493481:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493489:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493494:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.493500:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493507:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.493511:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493518:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493529:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493535:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cac0358/0xad8e53a423046dd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493559:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.493561:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783144205.493563:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493572:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.493574:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493582:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493595:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493602:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91d0ee0/0xad8e53a423046ddb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.493607:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144205.493615:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.493616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.493619:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.493622:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.493629:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.493637:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.493641:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493649:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493657:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.493658:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493667:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493686:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144205.493748:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144205.493753:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144205.493755:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493760:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493765:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.493778:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144205.493781:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144205.493784:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493787:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493809:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493810:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493836:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493837:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493851:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f2401be/0xad8e53a423046de2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493860:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.493873:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144205.493877:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493880:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144205.493887:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144205.493890:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493898:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493922:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.493926:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144205.493931:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053eb3be9/0xad8e53a423046de9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493934:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493951:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:0.0:1783144205.493954:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144205.493955:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.493959:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.493959:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144205.493963:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.493983:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493990:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.493997:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.494010:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144205.494036:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144205.494042:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144205.494048:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x682:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144205.494049:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144205.494055:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.494058:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.494065:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.494087:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=2739s v=(0 0) 00010000:00010000:3.0:1783144205.494091:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.494092:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144205.494102:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.494115:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.494119:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000301cf02/0xad8e53a423046df0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144205.494134:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.494142:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.494144:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144205.494146:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144205.494150:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144205.494161:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144205.494347:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144205.494352:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.494360:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144205.494368:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.494377:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.494387:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.494395:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ec59f7/0xad8e53a423046df7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144205.494409:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.494410:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144205.494412:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144205.494444:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783144205.498141:0:8438:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:0.0:1783144205.498413:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:83157:x1869759501226240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 27297us (27391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144205.498424:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905 00000100:00100000:1.0:1783144205.498859:0:83157:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83157:1869759501226240:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783144205.498875:0:83157:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6a1:0x0] from OST, last_created [0x280000401:0x6a1:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:3.0:1783144205.498957:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501226624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144205.499007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144205.499088:0:83157:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83157:1869759501226752:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783144205.499111:0:83157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144205.499129:0:83157:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6bdc840 going to sleep for 20 seconds 00000100:00100000:1.0:1783144205.499143:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501226752 00000100:00100000:1.0:1783144205.499149:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501226752 00000100:00100000:1.0:1783144205.499190:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907 00000100:00100000:1.0:1783144205.499199:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:83157:x1869759501226752:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1783144205.499206:0:8437:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1783144205.499239:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1698 00000100:00100000:1.0:1783144205.500893:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:83157:x1869759501226752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1690us (1776us total) trans 4294968822 rc 0/0 00000100:00100000:1.0:1783144205.500905:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907 00000100:00100000:2.0:1783144205.501016:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501226624 00000100:00100000:2.0:1783144205.501024:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501226624 00000100:00100000:2.0:1783144205.501071:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1783144205.501079:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501226624:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:2.0:1783144205.501085:0:8440:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1783144205.501104:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144205.501262:0:83157:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83157:1869759501226752:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783144205.501274:0:83157:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6a1:0x0]-[0x280000401:0x6c1:0x0] 00000100:00100000:2.0:1783144205.501825:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501226624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 745us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144205.501832:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1783144205.501954:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501226624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783144206.286171:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144206.350071:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501226880:0@lo:400:kworker.0 00000100:00080000:0.0:1783144206.350094:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144206.350099:0:35504:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1783144206.350107:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501227136:0@lo:400:kworker.0 00010000:00080000:1.0:1783144206.350241:0:8447:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2aee582300 x1869759501224832/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1783144215 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144206.350277:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501227008:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350306:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144206.350342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.350430:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501227392:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350461:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.350491:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501227904:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.350532:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783144206.350536:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501227264:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350550:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.350559:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501227776:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350571:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.350579:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501228288:0@lo:400:kworker.0 00000100:00100000:0.0:1783144206.350587:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501227520:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144206.350623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.350633:0:83144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501226880 00000100:00100000:3.0:1783144206.350651:0:83144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501226880 00000100:00100000:0.0:1783144206.350655:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501228032:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350694:0:83144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783144206.350711:0:83144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501226880:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144206.350715:0:83144:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.350801:0:83144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501226880:12345-0@lo:400:kworker.0 Request processed in 91us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144206.350811:0:83144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783144206.350812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144206.350840:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783144206.350847:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501227648:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350852:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227008 00000100:00100000:3.0:1783144206.350857:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227008 00000100:00100000:0.0:1783144206.350873:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144206.350891:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501228160:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.350895:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227392 00000100:00100000:3.0:1783144206.350899:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227392 00000100:00100000:0.0:1783144206.350916:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.350918:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227264 00000100:00100000:3.0:1783144206.350922:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227264 00000100:00100000:3.0:1783144206.350940:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227776 00000100:00100000:3.0:1783144206.350942:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227776 00000100:00100000:3.0:1783144206.350953:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228288 00000100:00100000:3.0:1783144206.350954:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228288 00000100:00100000:3.0:1783144206.350985:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1783144206.350993:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501227008:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144206.350998:0:66113:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.351140:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501227008:12345-0@lo:400:kworker.0 Request processed in 147us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144206.351144:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1783144206.351154:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1783144206.351159:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501227392:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783144206.351165:0:66143:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.351172:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1783144206.351198:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501227392:12345-0@lo:400:kworker.0 Request processed in 43us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144206.351204:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1783144206.351219:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1783144206.351223:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501227264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144206.351228:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501227776:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144206.351231:0:66113:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.351270:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501227264:12345-0@lo:400:kworker.0 Request processed in 90us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144206.351276:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1783144206.351297:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1783144206.351303:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501228288:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144206.351307:0:66113:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:0.0:1783144206.351317:0:66143:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.351335:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501228288:12345-0@lo:400:kworker.0 Request processed in 32us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144206.351341:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00080000:3.0:1783144206.351362:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144206.351366:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144206.351384:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227904 00000100:00100000:3.0:1783144206.351387:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227904 00000100:00100000:2.0:1783144206.351394:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144206.351408:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3654 00000100:00100000:3.0:1783144206.351415:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501227904:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144206.351420:0:78024:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783144206.351435:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501227776:12345-0@lo:400:kworker.0 Request processed in 208us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144206.351443:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1783144206.351459:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227136 00000100:00100000:0.0:1783144206.351463:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227136 00000100:00100000:3.0:1783144206.351465:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501227904:12345-0@lo:400:kworker.0 Request processed in 49us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144206.351473:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3654 00000100:00100000:0.0:1783144206.351504:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1783144206.351512:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501227136:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783144206.351522:0:66143:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783144206.351555:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501227008:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.351561:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501227264:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.351574:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501227776:0@lo:400:kworker.0 00000100:00100000:0.0:1783144206.351580:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501227136:12345-0@lo:400:kworker.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144206.351587:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501228288:0@lo:400:kworker.0 00000100:00100000:0.0:1783144206.351589:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1783144206.351596:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501227136:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.351605:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501227392:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.351615:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501227904:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.351623:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501226880:0@lo:400:kworker.0 00000100:00100000:2.0:1783144206.351636:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227520 00000100:00100000:2.0:1783144206.351646:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227520 00000100:00080000:0.0:1783144206.351659:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144206.351661:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228032 00000100:00080000:0.0:1783144206.351664:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144206.351665:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228032 00000100:00100000:2.0:1783144206.351673:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501227648 00000100:00100000:2.0:1783144206.351675:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501227648 00000100:00100000:3.0:1783144206.351683:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228160 00000100:00100000:3.0:1783144206.351690:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228160 00000100:00100000:2.0:1783144206.351694:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1783144206.351700:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501227520:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783144206.351704:0:26152:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.351707:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1783144206.351712:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501228032:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144206.351716:0:16470:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.351765:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501228032:12345-0@lo:400:kworker.0 Request processed in 53us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144206.351765:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501227520:12345-0@lo:400:kworker.0 Request processed in 64us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144206.351771:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00080000:0.0:1783144206.351848:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144206.352038:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:3.0:1783144206.352043:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:3.0:1783144206.352050:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501227648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144206.352053:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000020:02000000:3.0:1783144206.352054:0:16470:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783144206.352058:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501228160:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783144206.352062:0:26152:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144206.352086:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501227648:12345-0@lo:400:kworker.0 Request processed in 36us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144206.352092:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1783144206.352095:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501228160:12345-0@lo:400:kworker.0 Request processed in 38us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144206.352101:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1783144206.352139:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501227648:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.352150:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501228160:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.352162:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501227520:0@lo:400:kworker.0 00000100:00100000:3.0:1783144206.352170:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501228032:0@lo:400:kworker.0 00000100:00100000:1.0:1783144206.352718:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501224832:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1014994us (1015153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144206.352739:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3648 00000100:00080000:0.0:1783144206.353148:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1783144206.353157:0:3647:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2aee580000 x1869759501224832/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144235 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783144206.353166:0:3647:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2aee580000 x1869759501224832/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144235 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783144206.353172:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783144206.353187:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783144206.353262:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501228416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144206.353304:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144206.353492:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228416 00000100:00100000:2.0:1783144206.353496:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228416 00000100:00100000:2.0:1783144206.353522:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3655 00000100:00100000:2.0:1783144206.353527:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501228416:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1783144206.353530:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783144206.353551:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445011456 avail 1298771968 00000100:00100000:2.0:1783144206.353604:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501228416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144206.353611:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3655 00000100:00100000:2.0:1783144206.353641:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501228416:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1783144206.364680:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001102733e): req@ffff9c2affdb7480 x1869759501144064/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144031 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144206.364708:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501224832:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1783144206.365337:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144206.365521:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144064 00000100:00100000:0.0:1783144206.365529:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144064 00000100:00100000:0.0:1783144206.365615:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3656 00000100:00100000:0.0:1783144206.365624:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501144064:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1783144206.365630:0:23926:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783144206.365655:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445011456 avail 1298771968 00000100:00100000:0.0:1783144206.365755:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501144064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144206.365763:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3656 00000100:00100000:2.0:1783144206.365933:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501144064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783144207.312867:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144207.886011:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501228544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144207.886085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144207.886297:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144207.886306:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501228672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144207.886331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144207.886482:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228544 00000100:00100000:3.0:1783144207.886490:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228544 00000100:00100000:3.0:1783144207.886532:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228672 00000100:00100000:3.0:1783144207.886535:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228672 00000100:00100000:3.0:1783144207.886558:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1783144207.886567:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501228544:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:3.0:1783144207.886585:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783144207.886610:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144207.886653:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501228544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144207.886660:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1783144207.886676:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1783144207.886682:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501228672:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:3.0:1783144207.886686:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783144207.886697:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144207.886741:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501228672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144207.886747:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1783144207.886781:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501228672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144207.886795:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501228544:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783144208.334112:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144208.398024:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501228800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144208.398100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144208.398306:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228800 00000100:00100000:0.0:1783144208.398314:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228800 00000100:00100000:0.0:1783144208.398364:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3657 00000100:00100000:0.0:1783144208.398374:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501228800:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1783144208.398380:0:78024:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783144208.398410:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:0.0:1783144208.398462:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501228800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144208.398469:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3657 00000100:00100000:1.0:1783144208.398779:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501228800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783144209.361019:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144210.382047:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501229312:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.382110:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.382138:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501229824:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.382161:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.382174:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501230336:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.382190:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.382212:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1783144210.382217:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501228928:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.382241:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.382265:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501229440:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.382284:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.382300:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501229952:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.382317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144210.382342:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229824 00000100:00100000:1.0:1783144210.382349:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501230464:0@lo:400:kworker.0 00000100:00100000:3.0:1783144210.382350:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229824 00000100:00100000:1.0:1783144210.382376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.382409:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230336 00000100:00100000:1.0:1783144210.382413:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230336 00000100:00100000:3.0:1783144210.382425:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1783144210.382436:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501229824:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144210.382443:0:26142:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783144210.382447:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1783144210.382456:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501230336:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783144210.382461:0:8435:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144210.382504:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501229824:12345-0@lo:400:kworker.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.382506:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501230336:12345-0@lo:400:kworker.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144210.382518:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00080000:3.0:1783144210.382539:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144210.382555:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229312 00000100:00100000:3.0:1783144210.382558:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229312 00000100:00100000:0.0:1783144210.382581:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229440 00000100:00100000:0.0:1783144210.382587:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229440 00000100:00100000:3.0:1783144210.382590:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229952 00000100:00100000:3.0:1783144210.382601:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229952 00000100:00100000:0.0:1783144210.382633:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230464 00000100:00100000:0.0:1783144210.382638:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230464 00010000:00010000:2.0:1783144210.384029:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783144210.384067:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144210.384070:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144210.384084:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501229056:0@lo:400:kworker.0 00000100:00100000:2.0:1783144210.384123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.384209:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1783144210.384237:0:83145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501228928 00000100:00100000:1.0:1783144210.384242:0:83145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501228928 00000100:00100000:1.0:1783144210.384267:0:83145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783144210.384274:0:83145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501228928:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783144210.384279:0:83145:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783144210.384311:0:83145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501228928:12345-0@lo:400:kworker.0 Request processed in 38us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.384318:0:83145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783144210.384347:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501229184:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.384387:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501228928:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.384402:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501229824:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.384412:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501230336:0@lo:400:kworker.0 00000100:00100000:2.0:1783144210.384932:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501229568:0@lo:400:kworker.0 00000100:00100000:2.0:1783144210.384971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144210.384988:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501230080:0@lo:400:kworker.0 00000100:00100000:2.0:1783144210.385005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144210.385949:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229056 00000100:00100000:3.0:1783144210.385955:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229056 00000100:00100000:1.0:1783144210.385990:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1783144210.386003:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501229312:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783144210.386009:0:66947:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144210.386013:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1783144210.386024:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501229440:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144210.386034:0:66113:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783144210.386076:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501229312:12345-0@lo:400:kworker.0 Request processed in 76us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144210.386084:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501229440:12345-0@lo:400:kworker.0 Request processed in 61us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.386089:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1783144210.386098:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1783144210.386113:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1783144210.386120:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1783144210.386125:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501229952:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783144210.386131:0:66947:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144210.386135:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501230464:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783144210.386141:0:66113:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783144210.386165:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501229952:12345-0@lo:400:kworker.0 Request processed in 43us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.386172:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1783144210.386185:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501230464:12345-0@lo:400:kworker.0 Request processed in 54us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.386190:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1783144210.386199:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1783144210.386202:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501229056:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783144210.386208:0:66947:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00080000:3.0:1783144210.386221:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144210.386246:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501229056:12345-0@lo:400:kworker.0 Request processed in 46us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.386254:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1783144210.386288:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144210.386955:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229184 00000100:00100000:0.0:1783144210.386961:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229184 00000100:00100000:1.0:1783144210.386985:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501229056:0@lo:400:kworker.0 00000100:00100000:3.0:1783144210.386994:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501229696:0@lo:400:kworker.0 00000100:00100000:2.0:1783144210.387005:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501229440:0@lo:400:kworker.0 00000100:00100000:0.0:1783144210.387010:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1783144210.387021:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501229184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144210.387025:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501229952:0@lo:400:kworker.0 00000020:02000000:0.0:1783144210.387028:0:66143:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144210.387034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.387035:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229568 00000100:00100000:1.0:1783144210.387041:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229568 00000100:00100000:2.0:1783144210.387047:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501230464:0@lo:400:kworker.0 00000100:00100000:3.0:1783144210.387063:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501230208:0@lo:400:kworker.0 00000100:00100000:2.0:1783144210.387071:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501229312:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.387074:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230080 00000100:00100000:1.0:1783144210.387079:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230080 00000100:00100000:0.0:1783144210.387088:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501229184:12345-0@lo:400:kworker.0 Request processed in 68us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144210.387096:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1783144210.387110:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3658 00000100:00100000:3.0:1783144210.387111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144210.387124:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3659 00000100:00100000:1.0:1783144210.387125:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501229568:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783144210.387132:0:23926:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783144210.387139:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501230080:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783144210.387144:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144210.387163:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501229184:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.387179:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501229568:12345-0@lo:400:kworker.0 Request processed in 59us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.387188:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3658 00000100:00100000:2.0:1783144210.387193:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501230080:12345-0@lo:400:kworker.0 Request processed in 58us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144210.387224:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3659 00000100:00100000:1.0:1783144210.387227:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501229696 00000100:00100000:0.0:1783144210.387227:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230208 00000100:00100000:0.0:1783144210.387233:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230208 00000100:00100000:1.0:1783144210.387240:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501229696 00000100:00080000:2.0:1783144210.387262:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144210.387267:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144210.387273:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1783144210.387287:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:0.0:1783144210.387287:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501230208:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783144210.387295:0:26139:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783144210.387302:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501229696:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783144210.387307:0:26146:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783144210.387338:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501230208:12345-0@lo:400:kworker.0 Request processed in 57us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144210.387347:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1783144210.387351:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501229696:12345-0@lo:400:kworker.0 Request processed in 53us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144210.387361:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501229696:0@lo:400:kworker.0 00000100:00100000:1.0:1783144210.387366:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1783144210.387383:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501230208:0@lo:400:kworker.0 00000100:00100000:0.0:1783144210.387403:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501229568:0@lo:400:kworker.0 00000100:00100000:0.0:1783144210.387416:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501230080:0@lo:400:kworker.0 00000100:00100000:0.0:1783144210.530975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144210.531062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144210.531095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144210.531134:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144210.531177:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481631488 00000100:00100000:0.0:1783144210.531185:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481631488 00000100:00100000:0.0:1783144210.531228:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481631360 00000100:00100000:0.0:1783144210.531230:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481631360 00000100:00100000:0.0:1783144210.531246:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 682 00000100:00100000:0.0:1783144210.531255:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481631488:12345-192.168.203.4@tcp:400:kworker.0 00000020:02000000:0.0:1783144210.531262:0:81077:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783144210.531320:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481631488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144210.531327:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 682 00000100:00100000:0.0:1783144210.531342:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 949 00000100:00100000:0.0:1783144210.531346:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481631360:12345-192.168.203.4@tcp:38:kworker.0 00000020:02000000:0.0:1783144210.531350:0:81077:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1783144210.531369:0:81077:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t90194313217 exp 0000000000000000 cur 2744 last 0 00000020:00000080:0.0:1783144210.531408:0:81077:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a423046dfe 00000004:00100000:0.0:1783144210.531429:0:81077:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783144210.531512:0:81077:0:(import.c:65:import_set_state_nolock()) ffff9c2aee194000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783144210.531534:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144210.531541:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481631360:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 192us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144210.531548:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 949 00000100:00100000:2.0:1783144210.531556:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481631616 00000100:00100000:2.0:1783144210.531562:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481631616 00000100:00080000:2.0:1783144210.531585:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144210.531616:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1917 00000100:00100000:2.0:1783144210.531625:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481631616:12345-192.168.203.4@tcp:400:kworker.0 00000020:02000000:2.0:1783144210.531630:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783144210.531668:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481631616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144210.531675:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1917 00000100:00100000:3.0:1783144210.532088:0:83144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481631232 00000100:00100000:3.0:1783144210.532093:0:83144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481631232 00000100:00100000:3.0:1783144210.532161:0:83144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:3.0:1783144210.532171:0:83144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481631232:12345-192.168.203.4@tcp:400:kworker.0 00000020:02000000:3.0:1783144210.532176:0:83144:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783144210.532216:0:83144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481631232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144210.532224:0:83144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 155 00000100:00100000:0.0:1783144210.540218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144210.540347:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481631744 00000100:00100000:3.0:1783144210.540366:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481631744 00000100:00100000:3.0:1783144210.540424:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 950 00000100:00100000:3.0:1783144210.540435:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:63914:x1869759481631744:12345-192.168.203.4@tcp:41:lfs.0 00000020:02000000:3.0:1783144210.540442:0:66112:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1783144210.540475:0:66112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144210.540538:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:63914:x1869759481631744:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 104us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144210.540546:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 950 00000100:00100000:1.0:1783144210.543068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144210.543537:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481631872 00000100:00100000:2.0:1783144210.543546:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481631872 00000100:00100000:2.0:1783144210.543593:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4908 00000100:00100000:2.0:1783144210.543601:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1869759481631872:12345-192.168.203.4@tcp:8:lfs.0 00000020:02000000:2.0:1783144210.543608:0:8437:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1783144210.543634:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t0 exp 0000000000000000 cur 2744 last 0 00000020:00000080:2.0:1783144210.543662:0:8437:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a423046e05 00002000:00100000:2.0:1783144210.543674:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cace81e7-a6f2-4d37-b197-caf34583781c/ffff9c2ad085b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783144210.543689:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783144210.543798:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783144210.543825:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c29c235f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144210.543888:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481631872:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 286us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144210.543910:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4908 00000100:00100000:0.0:1783144210.545750:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144210.545821:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632000 00000100:00100000:3.0:1783144210.545828:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632000 00000100:00100000:3.0:1783144210.545875:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1508 00000100:00100000:3.0:1783144210.545887:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:63914:x1869759481632000:12345-192.168.203.4@tcp:13:lfs.0 00000020:02000000:3.0:1783144210.545894:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783144210.545912:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144210.545986:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:63914:x1869759481632000:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144210.545993:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1508 00000001:00100000:1.0:1783144210.547305:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00080000:1.0:1783144210.547317:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968822 is committed 00000100:00100000:3.0:1783144210.547713:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144210.547818:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632128 00000100:00100000:2.0:1783144210.547825:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632128 00000100:00100000:2.0:1783144210.547900:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1509 00000100:00100000:2.0:1783144210.547909:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:63914:x1869759481632128:12345-192.168.203.4@tcp:13:lfs.0 00000020:02000000:2.0:1783144210.547915:0:8440:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1783144210.547949:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144210.548006:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:63914:x1869759481632128:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144210.548014:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1509 00000100:00100000:2.0:1783144210.958360:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783144210.958384:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501230592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144210.958452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144210.958497:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230592 00000100:00100000:1.0:1783144210.958505:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230592 00000100:00100000:1.0:1783144210.958554:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1783144210.958563:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501230592:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1783144210.958569:0:11960:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783144210.958587:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144210.958640:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501230592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144210.958647:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1783144210.958991:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501230592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144210.959111:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144210.959122:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501230720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144210.959149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144210.959277:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230720 00000100:00100000:0.0:1783144210.959281:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230720 00000100:00100000:0.0:1783144210.959314:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1783144210.959322:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501230720:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1783144210.959327:0:26788:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783144210.959336:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144210.959380:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501230720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144210.959386:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1783144210.959479:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968822 gen 2 00000100:00100000:3.0:1783144210.959506:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501230720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783144211.405943:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144211.469969:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783144211.469991:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501230848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144211.470062:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144211.470248:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230848 00000100:00100000:2.0:1783144211.470255:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230848 00000100:00100000:2.0:1783144211.470324:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3660 00000100:00100000:2.0:1783144211.470334:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501230848:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1783144211.470341:0:23926:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783144211.470369:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:2.0:1783144211.470439:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501230848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144211.470447:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660 00000100:00100000:0.0:1783144211.470556:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501230848:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1783144211.476745:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968821 is committed 00000001:00100000:3.0:1783144211.477567:0:83139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000100:00100000:1.0:1783144211.979611:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144211.979976:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632256 00000100:00100000:2.0:1783144211.979986:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632256 00000100:00100000:2.0:1783144211.980047:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 951 00000100:00100000:2.0:1783144211.980070:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:64005:x1869759481632256:12345-192.168.203.4@tcp:101:lfs.0 00000020:02000000:2.0:1783144211.980077:0:66114:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1783144211.980093:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144211.980117:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423046e0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41954 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144211.980894:0:66114:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 729us 00010000:00010000:1.0:1783144211.989007:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046e13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144211.989027:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046e13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144211.989055:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046e13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144211.989108:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144211.989112:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1783144211.989141:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046e13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144211.989173:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423046e0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41954 expref: 7 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144211.989190:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046e13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41954 expref: 6 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144211.989199:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea600) 00010000:00010000:1.0:1783144211.989203:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144211.989206:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150a00, rc 0) 00000100:00100000:1.0:1783144211.989273:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:64005:x1869759481632256:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 9203us (9669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144211.989282:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 951 00000100:00100000:1.0:1783144211.993480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144211.994637:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632384 00000100:00100000:0.0:1783144211.994649:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632384 00000100:00100000:0.0:1783144211.994696:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 952 00000100:00100000:0.0:1783144211.994705:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:64005:x1869759481632384:12345-192.168.203.4@tcp:41:lfs.0 00000020:02000000:0.0:1783144211.994713:0:66143:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783144211.994774:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:0.0:1783144211.995015:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:64005:x1869759481632384:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 309us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144211.995034:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 952 00000100:00100000:1.0:1783144211.998577:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144211.998667:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632512 00000100:00100000:0.0:1783144211.998676:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632512 00000100:00100000:0.0:1783144211.998819:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 953 00000100:00100000:0.0:1783144211.998830:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:64005:x1869759481632512:12345-192.168.203.4@tcp:41:lfs.0 00000020:02000000:0.0:1783144211.998838:0:66113:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783144211.998880:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:0.0:1783144211.998964:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:64005:x1869759481632512:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 135us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144211.998972:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 953 00000100:00100000:2.0:1783144212.003900:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144212.004295:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632640 00000100:00100000:1.0:1783144212.004304:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632640 00000100:00100000:1.0:1783144212.004362:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1512 00000100:00100000:1.0:1783144212.004372:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:64005:x1869759481632640:12345-192.168.203.4@tcp:13:lfs.0 00000020:02000000:1.0:1783144212.004380:0:11960:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783144212.004418:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144212.004489:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:64005:x1869759481632640:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 118us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144212.004498:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1512 00000100:00100000:1.0:1783144212.009590:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144212.009662:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632768 00000100:00100000:0.0:1783144212.009672:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632768 00000100:00100000:0.0:1783144212.009747:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1513 00000100:00100000:0.0:1783144212.009761:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:64005:x1869759481632768:12345-192.168.203.4@tcp:13:lfs.0 00000020:02000000:0.0:1783144212.009767:0:26788:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783144212.009799:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144212.009867:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:64005:x1869759481632768:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 108us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144212.009875:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1513 00000100:00080000:2.0:1783144212.010334:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144212.026493:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144212.028524:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481632896 00000100:00100000:0.0:1783144212.028537:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481632896 00000100:00100000:0.0:1783144212.028596:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 954 00000100:00100000:0.0:1783144212.028606:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:63531:x1869759481632896:12345-192.168.203.4@tcp:101:multiop.0 00000020:02000000:0.0:1783144212.028612:0:81077:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1783144212.028735:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144212.028755:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7600/0xad8e53a423046e1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4195b expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.028857:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.028870:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.028880:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.028906:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.028913:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.028919:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029138:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046e2f lrc: 3/1,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029148:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046e2f lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029155:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046e2f lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144212.029183:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a041:0x1:0x0]: returning size 0 00000004:00200000:0.0:1783144212.029187:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1783144212.029215:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046e2f lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029227:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046e2f lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029235:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029242:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029258:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029264:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144212.029267:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029275:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029285:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea600) 00010000:00010000:0.0:1783144212.029288:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144212.029292:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029298:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a423046e21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029310:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029316:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029321:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029325:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144212.029328:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029341:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029348:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9c29c3701000) 00010000:00010000:0.0:1783144212.029350:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144212.029353:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029358:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423046e28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029383:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7600/0xad8e53a423046e1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4195b expref: 8 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029394:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046e2f lrc: 3/0,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4195b expref: 7 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144212.029401:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c29c3701900) 00010000:00010000:0.0:1783144212.029403:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144212.029405:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7e00, rc 0) 00000100:00100000:0.0:1783144212.029465:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:63531:x1869759481632896:12345-192.168.203.4@tcp:101:multiop.0 Request processed in 860us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144212.029472:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 954 00010000:00010000:1.0:1783144212.431141:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144213.006364:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783144213.006390:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501230976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144213.006524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144213.008189:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783144213.008205:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501231104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144213.008247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144213.008291:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501230976 00000100:00100000:0.0:1783144213.008299:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501230976 00000100:00100000:0.0:1783144213.008343:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501231104 00000100:00100000:0.0:1783144213.008347:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501231104 00000100:00100000:0.0:1783144213.008378:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1783144213.008389:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501230976:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144213.008397:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:2.0:1783144213.008408:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501231104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144213.008424:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1783144213.008424:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144213.008566:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501230976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144213.008574:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1783144213.008605:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501231104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144213.008613:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1783144213.008629:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501230976:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783144213.008636:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144213.008641:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144213.008665:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501231104:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144213.454956:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144213.495782:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144213.495853:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481633152 00000100:00100000:3.0:1783144213.495862:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481633152 00000100:00100000:3.0:1783144213.495934:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 955 00000100:00100000:3.0:1783144213.495944:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:64127:x1869759481633152:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1783144213.495993:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783144213.496018:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046e2f lrc: 0/0,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4195b expref: 7 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496036:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c29c3701900) 00010000:00010000:3.0:1783144213.496051:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046e13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41954 expref: 6 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496060:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea600) 00010000:00010000:3.0:1783144213.496066:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144213.496087:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496103:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496125:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496138:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496145:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496151:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496222:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 3/0,1 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496230:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496236:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783144213.496452:0:66143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5a:0x0].2, 64 off8320 00000004:00080000:3.0:1783144213.496461:0:66143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2747849738458ns, next at 2748849736501ns, rc = 0 00010000:00010000:3.0:1783144213.496506:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 3/0,1 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496515:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496523:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496540:0:66143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496547:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496553:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496579:0:66143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144213.496607:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496613:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 2/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496619:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496625:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144213.496629:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496635:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 4/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496643:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c2af565c900) 00010000:00010000:3.0:1783144213.496645:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783144213.496648:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 2/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496663:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e44 lrc: 0/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496675:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496681:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496687:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496691:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fa00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144213.496694:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496699:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496706:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af565cd00) 00010000:00010000:3.0:1783144213.496708:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144213.496710:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496716:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a423046e36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144213.496778:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027296f94 reply state 0000000060c87139 transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496790:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144213.496801:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9c2af565c800) 00010000:00010000:3.0:1783144213.496804:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144213.496806:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783144213.496862:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:64127:x1869759481633152:12345-192.168.203.4@tcp:36:rm.0 Request processed in 920us (1086us total) trans 94489280513 rc 0/0 00000100:00100000:3.0:1783144213.496869:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 955 00000100:00080000:2.0:1783144213.497045:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783144213.498208:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144213.498215:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144213.498223:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144213.498226:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144213.498234:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144213.498244:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c2af565c900) 00010000:00010000:1.0:1783144213.498246:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783144213.498249:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 1/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144213.498255:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423046e4b lrc: 0/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144213.498267:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144213.498269:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144213.498270:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144213.520221:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144213.520241:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501231232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144213.520299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144213.520382:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501231232 00000100:00100000:0.0:1783144213.520387:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501231232 00000100:00100000:0.0:1783144213.520448:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3661 00000100:00100000:0.0:1783144213.520455:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501231232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783144213.520486:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:0.0:1783144213.520535:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501231232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144213.520542:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3661 00000100:00100000:1.0:1783144213.520580:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501231232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783144214.478020:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144215.502095:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144215.567551:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501231488:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.567608:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.567630:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501232000:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.567651:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.567663:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501232512:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.567679:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.567698:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1783144215.567702:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501231360:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.567754:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.567779:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501231872:0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.567796:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232000 00000100:00100000:1.0:1783144215.567802:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144215.567806:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232000 00000100:00100000:1.0:1783144215.567819:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501232384:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.567839:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.567855:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501232896:0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.567860:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232512 00000100:00100000:0.0:1783144215.567865:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232512 00000100:00100000:1.0:1783144215.567876:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144215.567893:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3662 00000100:00100000:0.0:1783144215.567914:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501232000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.567930:0:83145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501231360 00000100:00100000:1.0:1783144215.567935:0:83145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501231360 00000100:00100000:1.0:1783144215.567966:0:83145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783144215.567975:0:83145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501231360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.567981:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501232000:12345-0@lo:400:kworker.0 Request processed in 66us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144215.568001:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3662 00000100:00100000:1.0:1783144215.568011:0:83145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501231360:12345-0@lo:400:kworker.0 Request processed in 37us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.568019:0:83145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783144215.568025:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3663 00000100:00100000:0.0:1783144215.568035:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501232512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568049:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501231488 00000100:00100000:1.0:1783144215.568062:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501231488 00000100:00100000:0.0:1783144215.568071:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501232512:12345-0@lo:400:kworker.0 Request processed in 37us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144215.568089:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663 00000100:00100000:1.0:1783144215.568095:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501231872 00000100:00100000:1.0:1783144215.568099:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501231872 00000100:00100000:0.0:1783144215.568115:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501231616:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568118:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232384 00000100:00100000:1.0:1783144215.568123:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232384 00000100:00100000:1.0:1783144215.568137:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232896 00000100:00100000:1.0:1783144215.568139:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232896 00000100:00100000:1.0:1783144215.568156:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1783144215.568158:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.568166:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501231488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568187:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501232128:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568198:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501231488:12345-0@lo:400:kworker.0 Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.568205:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1783144215.568217:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501231616 00000100:00100000:0.0:1783144215.568221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.568222:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501231616 00000100:00100000:1.0:1783144215.568242:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1783144215.568246:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501232640:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568252:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501231872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.568286:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501231872:12345-0@lo:400:kworker.0 Request processed in 37us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.568293:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1783144215.568300:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783144215.568308:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1783144215.568311:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501231744:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568318:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501232384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.568356:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501232384:12345-0@lo:400:kworker.0 Request processed in 39us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144215.568361:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501232256:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568365:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1783144215.568377:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501231744 00000100:00100000:1.0:1783144215.568380:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501231744 00000100:00100000:1.0:1783144215.568402:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1783144215.568403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.568412:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501232896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568426:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501232768:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568452:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501232896:12345-0@lo:400:kworker.0 Request processed in 42us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.568459:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1783144215.568475:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1783144215.568475:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144215.568485:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501231616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568521:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501231616:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144215.568526:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1783144215.568534:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1783144215.568538:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501231744:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783144215.568556:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144215.568560:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144215.568577:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501231744:12345-0@lo:400:kworker.0 Request processed in 42us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144215.568584:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1783144215.568611:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501231360:0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568613:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232128 00000100:00100000:0.0:1783144215.568619:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232128 00000100:00100000:1.0:1783144215.568628:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501231872:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568642:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501232384:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568651:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501232896:0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568661:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232640 00000100:00100000:1.0:1783144215.568663:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501231488:0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568667:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232640 00000100:00100000:1.0:1783144215.568675:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501232000:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568688:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501232512:0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568691:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232256 00000100:00100000:0.0:1783144215.568696:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232256 00000100:00100000:1.0:1783144215.568761:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501232768 00000100:00100000:1.0:1783144215.568765:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501232768 00000100:00100000:1.0:1783144215.568792:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1783144215.568799:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501232128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568832:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501232128:12345-0@lo:400:kworker.0 Request processed in 34us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.568848:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1783144215.568862:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:1.0:1783144215.568868:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501232640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568910:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501232640:12345-0@lo:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.568916:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:1.0:1783144215.568930:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1783144215.568937:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501232256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144215.568941:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1783144215.568954:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501232768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.568967:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501232256:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.568974:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:0.0:1783144215.568996:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501232768:12345-0@lo:400:kworker.0 Request processed in 45us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144215.569003:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1783144215.569006:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501231744:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.569020:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501232256:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.569030:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968821 gen 2 00000100:00080000:0.0:1783144215.569037:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144215.569041:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501232768:0@lo:400:kworker.0 00000100:00080000:0.0:1783144215.569042:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144215.569055:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501231616:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.569063:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501232128:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.569071:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501232640:0@lo:400:kworker.0 00000100:00100000:1.0:1783144215.655139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144215.655210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144215.655245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144215.655279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144215.655295:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481633408 00000100:00100000:2.0:1783144215.655326:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481633408 00000100:00100000:1.0:1783144215.655328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144215.655367:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481633536 00000100:00100000:1.0:1783144215.655379:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481633536 00000100:00100000:2.0:1783144215.655422:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 689 00000100:00100000:2.0:1783144215.655435:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481633408:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144215.655466:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 690 00000100:00100000:1.0:1783144215.655480:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481633536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144215.655547:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481633408:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 113us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144215.655566:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 689 00000100:00100000:1.0:1783144215.655568:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481633536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.655581:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 690 00000100:00080000:2.0:1783144215.655603:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144215.655609:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144215.655618:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481633664 00000100:00100000:1.0:1783144215.655623:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481633664 00000100:00100000:1.0:1783144215.655660:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481633792 00000100:00100000:1.0:1783144215.655663:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481633792 00000100:00100000:1.0:1783144215.655702:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1922 00000100:00100000:1.0:1783144215.655709:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cace81e7-a6f2-4d37-b197-caf34583781c+5:2403:x1869759481633664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144215.655787:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cace81e7-a6f2-4d37-b197-caf34583781c+5:2403:x1869759481633664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.655797:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1922 00000100:00100000:1.0:1783144215.655823:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1923 00000100:00100000:1.0:1783144215.655832:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481633792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144215.655862:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481633792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144215.655869:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1923 00000100:00080000:2.0:1783144215.656288:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144215.656295:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144215.656384:0:83148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481633280 00000100:00100000:3.0:1783144215.656390:0:83148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481633280 00000100:00100000:3.0:1783144215.656417:0:83148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:3.0:1783144215.656422:0:83148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addf84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2404:x1869759481633280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144215.656494:0:83148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addf84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2404:x1869759481633280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144215.656502:0:83148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 157 00000100:00100000:2.0:1783144216.079289:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783144216.079312:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501233024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144216.079376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783144216.079521:0:83159:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2750432797982ns, next at 2751432795499ns, rc = 0 00000100:00100000:3.0:1783144216.079537:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144216.079546:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501233152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144216.079576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144216.079745:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501233024 00000100:00100000:0.0:1783144216.079754:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501233024 00000100:00100000:0.0:1783144216.079796:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501233152 00000100:00100000:0.0:1783144216.079799:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501233152 00000100:00100000:0.0:1783144216.079834:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1783144216.079850:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501233024:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144216.079871:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00002000:00000024:0.0:1783144216.079880:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144216.079885:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afad30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501233152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783144216.079914:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144216.079954:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501233024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144216.079962:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afad30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501233152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144216.079964:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:2.0:1783144216.079973:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1783144216.080018:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501233152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144216.080190:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501233024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783144216.526507:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144216.553355:0:83870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 01:50:16 (1783144216) 00000100:00100000:3.0:1783144216.591048:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144216.591072:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501233280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144216.591139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144216.591177:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501233280 00000100:00100000:2.0:1783144216.591184:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501233280 00000100:00100000:2.0:1783144216.591226:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3664 00000100:00100000:2.0:1783144216.591233:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501233280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783144216.591266:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:2.0:1783144216.591317:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501233280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144216.591333:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664 00000100:00100000:3.0:1783144216.591653:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501233280:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1783144216.980321:0:83139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1783144216.980352:0:83139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000004:00080000:3.0:1783144216.980357:0:83139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1783144216.980448:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144216.980450:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1783144216.980462:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.980470:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144216.980472:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501233408:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783144216.980477:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144216.980483:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.980492:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.980513:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9c2af565c800) 00010000:00010000:2.0:1783144216.980516:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144216.980521:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.980527:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a423046e3d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144216.980564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144216.980766:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501233408 00000100:00100000:3.0:1783144216.980772:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501233408 00000100:00100000:3.0:1783144216.980816:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909 00000100:00100000:3.0:1783144216.980825:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501233408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783144216.980851:0:8602:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1666 count 1 00010000:00010000:3.0:1783144216.980871:0:8602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144216.980900:0:8602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a4230469f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41931 expref: 5 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144216.980910:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=205s v=(0 0) 00010000:00010000:3.0:1783144216.980914:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144216.980919:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144216.980945:0:8602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a4230469f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41931 expref: 5 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144216.980959:0:8602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a4230469f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41931 expref: 5 pid: 8435 timeout: 2851 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144216.980972:0:8602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8602:1869759501233536:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144216.981038:0:8602:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144216.985105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144216.985143:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481633920 00000100:00100000:1.0:1783144216.985153:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481633920 00010000:00010000:1.0:1783144216.985192:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a4230469f2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41931 expref: 6 pid: 8435 timeout: 2851 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144216.985241:0:8602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8602:1869759501233536:192.168.203.4@tcp:104: 00010000:00010000:0.0:1783144216.985265:0:8602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144216.985377:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2534 00000100:00100000:2.0:1783144216.985388:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad1392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481633920:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783144216.985401:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144216.985428:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a4230469f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41931 expref: 6 pid: 8435 timeout: 2851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985442:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a4230469f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41931 expref: 6 pid: 8435 timeout: 2851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985465:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a4230469f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41931 expref: 6 pid: 8435 timeout: 2851 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985479:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144216.985483:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144216.985489:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985499:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985522:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144216.985545:0:8602:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144216.985557:0:8602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144216.985575:0:8602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144216.985582:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad1392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481633920:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 194us (481us total) trans 0 rc 0/0 00010000:00010000:0.0:1783144216.985590:0:8602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144216.985595:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2534 00010000:00010000:0.0:1783144216.985621:0:8602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144216.985666:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144216.985673:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985682:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144216.985686:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985703:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985716:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985749:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423046e52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144216.985771:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144216.985774:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144216.985777:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144216.985859:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501233408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5034us (5296us total) trans 4294968822 rc 0/0 00000100:00100000:0.0:1783144216.985868:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909 00000004:00080000:2.0:1783144216.985925:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c2aef4bc000/2, rc 0, transno 4294968822 00000100:00100000:2.0:1783144216.985932:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501233408:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1783144216.989561:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968822 is committed 00000100:00100000:1.0:1783144217.014475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144217.014537:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634048 00000100:00100000:3.0:1783144217.014547:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634048 00000100:00100000:3.0:1783144217.014620:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 956 00000100:00100000:3.0:1783144217.014638:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+5:64713:x1869759481634048:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144217.014655:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144217.014675:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41962 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783144217.014688:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783144217.015129:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423046e60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.015144:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423046e60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.015156:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423046e60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144217.015199:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144217.015203:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783144217.015223:0:66112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423046e60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.015249:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41962 expref: 7 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.015264:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423046e60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41962 expref: 6 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.015273:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af9dfb600) 00010000:00010000:3.0:1783144217.016818:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144217.016825:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043f400, rc 0) 00000100:00100000:3.0:1783144217.017133:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:64713:x1869759481634048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2493us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144217.017152:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 956 00000100:00100000:3.0:1783144217.022718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144217.022824:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634176 00000100:00100000:2.0:1783144217.022834:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634176 00000100:00100000:2.0:1783144217.022900:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 957 00000100:00100000:2.0:1783144217.022910:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:64713:x1869759481634176:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144217.022957:0:66114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:2.0:1783144217.023025:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:64713:x1869759481634176:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144217.023033:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 957 00000100:00100000:2.0:1783144217.024302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144217.024416:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634304 00000100:00100000:1.0:1783144217.024422:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634304 00000100:00100000:1.0:1783144217.024474:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 958 00000100:00100000:1.0:1783144217.024483:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:64713:x1869759481634304:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144217.024506:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:1.0:1783144217.024543:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:64713:x1869759481634304:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 62us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144217.024549:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 958 00000100:00080000:2.0:1783144217.024593:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144217.029464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144217.029800:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634432 00000100:00100000:1.0:1783144217.029809:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634432 00000100:00080000:3.0:1783144217.029852:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144217.029910:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1518 00000100:00100000:1.0:1783144217.029921:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:64713:x1869759481634432:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144217.029943:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144217.030006:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:64713:x1869759481634432:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 88us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144217.030013:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1518 00000100:00100000:3.0:1783144217.032478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144217.033863:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634560 00000100:00100000:0.0:1783144217.033873:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634560 00000100:00100000:0.0:1783144217.033939:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1519 00000100:00100000:0.0:1783144217.033949:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:64713:x1869759481634560:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:0.0:1783144217.033972:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144217.034028:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:64713:x1869759481634560:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 81us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144217.034036:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1519 00000100:00080000:2.0:1783144217.034583:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144217.077056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144217.077851:0:66890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634688 00000100:00100000:1.0:1783144217.077861:0:66890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634688 00000100:00100000:1.0:1783144217.077953:0:66890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:1.0:1783144217.077964:0:66890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:cace81e7-a6f2-4d37-b197-caf34583781c+6:64720:x1869759481634688:12345-192.168.203.4@tcp:700:mcreate.0 00000100:00100000:1.0:1783144217.078058:0:66890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:cace81e7-a6f2-4d37-b197-caf34583781c+6:64720:x1869759481634688:12345-192.168.203.4@tcp:700:mcreate.0 Request processed in 96us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144217.078066:0:66890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1783144217.082918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144217.083187:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634944 00000100:00100000:1.0:1783144217.083197:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634944 00000100:00100000:1.0:1783144217.083314:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 959 00000100:00100000:1.0:1783144217.083325:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:64720:x1869759481634944:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00010000:1.0:1783144217.083377:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144217.083400:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423046e60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41962 expref: 6 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.083417:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af9dfb600) 00010000:00010000:1.0:1783144217.083426:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144217.083483:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.083495:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.083505:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.083516:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.083523:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.083529:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084006:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084015:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084021:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084028:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144217.084032:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084039:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084048:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e900) 00010000:00010000:1.0:1783144217.084051:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144217.084054:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084060:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046e67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144217.084073:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f5f7beb reply state 00000000065dcb71 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084084:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144217.084089:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ed00) 00010000:00010000:1.0:1783144217.084098:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144217.084100:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144217.084191:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:64720:x1869759481634944:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 867us (1280us total) trans 94489280514 rc 0/0 00000100:00100000:1.0:1783144217.084199:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 959 00000100:00100000:3.0:1783144217.100583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144217.100651:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635072 00000100:00100000:2.0:1783144217.100660:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635072 00000100:00100000:2.0:1783144217.100756:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 960 00000100:00100000:2.0:1783144217.100767:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:64723:x1869759481635072:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1783144217.100791:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144217.100822:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423046e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41969 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144217.100878:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423046e7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144217.100902:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423046e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144217.100915:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423046e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144217.100959:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144217.100963:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783144217.100984:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423046e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144217.101007:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423046e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41969 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144217.101023:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423046e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41969 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144217.101032:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ead00) 00010000:00010000:2.0:1783144217.101046:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144217.101049:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e200, rc 0) 00000100:00100000:2.0:1783144217.101101:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:64723:x1869759481635072:12345-192.168.203.4@tcp:101:rm.0 Request processed in 336us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144217.101108:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 960 00000100:00100000:2.0:1783144217.102921:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144217.102947:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635200 00000100:00100000:1.0:1783144217.102955:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635200 00000100:00100000:3.0:1783144217.103007:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 961 00000100:00100000:3.0:1783144217.103074:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:64723:x1869759481635200:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1783144217.103090:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144217.103104:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41970 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103160:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103171:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103180:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103198:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103206:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103212:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103304:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423046e98 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103313:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423046e98 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103319:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423046e98 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144217.103354:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:3.0:1783144217.103357:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783144217.103374:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423046e98 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103384:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423046e98 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103392:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103398:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103404:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103409:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144217.103413:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103420:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103437:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ead00) 00010000:00010000:3.0:1783144217.103440:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144217.103444:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103450:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a423046e8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103460:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103466:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103471:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103477:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144217.103479:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103484:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103490:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ed00) 00010000:00010000:3.0:1783144217.103493:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144217.103496:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103501:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423046e91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103533:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f000/0xad8e53a423046e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41970 expref: 10 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103545:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423046e98 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41970 expref: 9 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.103552:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2af9dfb700) 00010000:00010000:3.0:1783144217.103554:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144217.103556:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043fe00, rc 0) 00000100:00100000:3.0:1783144217.103615:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+9:64723:x1869759481635200:12345-192.168.203.4@tcp:101:rm.0 Request processed in 546us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144217.104026:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 961 00000100:00100000:3.0:1783144217.105674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144217.105748:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635456 00000100:00100000:0.0:1783144217.105756:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635456 00000100:00100000:0.0:1783144217.105807:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 962 00000100:00100000:0.0:1783144217.105817:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:64723:x1869759481635456:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1783144217.105857:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783144217.105881:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423046e98 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41970 expref: 9 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.105910:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2af9dfb700) 00010000:00010000:0.0:1783144217.105932:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423046e7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41969 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.105942:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ead00) 00010000:00010000:0.0:1783144217.105948:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144217.105968:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.105978:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.105987:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.105998:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106005:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106011:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106087:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106095:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106108:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106301:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106310:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106318:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106326:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106331:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106337:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106430:0:66112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144217.106450:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106457:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106464:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106466:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144217.106474:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144217.106475:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106488:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144217.106488:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106494:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106501:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106508:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106513:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c29c3701300) 00010000:00010000:0.0:1783144217.106518:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783144217.106522:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106527:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c29c3701300) 00010000:00010000:0.0:1783144217.106529:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423046ead lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106534:0:9525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783144217.106539:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106550:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106567:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423046eb4 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106568:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106584:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106590:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144217.106592:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144217.106596:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144217.106598:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144217.106599:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144217.106605:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106612:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106632:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29c3701700) 00010000:00010000:0.0:1783144217.106634:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144217.106638:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106644:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423046e9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144217.106656:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000242a90b7 reply state 0000000012d30b09 transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106667:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144217.106673:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ed00) 00010000:00010000:0.0:1783144217.106675:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144217.106678:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144217.106766:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:64723:x1869759481635456:12345-192.168.203.4@tcp:36:rm.0 Request processed in 950us (1096us total) trans 94489280515 rc 0/0 00000100:00100000:0.0:1783144217.106773:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 962 00010000:00010000:1.0:1783144217.550877:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144218.125858:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144218.125888:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501233664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144218.125950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144218.125994:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501233664 00000100:00100000:0.0:1783144218.126001:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501233664 00000100:00100000:0.0:1783144218.126055:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1783144218.126064:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501233664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144218.126091:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783144218.126144:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144218.126156:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501233664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144218.126165:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1783144218.126211:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501233664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144218.126894:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501233792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144218.126928:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144218.127004:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501233792 00000100:00100000:1.0:1783144218.127010:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501233792 00000100:00080000:2.0:1783144218.127061:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144218.127062:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1783144218.127076:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501233792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144218.127096:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144218.127292:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501233792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 218us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144218.127301:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1783144218.127454:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501233792:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144218.574377:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144218.638679:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144218.638702:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501233920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144218.638961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144218.639321:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501233920 00000100:00100000:1.0:1783144218.639329:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501233920 00000100:00100000:1.0:1783144218.639385:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3665 00000100:00100000:1.0:1783144218.639394:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501233920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783144218.639423:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:1.0:1783144218.639478:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501233920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144218.639485:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3665 00000100:00100000:2.0:1783144218.639542:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501233920:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783144219.598855:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783144220.009925:0:84264:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1783144220.038052:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144220.038169:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635584 00000100:00100000:2.0:1783144220.038180:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635584 00000100:00100000:2.0:1783144220.038278:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 963 00000100:00100000:2.0:1783144220.038290:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+9:64790:x1869759481635584:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144220.038312:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144220.038334:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423046ebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41977 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.038390:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423046ec2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.038403:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423046ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.038422:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423046ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144220.038460:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144220.038464:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783144220.038481:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423046ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.038504:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423046ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41977 expref: 11 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.038519:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423046ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41977 expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.038528:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea900) 00010000:00010000:2.0:1783144220.038531:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144220.038534:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fa00, rc 0) 00010000:00000080:2.0:1783144220.038541:0:66114:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c50e7480 x1869759481635584/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:331/0 lens 576/688 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144220.038595:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+10:64790:x1869759481635584:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 309us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.038603:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 963 00000100:00080000:3.0:1783144220.038652:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144220.039951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144220.040074:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635712 00000100:00100000:1.0:1783144220.040080:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635712 00000100:00100000:1.0:1783144220.040132:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 964 00000100:00100000:1.0:1783144220.040145:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+10:64790:x1869759481635712:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144220.040155:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144220.040174:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046ec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4197e expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040211:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040221:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040231:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040245:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040252:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040261:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040294:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040303:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040309:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040316:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040323:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144220.040334:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040342:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040355:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea900) 00010000:00010000:1.0:1783144220.040358:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144220.040362:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040370:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423046ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040384:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040391:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040397:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040404:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144220.040408:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040414:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040425:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c2aee58e100) 00010000:00010000:1.0:1783144220.040428:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144220.040437:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040444:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423046ed7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040471:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046ec9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4197e expref: 11 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040483:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea900) 00010000:00010000:1.0:1783144220.040486:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144220.040490:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423046ec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4197e expref: 11 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.040499:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150000, rc 0) 00010000:00000080:1.0:1783144220.040504:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af9f1ea00 x1869759481635712/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:331/0 lens 592/584 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144220.040555:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+10:64790:x1869759481635712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 414us (606us total) trans 0 rc 301/301 00000100:00100000:1.0:1783144220.040563:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 964 00000100:00100000:2.0:1783144220.042162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144220.042204:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635968 00000100:00100000:1.0:1783144220.042210:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635968 00000100:00100000:1.0:1783144220.042254:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 965 00000100:00100000:1.0:1783144220.042263:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:64790:x1869759481635968:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144220.042274:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144220.042277:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783144220.042293:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423046ec2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41977 expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042319:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea900) 00010000:00010000:1.0:1783144220.042333:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144220.042344:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423046ede lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41985 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042406:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042417:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042425:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042436:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042443:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042450:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042840:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042850:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042858:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144220.042886:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783144220.042908:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042916:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042923:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042929:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144220.042934:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042940:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042950:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e800) 00010000:00010000:1.0:1783144220.042953:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144220.042957:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042972:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423046ee5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144220.042984:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075c4bb90 reply state 0000000078e056e2 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.042995:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.043012:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c2aee58e400) 00010000:00010000:1.0:1783144220.043015:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144220.043017:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144220.043041:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423046ede lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.043061:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.043069:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c2aee58e000) 00010000:00010000:1.0:1783144220.043071:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144220.043074:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151000, rc 0) 00010000:00000080:1.0:1783144220.043484:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af9f1e300 x1869759481635968/t94489280516(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:331/0 lens 536/608 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144220.043534:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+12:64790:x1869759481635968:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1271us (1372us total) trans 94489280516 rc 0/0 00000100:00100000:1.0:1783144220.043541:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 965 00000100:00100000:3.0:1783144220.045119:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144220.045199:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636224 00000100:00100000:2.0:1783144220.045206:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636224 00000100:00100000:2.0:1783144220.045246:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 966 00000100:00100000:2.0:1783144220.045256:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:64790:x1869759481636224:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144220.045279:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144220.045293:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a423046f01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4198c expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.045359:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.045373:0:66113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.045382:0:66113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.045411:0:66113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.045424:0:66113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 13 pid: 66143 timeout: 2854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144220.045437:0:66113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66113:1869759501234048:192.168.203.4@tcp:104: 00000100:00100000:2.0:1783144220.045501:0:66113:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144220.046674:0:66113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66113:1869759501234048:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144220.046691:0:66113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144220.047685:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144220.047793:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636352 00000100:00100000:1.0:1783144220.047799:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636352 00010000:00010000:1.0:1783144220.047822:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 14 pid: 66143 timeout: 2854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144220.047861:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2535 00000100:00100000:1.0:1783144220.047879:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cace81e7-a6f2-4d37-b197-caf34583781c+14:2404:x1869759481636352:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144220.047889:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144220.047896:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 14 pid: 66143 timeout: 2854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.047913:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 14 pid: 66143 timeout: 2854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.047930:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423046ef3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 14 pid: 66143 timeout: 2854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.047942:0:26153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c2aee58e000) 00010000:00010000:1.0:1783144220.047947:0:26153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.047956:0:26153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.047962:0:26153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.047981:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144220.048016:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cace81e7-a6f2-4d37-b197-caf34583781c+13:2404:x1869759481636352:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 147us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.048023:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2535 00010000:00010000:1.0:1783144220.048101:0:66113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048109:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144220.048120:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783144220.048286:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048303:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048309:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048314:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144220.048318:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048325:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048333:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c2aee58e000) 00010000:00010000:1.0:1783144220.048336:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783144220.048340:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048345:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423046f08 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048387:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a423046f01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4198c expref: 13 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048396:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71ea000) 00010000:00010000:1.0:1783144220.048398:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783144220.048402:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a423046f01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4198c expref: 13 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.048413:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e600, rc 0) 00010000:00000080:1.0:1783144220.048425:0:66113:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c50e5500 x1869759481636224/t94489280517(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:331/0 lens 712/824 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144220.048468:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:64790:x1869759481636224:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 3214us (3350us total) trans 94489280517 rc 301/301 00000100:00100000:1.0:1783144220.048475:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 966 00000100:00100000:3.0:1783144220.051948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144220.051987:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636608 00000100:00100000:0.0:1783144220.051994:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636608 00000100:00100000:0.0:1783144220.052042:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:0.0:1783144220.052053:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:64790:x1869759481636608:12345-192.168.203.4@tcp:35:lfs.0 00010000:00000080:0.0:1783144220.052202:0:66116:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4e9fb80 x1869759481636608/t94489280518(0) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:331/0 lens 392/456 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144220.052252:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+13:64790:x1869759481636608:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 201us (306us total) trans 94489280518 rc 0/0 00000100:00100000:0.0:1783144220.052261:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 209 00000100:00100000:3.0:1783144220.053356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144220.053420:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636864 00000100:00100000:1.0:1783144220.053425:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636864 00000100:00100000:1.0:1783144220.053464:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:1.0:1783144220.053473:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+13:64790:x1869759481636864:12345-192.168.203.4@tcp:35:lfs.0 00010000:00000080:1.0:1783144220.053571:0:66115:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4e9ca80 x1869759481636864/t94489280519(0) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:331/0 lens 392/456 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144220.053643:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+14:64790:x1869759481636864:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 172us (288us total) trans 94489280519 rc 0/0 00000100:00100000:1.0:1783144220.053651:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00010000:00010000:3.0:1783144220.622825:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144220.686469:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501234176:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.686538:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144220.686581:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501234688:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.686607:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144220.686628:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501235200:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.686648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144220.686662:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501235712:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.686680:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144220.686702:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783144220.686707:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501234304:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.686754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144220.686770:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501234816:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.686792:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144220.686808:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501235328:0@lo:400:kworker.0 00000100:00100000:0.0:1783144220.686921:0:83145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501234176 00000100:00100000:0.0:1783144220.686929:0:83145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501234176 00000100:00100000:0.0:1783144220.686969:0:83145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783144220.686979:0:83145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa9ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501234176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.687071:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501234432:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.687896:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.687921:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501234944:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.687945:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.687963:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501235456:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.687982:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.688008:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783144220.688015:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501234560:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.688034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.688049:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501235072:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.688066:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.688080:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501235584:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.688097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.688129:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501234688 00000100:00100000:0.0:1783144220.688219:0:83145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa9ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501234176:12345-0@lo:400:kworker.0 Request processed in 1240us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144220.688228:0:83145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783144220.688280:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235200 00000100:00100000:0.0:1783144220.688285:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235200 00000100:00100000:0.0:1783144220.688306:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235712 00000100:00100000:0.0:1783144220.688308:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235712 00000100:00100000:0.0:1783144220.688318:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501234304 00000100:00100000:0.0:1783144220.688321:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501234304 00000100:00100000:0.0:1783144220.688349:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501234432 00000100:00080000:3.0:1783144220.688350:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144220.688357:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501234432 00000100:00100000:0.0:1783144220.688377:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501234560 00000100:00100000:0.0:1783144220.688379:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501234560 00000100:00100000:0.0:1783144220.688396:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1783144220.688403:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501235200:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783144220.688418:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab13100 x1869759501235200/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1783144231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144220.688448:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501235200:12345-0@lo:400:kworker.0 Request processed in 46us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144220.688453:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00080000:3.0:1783144220.688455:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783144220.688458:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144220.688465:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1783144220.688471:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501235712:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783144220.688480:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab10380 x1869759501235712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1783144231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144220.688504:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501235712:12345-0@lo:400:kworker.0 Request processed in 34us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144220.688521:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1783144220.688532:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1783144220.688537:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501234304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.688606:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144220.688642:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501234176:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.688657:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501235200:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.688667:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501235712:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.688698:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501234816 00000100:00100000:2.0:1783144220.688701:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501234688 00000100:00100000:1.0:1783144220.688703:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501234816 00000100:00100000:2.0:1783144220.688759:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1783144220.688766:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501234432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.688792:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235328 00000100:00100000:1.0:1783144220.688796:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235328 00000100:00100000:2.0:1783144220.688805:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501234432:12345-0@lo:400:kworker.0 Request processed in 38us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.688813:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1783144220.688819:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666 00000100:00100000:1.0:1783144220.688827:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501234816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.688832:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1783144220.688841:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501234560:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783144220.688846:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab11500 x1869759501234816/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000080:2.0:1783144220.688855:0:66114:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af9f1fb80 x1869759501234560/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1783144231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144220.688904:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501234816:12345-0@lo:400:kworker.0 Request processed in 77us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.688906:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501234560:12345-0@lo:400:kworker.0 Request processed in 64us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.688918:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666 00000100:00100000:2.0:1783144220.688920:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1783144220.688945:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3667 00000100:00100000:2.0:1783144220.688946:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1783144220.688962:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501234688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.688962:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501235328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.689008:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501234688:12345-0@lo:400:kworker.0 Request processed in 52us (2399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.689015:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501235328:12345-0@lo:400:kworker.0 Request processed in 58us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.689018:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1783144220.689026:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3667 00000100:00100000:2.0:1783144220.689051:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501234944 00000100:00100000:2.0:1783144220.689055:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501234944 00000100:00100000:1.0:1783144220.689062:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235456 00000100:00100000:1.0:1783144220.689067:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235456 00000100:00100000:2.0:1783144220.689087:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235072 00000100:00100000:2.0:1783144220.689092:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235072 00000100:00100000:1.0:1783144220.689098:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235584 00000100:00100000:1.0:1783144220.689102:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235584 00000100:00100000:2.0:1783144220.689121:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:2.0:1783144220.689131:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501234944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.689135:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:1.0:1783144220.689145:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501235456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.689169:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501234944:12345-0@lo:400:kworker.0 Request processed in 39us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.689178:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1783144220.689188:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501235456:12345-0@lo:400:kworker.0 Request processed in 43us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.689194:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1783144220.689201:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:2.0:1783144220.689204:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501235072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.689220:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1783144220.689239:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501235072:12345-0@lo:400:kworker.0 Request processed in 37us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.689240:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501235584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.689253:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00080000:2.0:1783144220.689278:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144220.689281:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144220.689283:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144220.689300:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501234560:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.689311:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501235072:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.689320:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501234432:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.689329:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501234944:0@lo:400:kworker.0 00000100:00100000:2.0:1783144220.689339:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501235456:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.689404:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501235584:12345-0@lo:400:kworker.0 Request processed in 177us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.689412:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1783144220.689467:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968822 gen 2 00000004:00080000:1.0:1783144220.689473:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c2aef4bc000, transno 4294968822 00000100:00100000:1.0:1783144220.689484:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501235584:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.689516:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501234816:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.689527:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501235328:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.689536:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501234688:0@lo:400:kworker.0 00010000:00000080:0.0:1783144220.691490:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab11880 x1869759501234304/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1783144231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144220.691562:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501234304:12345-0@lo:400:kworker.0 Request processed in 3022us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144220.691572:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1783144220.691602:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501234304:0@lo:400:kworker.0 00000100:00100000:1.0:1783144220.772006:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144220.772045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144220.772068:0:83144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636992 00000100:00100000:2.0:1783144220.772079:0:83144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636992 00000100:00100000:1.0:1783144220.772123:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144220.772130:0:83144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:2.0:1783144220.772143:0:83144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa9adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481636992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144220.772149:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481637120 00000100:00100000:1.0:1783144220.772160:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481637120 00000100:00100000:1.0:1783144220.772188:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481637248 00000100:00100000:1.0:1783144220.772191:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481637248 00000100:00100000:2.0:1783144220.772220:0:83144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa9adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481636992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.772221:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 697 00000100:00100000:2.0:1783144220.772234:0:83144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:1.0:1783144220.772234:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+14:2403:x1869759481637120:12345-192.168.203.4@tcp:400:kworker.0 00010000:00000080:1.0:1783144220.772260:0:66113:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab11f80 x1869759481637120/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:331/0 lens 224/224 e 0 to 0 dl 1783144231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144220.772270:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144220.772289:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+14:2403:x1869759481637120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 58us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.772296:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 697 00000100:00100000:1.0:1783144220.772310:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 698 00000100:00100000:1.0:1783144220.772315:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481637248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144220.772335:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481637248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.772340:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 698 00000100:00100000:3.0:1783144220.772479:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144220.772610:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144220.772957:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481637376 00000100:00100000:1.0:1783144220.772961:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481637376 00000100:00100000:1.0:1783144220.773001:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481637504 00000100:00100000:1.0:1783144220.773004:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481637504 00000100:00100000:1.0:1783144220.773025:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1928 00000100:00100000:1.0:1783144220.773032:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2403:x1869759481637376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144220.773065:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2403:x1869759481637376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.773072:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1928 00000100:00100000:1.0:1783144220.773084:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1929 00000100:00100000:1.0:1783144220.773091:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481637504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144220.773122:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481637504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144220.773129:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1929 00000100:00080000:3.0:1783144220.773321:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144220.773324:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1783144220.930841:0:84363:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783144220.930904:0:84363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.930921:0:84363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.930929:0:84363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.930936:0:84363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.930956:0:84363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783144220.930962:0:84363:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783144220.930993:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783144220.930997:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783144220.931003:0:84363:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783144220.931025:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783144220.931086:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501235840:0@lo:39:umount.0 00000100:00100000:0.0:1783144220.931158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.931247:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235840 00000100:00100000:2.0:1783144220.931254:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235840 00000100:00100000:2.0:1783144220.931327:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1783144220.931337:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501235840:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783144220.931359:0:66112:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046c30 00000100:00080000:2.0:1783144220.931373:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c2aee197800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783144220.931379:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144220.931392:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.931401:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0c00 already unused, calling callback (ffffffffc1204c20) 00010000:00000080:2.0:1783144220.931401:0:66112:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4b36d80 x1869759501235840/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1783144231 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 10000000:00010000:3.0:1783144220.931408:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.931424:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144220.931431:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144220.931436:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783144220.931439:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783144220.931442:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1783144220.931455:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1869759501235840:12345-0@lo:39:umount.0 Request processed in 119us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.931462:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00010000:00010000:3.0:1783144220.931467:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783144220.931472:0:66112:0:(genops.c:906:class_export_put()) final put ffff9c2aee190800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1783144220.931478:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144220.931498:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.931505:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423046b11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b18 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.931525:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144220.931527:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144220.931528:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144220.931538:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501235968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144220.931572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144220.931622:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501235968 00000100:00100000:3.0:1783144220.931627:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501235968 00000020:00000080:1.0:1783144220.931643:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee190800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1783144220.931663:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1783144220.931673:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501235968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144220.931684:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1783144220.931692:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee197800 for lustre-MDT0000 00010000:00010000:3.0:1783144220.931699:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7a00/0xad8e53a423046b18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b11 expref: 24 pid: 83145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.931713:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1783144220.931742:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783144220.931753:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501235840:0@lo:39:umount.0 00000100:00100000:3.0:1783144220.931767:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3651:x1869759501235968:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144220.931775:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1783144220.931811:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501235968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144220.931829:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144220.931837:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783144220.931839:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783144220.931841:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783144220.934066:0:84363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934083:0:84363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934091:0:84363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934098:0:84363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934129:0:84363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144220.934134:0:84363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934142:0:84363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934147:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144220.934148:0:84363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934156:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934158:0:84363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934174:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6000 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144220.934180:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934190:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934191:0:84363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144220.934204:0:84363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144220.934204:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144220.934212:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783144220.934214:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783144220.934238:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934244:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144220.934272:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934282:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423046a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046a3f expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934299:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144220.934302:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934318:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c400 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144220.934321:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934323:0:84363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934335:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934339:0:84363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144220.934346:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934351:0:84363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144220.934356:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783144220.934363:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783144220.934367:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783144220.934375:0:84363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144220.934382:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934385:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144220.934390:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144220.934397:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934399:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934414:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6800 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:2.0:1783144220.934416:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a423046b34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144220.934419:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934431:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144220.934432:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934434:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1783144220.934440:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934443:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783144220.934449:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783144220.934452:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783144220.934455:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1783144220.934459:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501236224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144220.934475:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934483:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144220.934497:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.934504:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6800/0xad8e53a423046b03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046b0a expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144220.934507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.934542:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783144220.934548:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501236096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144220.934567:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.934589:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236224 00000100:00100000:2.0:1783144220.934594:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236224 00000100:00100000:2.0:1783144220.934623:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236096 00000100:00100000:2.0:1783144220.934626:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236096 00000100:00100000:2.0:1783144220.934652:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1783144220.934660:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501236224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144220.934671:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144220.934682:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423046b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b34 expref: 24 pid: 83145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934693:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144220.934740:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3649:x1869759501236224:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.934747:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1783144220.934761:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1783144220.934767:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3649:x1869759501236096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144220.934775:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144220.934782:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423046a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046a38 expref: 22 pid: 83146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.934790:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144220.934822:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3649:x1869759501236096:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.934834:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1783144220.934881:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501236096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144220.934898:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501236224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144220.934932:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144220.934937:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501236352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144220.934959:0:84363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144220.934967:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144220.934974:0:84363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.934981:0:84363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.934988:0:84363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144220.935003:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236352 00000100:00100000:2.0:1783144220.935007:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236352 00010000:00010000:1.0:1783144220.935009:0:84363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783144220.935014:0:84363:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783144220.935018:0:84363:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:2.0:1783144220.935040:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000020:01000004:1.0:1783144220.935047:0:84363:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000100:00100000:2.0:1783144220.935048:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3650:x1869759501236352:12345-0@lo:103:ldlm_bl.0 00000020:01000000:1.0:1783144220.935052:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:2.0:1783144220.935057:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1783144220.935058:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1783144220.935065:0:84363:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1783144220.935069:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47d400/0xad8e53a423046b0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b03 expref: 21 pid: 83145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.935083:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144220.935107:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3650:x1869759501236352:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.935113:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1783144220.935135:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501236352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144220.935161:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144220.935166:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.935173:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6200 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144220.935176:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.935194:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144220.935201:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144220.935206:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783144220.935209:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783144220.935211:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783144220.935223:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.935229:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144220.935242:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.935253:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423046a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046a31 expref: -99 pid: 83138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144220.935255:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144220.935258:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144220.935262:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144220.935269:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144220.935278:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144220.935280:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144220.935284:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501236480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144220.935313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144220.935455:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236480 00000100:00100000:2.0:1783144220.935459:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236480 00000100:00100000:2.0:1783144220.935487:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1783144220.935494:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3651:x1869759501236480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144220.935502:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144220.935509:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6e800/0xad8e53a423046a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046a2a expref: 20 pid: 83145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144220.935529:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144220.935557:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3651:x1869759501236480:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.935565:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1783144220.935572:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501236480:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1783144220.936630:0:84363:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1783144220.937050:0:83139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:1.0:1783144220.937084:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.937099:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.937105:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.937111:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144220.937115:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.937123:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144220.937213:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1783144220.937221:0:84363:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aee191800 cace81e7-a6f2-4d37-b197-caf34583781c 192.168.203.4@tcp 7 (0 0 0) 0 0 0 2: ffff9c2ac7d0c000 94489280519 stale:0 00000020:00080000:3.0:1783144220.937227:0:84363:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aee194800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144220.937232:0:84363:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2affddf800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144220.937236:0:84363:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2affdde000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144220.937240:0:84363:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2af7288800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144220.937244:0:84363:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c2aee593380) has exports, disconnecting them 00000020:00080000:3.0:1783144220.937249:0:84363:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.4@tcp (ffff9c2aee191800), last request at 1783144220 00000020:00000080:3.0:1783144220.937255:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046dfe 00000100:00080000:3.0:1783144220.937262:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2aee194000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783144220.937286:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2aee191800): rc 0 00000020:00080000:3.0:1783144220.937290:0:84363:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2aee194800), last request at 1783144024 00000020:00000080:3.0:1783144220.937293:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046c29 00000100:00080000:3.0:1783144220.937296:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2aee195800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783144220.937310:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aee194800): rc 0 00000020:00000080:3.0:1783144220.937312:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2aee194800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783144220.937323:0:84363:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2affddf800), last request at 1783144220 00000020:00000080:3.0:1783144220.937326:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046c22 00010000:00010000:0.0:1783144220.937330:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144220.937331:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2affdd8000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144220.937339:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee194800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1783144220.937347:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783144220.937358:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2affddf800): rc 0 00000020:00000080:3.0:1783144220.937360:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2affddf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783144220.937366:0:84363:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2affdde000), last request at 1783144220 00000020:00000080:3.0:1783144220.937371:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046c1b 00010000:00010000:2.0:1783144220.937377:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144220.937379:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee195800 for lustre-MDT0000 00000020:00000080:0.0:1783144220.937384:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2affddf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1783144220.937391:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2affddc000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144220.937410:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2affdd8000 for lustre-MDT0000 00000020:00080000:3.0:1783144220.937435:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2affdde000): rc 0 00000020:00000080:3.0:1783144220.937438:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2affdde000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783144220.937448:0:84363:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2af7288800), last request at 1783144018 00000020:00000080:3.0:1783144220.937451:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a85 00000100:00080000:3.0:1783144220.937458:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2aee193800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144220.937465:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2affdde000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:3.0:1783144220.937471:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2af7288800): rc 0 00000020:00000080:3.0:1783144220.937474:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2af7288800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1783144220.937482:0:84363:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc16281717ae0 00000020:00000080:0.0:1783144220.937488:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2affddc000 for lustre-MDT0000 00000020:00000080:0.0:1783144220.937493:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af7288800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144220.937508:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee193800 for lustre-MDT0000 00010000:00010000:0.0:1783144220.937512:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144220.937533:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783144220.937537:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 3 00010000:00010000:2.0:1783144220.937689:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144220.938323:0:84363:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00010000:00010000:1.0:1783144220.938333:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ed00) 00010000:00010000:1.0:1783144220.938338:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:3.0:1783144220.938343:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d60000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783144220.938343:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938360:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423046e6e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938378:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938383:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938387:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938391:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144220.938398:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938410:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938417:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ed00) 00010000:00010000:1.0:1783144220.938418:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144220.938420:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938424:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423046ea6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938436:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938439:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938443:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938446:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144220.938448:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938451:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938454:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c2aee58e400) 00010000:00010000:1.0:1783144220.938456:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144220.938461:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144220.938468:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423046eec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783144220.938476:0:3634:0:(genops.c:906:class_export_put()) final put ffff9c2aee191800/cace81e7-a6f2-4d37-b197-caf34583781c 00000100:00100000:0.0:1783144220.938507:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501236608:0@lo:39:umount.0 00000100:00100000:0.0:1783144220.938561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783144220.938590:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee191800/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-MDT0000 00000100:00080000:1.0:1783144220.938616:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783144220.938629:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968822 gen 3 00000020:00000080:3.0:1783144220.938633:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee194000 for lustre-MDT0000 00000004:00080000:1.0:1783144220.938640:0:84363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144220.938678:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236608 00000100:00100000:2.0:1783144220.938686:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236608 00000100:00080000:1.0:1783144220.938692:0:84363:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783144220.938703:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783144220.938714:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783144220.938716:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968822 gen 3 00000004:00080000:1.0:1783144220.938740:0:84363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144220.938754:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3668 00000100:00100000:2.0:1783144220.938766:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501236608:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783144220.938789:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046ac4 00000100:00080000:1.0:1783144220.938790:0:84363:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783144220.938798:0:8446:0:(import.c:65:import_set_state_nolock()) ffff9c2af720e800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1783144220.938800:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c48800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000001:00000004:2.0:1783144220.938822:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378730 00000020:00080000:1.0:1783144220.938834:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c2aee593380) has no exports 00010000:00010000:0.0:1783144220.938948:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144220.938966:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1869759501236608:12345-0@lo:39:umount.0 Request processed in 201us (403us total) trans 81604378731 rc 0/0 00000100:00100000:2.0:1783144220.938974:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3668 00000100:00100000:3.0:1783144220.939057:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501236736:0@lo:9:umount.0 00000100:00100000:3.0:1783144220.939087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783144220.939153:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c2aee593380) has no exports 00000100:00100000:3.0:1783144220.939156:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501236864:0@lo:9:umount.0 00000100:00100000:3.0:1783144220.939190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144220.939316:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d60000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783144220.939322:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501236608:0@lo:39:umount.0 00000100:00100000:2.0:1783144220.939355:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236736 00000100:00100000:2.0:1783144220.939359:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236736 00000100:00100000:0.0:1783144220.939370:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236864 00000100:00100000:0.0:1783144220.939376:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236864 00000100:00100000:2.0:1783144220.939428:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910 00000100:00100000:0.0:1783144220.939438:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911 00000100:00100000:2.0:1783144220.939439:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501236736:12345-0@lo:9:umount.0 00000100:00100000:0.0:1783144220.939452:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501236864:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783144220.939457:0:26142:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046ae0 00000100:00080000:2.0:1783144220.939464:0:26142:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e7000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144220.939468:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046aee 00000100:00080000:0.0:1783144220.939476:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3daf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783144220.939501:0:26142:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968822 00000001:00000004:0.0:1783144220.939514:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968822 00000100:00100000:2.0:1783144220.939610:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501236736:12345-0@lo:9:umount.0 Request processed in 174us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144220.939619:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910 00000100:00100000:0.0:1783144220.939625:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501236864:12345-0@lo:9:umount.0 Request processed in 176us (433us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144220.939645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783144220.939661:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783144220.939669:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783144220.939671:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144220.939674:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501236736:0@lo:9:umount.0 00000100:00080000:2.0:1783144220.939682:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c48800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783144220.939687:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783144220.939688:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144220.939690:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501236864:0@lo:9:umount.0 00000100:00100000:0.0:1783144220.939704:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911 00010000:00010000:0.0:1783144220.939753:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783144220.965098:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a9a 00000020:00000080:1.0:1783144220.965113:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c29c496a000/lustre-QMT0000_UUID 00000020:01000000:1.0:1783144220.965171:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783144220.965246:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783144220.965264:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144220.965276:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783144220.965294:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c2aee590000) has no exports 00000020:00000080:0.0:1783144220.965477:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a93 00000020:00000080:0.0:1783144220.965484:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac6d96000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144220.965529:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac6d96000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783144220.965542:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144220.965552:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783144220.965555:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac752f000/lustre-QMT0000_UUID 00000020:00000080:0.0:1783144220.965557:0:84363:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac752f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783144220.965564:0:84363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1783144220.965713:0:84363:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c29c2574780 - data ffff9c2acff40288/ffff9c2aee667000 00000020:01000000:1.0:1783144220.965896:0:84363:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c29c53129c0 - data ffff9c2afa6ba000/ffff9c29c72b8800 00000100:00080000:0.0:1783144220.990813:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144220.990822:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 4 00000100:00100000:0.0:1783144220.990837:0:84363:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2ae4e9d180 x1869759501236608/t81604378731(81604378731) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144230 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144220.990873:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783144220.992071:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783144220.992074:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968822 gen 4 00000004:00080000:0.0:1783144220.992089:0:84363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144220.992091:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783144220.992318:0:83156:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783144220.992323:0:83156:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 1 count 1 00000040:00080000:2.0:1783144220.992335:0:83156:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:0.0:1783144220.992805:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783144220.992807:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968822 gen 4 00000004:00080000:0.0:1783144220.992821:0:84363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144220.992823:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783144220.993197:0:83158:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783144220.993201:0:83158:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 2 count 1 00000040:00080000:3.0:1783144220.993208:0:83158:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:0.0:1783144220.993903:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a54 00000020:00000080:0.0:1783144220.993913:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d67800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144220.994087:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d67800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783144220.994739:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a69 00000020:00000080:0.0:1783144220.994746:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2af728e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783144220.994756:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783144220.994761:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144220.994765:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1783144220.994772:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783144220.994776:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c2aee594d40) has no exports 00000004:01000000:0.0:1783144220.995011:0:84363:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783144220.995019:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046ae7 00000020:00000080:0.0:1783144220.995023:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2aefdde000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783144220.995045:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783144220.995050:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144220.995059:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783144220.995061:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c2ad08d99c0) has no exports 00000020:00000080:0.0:1783144220.995067:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046ad9 00000020:00000080:0.0:1783144220.995071:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2af5c4c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144220.995194:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefdde000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783144220.995203:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144220.995497:0:84363:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783144220.995501:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783144220.995505:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968822 gen 5 00000004:00080000:0.0:1783144220.995511:0:84363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144220.995514:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144220.995559:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144220.995568:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144220.995575:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046acb 00000020:00000080:0.0:1783144220.995582:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c29c443b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783144220.995588:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783144220.995592:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144220.995603:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783144220.995606:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c29c31e3380) has no exports 00000020:00000080:0.0:1783144220.995610:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046abd 00000020:00000080:0.0:1783144220.995615:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2af9ec9800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144220.995624:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5c48800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783144220.995633:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c29c443d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144220.995636:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c443d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783144220.995643:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144220.995719:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c443b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783144220.995759:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af9ec9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144220.996082:0:84363:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783144220.996085:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783144220.996088:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968822 gen 5 00000004:00080000:0.0:1783144220.996091:0:84363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144220.996093:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144220.996138:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144220.996147:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783144220.996159:0:84363:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783144220.996165:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046aaf 00000020:00000080:0.0:1783144220.996169:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c29c496b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783144220.996174:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783144220.996183:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144220.996189:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783144220.996192:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c29c3568000) has no exports 00000020:00000080:0.0:1783144220.996196:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046aa8 00000020:00000080:0.0:1783144220.996199:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d61800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144220.996216:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac91e1800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783144220.996224:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c29c4969000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144220.996227:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c4969000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783144220.996234:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144220.996287:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783144220.996296:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d61800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783144221.000774:0:84363:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783144221.000782:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783144221.000785:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 5 00000100:00100000:2.0:1783144221.000792:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783144221.000848:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144221.000873:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144221.000915:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144221.000920:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144221.000930:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c29c4c0c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144221.000971:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9d60000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783144221.000981:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c29c496f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144221.000984:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783144221.000991:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144221.001032:0:84363:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c4c0c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783144221.001038:0:84363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144221.001250:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a70 00000020:00000080:2.0:1783144221.001258:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2af7288000/lustre-MDD0000_UUID 00000020:01000000:2.0:1783144221.001299:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783144221.001303:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144221.001309:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783144221.001313:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c2aee5919c0) has no exports 00000020:00000080:2.0:1783144221.001339:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144221.001353:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783144221.001358:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a77 00000020:00000080:2.0:1783144221.001363:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2af728e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144221.001486:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af7288000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783144221.001490:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2af728b000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783144221.001492:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783144221.001495:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1783144221.001680:0:84363:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2ae4b2a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783144221.001684:0:84363:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2ae4b2a800 3 00000020:01000004:2.0:1783144221.001687:0:84363:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2ae4b2a800 from lustre-MDT0000 00000020:00000080:2.0:1783144221.001709:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144221.001714:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783144221.001717:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d65000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783144221.001719:0:84363:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d65000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783144221.001745:0:84363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783144221.001777:0:84363:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783144221.001780:0:84363:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783144221.001782:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783144221.001784:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144221.001787:0:84363:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1783144221.001799:0:84363:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2af71e3800 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 192.168.203.4@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144221.001804:0:84363:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2ac5d51800 4e9e4714-8000-4c64-bed6-3cadd5fdfc80 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144221.001808:0:84363:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9c29c31e4d40) has exports, disconnecting them 00000020:00080000:2.0:1783144221.001812:0:84363:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.4@tcp (ffff9c2af71e3800), last request at 1783144020 00000020:00000080:2.0:1783144221.001828:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046bf8 00000020:00010000:2.0:1783144221.001832:0:84363:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2af71e3800: total 1 00000100:00080000:2.0:1783144221.001836:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783144221.001845:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2af71e3800): rc 0 00000020:00080000:2.0:1783144221.001848:0:84363:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2ac5d51800), last request at 1783144018 00000020:00010000:2.0:1783144221.001897:0:9527:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2af71e3800: total 1 00010000:00010000:2.0:1783144221.001918:0:9527:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2af71e3800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1783144221.001942:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0400/0xad8e53a423046bff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41938 expref: 5 pid: 83144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.001954:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7000/0xad8e53a423046c0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41946 expref: 4 pid: 83146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.001970:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6ea00/0xad8e53a423046c06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4193f expref: 3 pid: 83148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.001978:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47cc00/0xad8e53a423046c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4194d expref: 2 pid: 83148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.001986:0:9527:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2af71e3800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1783144221.001999:0:9527:0:(genops.c:906:class_export_put()) final put ffff9c2af71e3800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 00000020:00000080:3.0:1783144221.002040:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1783144221.002067:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144221.002069:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144221.002074:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144221.002090:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a15 00000020:00010000:2.0:1783144221.002093:0:84363:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ac5d51800: total 1 00000100:00080000:2.0:1783144221.002096:0:84363:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d55000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783144221.002105:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac5d51800): rc 0 00000020:00000080:3.0:1783144221.002109:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e3800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 for MGS 00000020:00080000:2.0:1783144221.002110:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9c29c31e4d40) has no exports 00000020:00000080:3.0:1783144221.002143:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af71e2000 for MGS 00000100:00100000:2.0:1783144221.002181:0:83144:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2aef54ec00:83144] 0 exiting: rc = 1 00000100:00100000:1.0:1783144221.002184:0:83146:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2af9628000:83146] 2 exiting: rc = 0 00000100:00100000:3.0:1783144221.002191:0:83148:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c29c5263000:83148] 3 exiting: rc = 0 00000020:00010000:2.0:1783144221.002392:0:6508:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ac5d51800: total 0 00010000:00010000:2.0:1783144221.002415:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ac5d51800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783144221.002431:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c600/0xad8e53a423046b9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b96 expref: 14 pid: 83146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002444:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a423046b8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b88 expref: 13 pid: 83148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002454:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6e200/0xad8e53a423046b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b42 expref: 12 pid: 83148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002467:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423046bab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046ba4 expref: 11 pid: 83144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002493:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7200/0xad8e53a423046bb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046bb2 expref: 10 pid: 83145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002501:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423046bc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046bc0 expref: 9 pid: 83144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002509:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423046b57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b50 expref: 8 pid: 83146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002519:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f6a00/0xad8e53a423046bd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046bce expref: 7 pid: 83148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002526:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423046b65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b5e expref: 6 pid: 83146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002543:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47ca00/0xad8e53a423046b73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b6c expref: 5 pid: 83144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002552:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6e600/0xad8e53a423046bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046bea expref: 4 pid: 83144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002562:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0600/0xad8e53a423046b81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046b7a expref: 3 pid: 83145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002571:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f6c00/0xad8e53a423046be3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046bdc expref: 2 pid: 83145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144221.002579:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ac5d51800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783144221.002646:0:6508:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d51800/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 00010000:00010000:2.0:1783144221.002652:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144221.002658:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144221.002659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144221.002688:0:83145:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2b01425000:83145] 1 exiting: rc = 0 00000020:00000080:3.0:1783144221.002763:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d51800/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 for MGS 00000100:00100000:2.0:1783144221.002787:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783144221.002791:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac5d55000 for MGS 00000100:00100000:2.0:1783144221.002798:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002806:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002813:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002818:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002824:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002830:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002837:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002843:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002849:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002854:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002872:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002879:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002885:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002892:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002900:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002905:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002913:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002918:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002923:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002927:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002934:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002941:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002954:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002960:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002966:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002970:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002976:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002983:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002993:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.002999:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003004:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003019:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003025:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003030:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003036:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003042:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003048:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003059:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003066:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003074:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003081:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003087:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003095:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003100:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003105:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003110:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003116:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003123:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003131:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003136:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003145:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003151:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003156:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003163:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003170:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003176:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003191:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003198:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003208:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003215:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003221:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003226:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144221.003230:0:84363:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783144221.004920:0:84363:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c29c5312540 - data ffff9c2afa6ba948/ffff9c2aef4d6400 00000020:01000000:2.0:1783144221.005207:0:84363:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2aeedc9840 - data ffff9c2afa73eaf8/ffff9c2afcbb6800 00000020:00000080:2.0:1783144221.007299:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a0e 00000020:00000080:2.0:1783144221.007319:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d53000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783144221.007622:0:84363:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2ae4b2a800 from MGS, refs=2 00000020:00000080:3.0:1783144221.007623:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d53000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1783144221.007628:0:84363:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2ae4b2a800 2 00000020:01000004:2.0:1783144221.007633:0:84363:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2ae4b2a800 from MGS 00000020:00000080:2.0:1783144221.008009:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144221.008017:0:84363:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783144221.008021:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d52000/MGS 00000020:00000080:2.0:1783144221.008024:0:84363:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d52000/MGS for MGS 00000020:01000000:2.0:1783144221.008031:0:84363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783144221.008111:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783144221.008116:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144221.008127:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783144221.008255:0:84363:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c2af71e0800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144221.008263:0:84363:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c29c356cd40) has exports, disconnecting them 00000020:00080000:2.0:1783144221.008270:0:84363:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c2af71e0800), last request at 1783144018 00000020:00000080:2.0:1783144221.008274:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046b26 00000020:00080000:2.0:1783144221.008288:0:84363:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2af71e0800): rc 0 00000020:00000080:2.0:1783144221.008293:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2af71e0800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783144221.008512:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e0800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783144221.010786:0:84363:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783144221.010793:0:84363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783144221.010797:0:84363:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783144221.010803:0:84363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783144221.010933:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144221.010943:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783144221.010950:0:84363:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2ae4b2a800 1 00000020:00000080:3.0:1783144221.010955:0:84363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046a00 00000020:00000080:0.0:1783144221.010958:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af71e1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783144221.010962:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d54000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144221.010968:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2af71e3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783144221.010973:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783144221.010975:0:84363:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:01000000:0.0:1783144221.010979:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783144221.010992:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144221.010997:0:84363:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783144221.011000:0:84363:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c2af5d5cd40) has no exports 00000020:00000080:0.0:1783144221.011048:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d54000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783144221.037252:0:84363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144221.037266:0:84363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783144221.037272:0:84363:0:(genops.c:906:class_export_put()) final put ffff9c29c722d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144221.037277:0:84363:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c722d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783144221.037287:0:84363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783144221.037406:0:84363:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9c2ae4b29000 00000020:02000400:3.0:1783144221.037472:0:84363:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783144221.647272:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144221.711598:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501236992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144221.711678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144221.711746:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236992 00000100:00100000:2.0:1783144221.711756:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236992 00000100:00100000:2.0:1783144221.711807:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669 00000100:00100000:2.0:1783144221.711814:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1869759501236992:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783144221.711822:0:78024:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783144221.711880:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1869759501236992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (201us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144221.711887:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669 00000100:02020000:2.0:1783144221.711924:0:3648:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783144221.725588:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783144221.725598:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783144221.725614:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783144221.733846:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144221.733866:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2739 00000100:00080000:2.0:1783144221.733876:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144221.733948:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af9f1d500 x1869759501237120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144221.734000:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501237120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783144221.734064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144221.734103:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501237120 00000100:00100000:1.0:1783144221.734112:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501237120 00000100:00100000:1.0:1783144221.734526:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:1.0:1783144221.734535:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501237120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783144221.734566:0:23926:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144221.734626:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501237120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 91us (560us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144221.734635:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00080000:3.0:1783144221.734663:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144221.734670:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144221.734674:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501237120:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1783144222.669975:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144223.245945:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501237248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144223.246063:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144223.246102:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783144223.246109:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501237248 00000100:00100000:3.0:1783144223.246118:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501237248 00000100:00100000:0.0:1783144223.246118:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501237376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144223.246159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144223.246182:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144223.246188:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501237376 00000100:00100000:2.0:1783144223.246201:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1783144223.246205:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501237376 00000100:00100000:2.0:1783144223.246221:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501237248:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144223.246250:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00002000:00000024:2.0:1783144223.246257:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144223.246263:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501237376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144223.246282:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783144223.246313:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144223.246320:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501237248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144223.246329:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1783144223.246336:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501237376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144223.246345:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1783144223.246372:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501237248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144223.246392:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501237376:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783144223.693975:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783144223.759137:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144223.759147:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2ad06c4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783144223.759202:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad06c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783144223.759254:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ad3daf800 for lustre-OST0001 00010000:00010000:2.0:1783144224.718052:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144225.741942:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144225.806123:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144225.806128:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144225.806131:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783144225.806134:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501237504:0@lo:400:kworker.0 00000100:00080000:3.0:1783144225.806138:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2756 00000100:00080000:3.0:1783144225.806144:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1783144225.806151:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501237632:0@lo:400:kworker.0 00000100:00080000:3.0:1783144225.806153:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144225.806179:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaac700 x1869759501238144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1783144225.806336:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501237504 offset 0 length 224: 4 00000100:00100000:1.0:1783144225.806338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144225.806358:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501238144:0@lo:38:kworker.0 00000100:00100000:2.0:1783144225.806384:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501238016:0@lo:400:kworker.0 00000100:00100000:1.0:1783144225.806393:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501238272:0@lo:400:kworker.0 00000100:00100000:3.0:1783144225.806400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144225.806425:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144225.806435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144225.806450:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238144 00000100:00100000:3.0:1783144225.806458:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238144 00000100:00100000:1.0:1783144225.806465:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783144225.806473:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501237760:0@lo:400:kworker.0 00000100:00100000:2.0:1783144225.806484:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501237632 00000100:00100000:2.0:1783144225.806490:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501237632 00000100:00100000:3.0:1783144225.806494:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:3.0:1783144225.806500:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501238144:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144225.806513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1783144225.806519:0:8447:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144225.806525:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238016 00000100:00100000:1.0:1783144225.806537:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501238400:0@lo:400:kworker.0 00000100:00100000:2.0:1783144225.806543:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238016 00000100:00100000:3.0:1783144225.806564:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501238144:12345-0@lo:38:kworker.0 Request processed in 63us (167us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144225.806571:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00100000:1.0:1783144225.806575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144225.806592:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501237760 00000100:00100000:2.0:1783144225.806597:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501237760 00000100:00100000:3.0:1783144225.806601:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1783144225.806615:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501238016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144225.806619:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1783144225.806633:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1783144225.806634:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501237760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144225.806644:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1869759501237632:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144225.806651:0:66114:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783144225.806655:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501238016:12345-0@lo:400:kworker.0 Request processed in 42us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144225.806660:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1783144225.806687:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501237760:12345-0@lo:400:kworker.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00080000:3.0:1783144225.806695:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783144225.806696:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1869759501237632:12345-0@lo:400:kworker.0 Request processed in 52us (485us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144225.806697:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00080000:3.0:1783144225.806700:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144225.806707:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501238144:0@lo:38:kworker.0 00000100:00100000:2.0:1783144225.806713:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1783144225.806748:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238272 00000100:00100000:3.0:1783144225.806752:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501238016:0@lo:400:kworker.0 00000100:00100000:1.0:1783144225.806753:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238272 00000100:00100000:3.0:1783144225.806786:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238400 00000100:00100000:3.0:1783144225.806789:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238400 00000100:00100000:1.0:1783144225.806800:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1783144225.806816:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501238272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144225.806837:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1783144225.806844:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501238400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144225.806866:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501238272:12345-0@lo:400:kworker.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144225.806874:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00080000:2.0:1783144225.806886:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144225.806890:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501238400:12345-0@lo:400:kworker.0 Request processed in 45us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144225.806900:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:1.0:1783144225.806913:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501237760:0@lo:400:kworker.0 00000100:00100000:1.0:1783144225.806929:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501238400:0@lo:400:kworker.0 00000100:00100000:1.0:1783144225.806939:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501238272:0@lo:400:kworker.0 00000100:00080000:1.0:1783144225.806949:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783144225.806953:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783144225.806956:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783144225.806960:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144225.806964:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2558 00000100:00080000:1.0:1783144225.806968:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144225.806983:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4ea0700 x1869759501238656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144225.806989:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144225.806992:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501237888:0@lo:400:kworker.0 00000100:00080000:2.0:1783144225.806994:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144225.807009:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501237632:0@lo:400:kworker.0 00000100:00100000:0.0:1783144225.807025:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144225.807050:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501238528:0@lo:400:kworker.0 00000100:00100000:2.0:1783144225.807063:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501237888 00000100:00100000:2.0:1783144225.807069:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501237888 00000100:00100000:0.0:1783144225.807073:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144225.807156:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238528 00000100:00100000:2.0:1783144225.807160:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238528 00000100:00100000:3.0:1783144225.807309:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501238656:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783144225.807317:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1783144225.807324:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1869759501237888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144225.807326:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1783144225.807335:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783144225.807335:0:66947:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783144225.807337:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3650:x1869759501238528:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144225.807345:0:81077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783144225.807373:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238656 00000100:00100000:1.0:1783144225.807374:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1869759501237888:12345-0@lo:400:kworker.0 Request processed in 51us (351us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783144225.807380:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238656 00000100:00100000:1.0:1783144225.807382:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1783144225.807395:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1783144225.807403:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501238656:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783144225.807412:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144225.807436:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501238656:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32us (107us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144225.807440:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:3.0:1783144225.807451:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783144225.807455:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783144225.807459:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144225.807463:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144225.807465:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144225.807468:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2558 00000100:00080000:1.0:1783144225.807471:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:3.0:1783144225.807475:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144225.807476:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501238656:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783144225.807479:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3650:x1869759501238528:12345-0@lo:400:kworker.0 Request processed in 141us (403us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144225.807491:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1783144225.807499:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaac700 x1869759501238784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144225.807527:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501237888:0@lo:400:kworker.0 00000100:00080000:3.0:1783144225.807541:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783144225.807544:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783144225.807547:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144225.807551:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144225.807554:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2558 00000100:00080000:3.0:1783144225.807559:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144225.807561:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501238784:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783144225.807574:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaae680 x1869759501238912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144225.807586:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501238528:0@lo:400:kworker.0 00000100:00100000:1.0:1783144225.807593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144225.807623:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501238912:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783144225.807632:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238784 00000100:00100000:2.0:1783144225.807638:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238784 00000100:00100000:1.0:1783144225.807648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144225.807765:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501238912 00000100:00100000:2.0:1783144225.807769:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501238912 00000100:00100000:3.0:1783144225.807790:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1783144225.807794:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501238784:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783144225.807802:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00010000:00020000:3.0:1783144225.807804:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144225.807811:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501238912:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783144225.807834:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144225.807841:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501238784:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 44us (250us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144225.807851:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1783144225.807869:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501238912:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (220us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144225.807883:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00080000:1.0:1783144225.807913:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144225.807918:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144225.807921:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501238912:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783144225.807929:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144225.807932:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144225.807934:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501238784:0@lo:38:ptlrpcd_00_02.0 00000400:00000100:2.0:1783144225.891910:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481637632 offset 0 length 224: 4 00000100:00100000:2.0:1783144225.891957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144225.891996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144225.892016:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481637888 00000100:00100000:3.0:1783144225.892024:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481637888 00000100:00100000:2.0:1783144225.892032:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144225.892073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144225.892074:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481638144 00000100:00100000:0.0:1783144225.892094:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481638144 00000100:00100000:3.0:1783144225.892102:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481637760 00000100:00100000:2.0:1783144225.892106:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481638016 00000100:00100000:3.0:1783144225.892108:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481637760 00000100:00100000:2.0:1783144225.892112:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481638016 00000100:00100000:1.0:1783144225.892118:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 701 00000100:00100000:1.0:1783144225.892138:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481637888:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144225.892148:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 974 00000100:00100000:0.0:1783144225.892154:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1932 00000100:00100000:3.0:1783144225.892160:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2406:x1869759481637760:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144225.892163:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1933 00000100:00100000:0.0:1783144225.892169:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481638144:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144225.892191:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481638016:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:3.0:1783144225.892193:0:81077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:0.0:1783144225.892235:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481638144:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144225.892245:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481637888:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 112us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144225.892246:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2406:x1869759481637760:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (210us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144225.892248:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481638016:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144225.892248:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1932 00000100:00100000:1.0:1783144225.892267:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 701 00000100:00100000:2.0:1783144225.892268:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1933 00000100:00100000:3.0:1783144225.892283:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 974 00000100:00080000:2.0:1783144225.892317:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144225.892323:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144225.892327:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144225.906235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144225.906332:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481638272 00000100:00100000:1.0:1783144225.906342:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481638272 00000100:00100000:1.0:1783144225.906393:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 975 00000100:00100000:1.0:1783144225.906401:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481638272:12345-192.168.203.4@tcp:38:ptlrpcd_01_01.0 00010000:00020000:1.0:1783144225.906435:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144225.906508:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481638272:12345-192.168.203.4@tcp:38:ptlrpcd_01_01.0 Request processed in 106us (281us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144225.906516:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 975 00010000:00010000:0.0:1783144226.765927:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783144226.831157:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783144226.831180:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378731 is committed 00000020:00000080:3.0:1783144226.831189:0:75517:0:(genops.c:906:class_export_put()) final put ffff9c2af720d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144226.831254:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af720d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783144226.831352:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af720e800 for lustre-MDT0001 00000001:00100000:1.0:1783144226.831444:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144226.831453:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2af71e2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783144226.831495:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783144226.831558:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af71e7000 for lustre-OST0000 00010000:00010000:2.0:1783144227.790060:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144228.366080:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501239040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144228.366159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144228.366224:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501239168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144228.366260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144228.366310:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501239040 00000100:00100000:1.0:1783144228.366318:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501239040 00000100:00100000:1.0:1783144228.366391:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501239168 00000100:00100000:1.0:1783144228.366395:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501239168 00000100:00080000:3.0:1783144228.366403:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144228.366408:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144228.366498:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:2.0:1783144228.366511:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501239040:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144228.366517:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:1.0:1783144228.366527:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501239168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144228.366546:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1783144228.366546:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144228.366591:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501239168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144228.366596:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:2.0:1783144228.366608:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501239040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144228.366617:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:1.0:1783144228.366640:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501239168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144228.366677:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501239040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144228.815993:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144229.838211:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144230.863432:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144230.925946:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144230.925953:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144230.925957:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144230.925965:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2760 00000100:00080000:3.0:1783144230.925971:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144230.925978:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144230.926000:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaad180 x1869759501239424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144230.926036:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144230.926039:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144230.926041:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144230.926045:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2760 00000100:00080000:3.0:1783144230.926047:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144230.926051:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144230.926081:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaac700 x1869759501239680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144230.926098:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144230.926101:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144230.926103:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144230.926107:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2760 00000100:00080000:3.0:1783144230.926109:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783144230.926113:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144230.926122:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501239424:0@lo:38:kworker.0 00000100:00100000:3.0:1783144230.926124:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaaed80 x1869759501239936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144230.926145:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144230.926147:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144230.926149:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144230.926152:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2760 00000100:00080000:3.0:1783144230.926154:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144230.926157:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144230.926165:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aca302680 x1869759501240320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144230.926184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144230.926201:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501239808:0@lo:400:kworker.0 00000100:00100000:1.0:1783144230.926214:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501239680:0@lo:38:kworker.0 00000100:00100000:1.0:1783144230.926232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144230.926264:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501239552:0@lo:400:kworker.0 00000100:00100000:1.0:1783144230.926277:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501239936:0@lo:38:kworker.0 00000100:00100000:3.0:1783144230.926288:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144230.926307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144230.926321:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501239424 00000100:00100000:1.0:1783144230.926324:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aca302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501240320:0@lo:38:kworker.0 00000100:00100000:3.0:1783144230.926326:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501239424 00000100:00100000:1.0:1783144230.926345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144230.926345:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501239296:0@lo:400:kworker.0 00000100:00100000:3.0:1783144230.926354:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501239680 00000100:00100000:3.0:1783144230.926365:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501239680 00000400:00000100:0.0:1783144230.926379:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501239296 offset 0 length 224: 4 00000100:00100000:0.0:1783144230.926405:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aca301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501240192:0@lo:400:kworker.0 00000100:00100000:0.0:1783144230.926434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144230.926447:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501240064:0@lo:400:kworker.0 00000100:00100000:3.0:1783144230.926490:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501239552 00000100:00100000:3.0:1783144230.926494:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501239552 00000100:00100000:2.0:1783144230.926543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144230.928163:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501240320 00000100:00100000:1.0:1783144230.928172:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501240320 00000100:00100000:1.0:1783144230.928202:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1783144230.928217:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501239552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144230.928301:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1783144230.928309:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501239424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144230.928329:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144230.928407:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501239424:12345-0@lo:38:kworker.0 Request processed in 97us (2221us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144230.928414:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1783144230.928433:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1783144230.928437:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501239680:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144230.928448:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144230.928484:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501239680:12345-0@lo:38:kworker.0 Request processed in 45us (2251us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144230.928490:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1783144230.928502:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1783144230.928506:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501240320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144230.928515:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144230.928540:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501240320:12345-0@lo:38:kworker.0 Request processed in 32us (2195us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144230.928546:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1783144230.928569:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501239936 00000100:00100000:0.0:1783144230.928573:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501239936 00000100:00100000:0.0:1783144230.928595:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672 00000100:00100000:0.0:1783144230.928598:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501239936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144230.928605:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144230.928642:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501239552:12345-0@lo:400:kworker.0 Request processed in 429us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144230.928649:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501239936:12345-0@lo:38:kworker.0 Request processed in 48us (2340us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144230.928655:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1783144230.928658:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672 00000100:00100000:0.0:1783144230.928688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144230.928737:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501239808 00000100:00100000:0.0:1783144230.928740:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501239808 00000100:00080000:3.0:1783144230.928754:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144230.928764:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1783144230.928769:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501239808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144230.928803:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501239552:0@lo:400:kworker.0 00000100:00100000:0.0:1783144230.928812:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501239808:12345-0@lo:400:kworker.0 Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144230.928820:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1783144230.928854:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501240192 00000100:00100000:0.0:1783144230.928855:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501239808:0@lo:400:kworker.0 00000100:00100000:3.0:1783144230.928860:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501240192 00000100:00100000:3.0:1783144230.928903:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501240064 00000100:00100000:3.0:1783144230.928908:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501240064 00000100:00080000:0.0:1783144230.928913:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144230.928920:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144230.928924:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501239936:0@lo:38:kworker.0 00000100:00080000:0.0:1783144230.928936:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783144230.928937:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00080000:0.0:1783144230.928944:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144230.928950:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aca302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501240320:0@lo:38:kworker.0 00000100:00100000:3.0:1783144230.928952:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501240192:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783144230.928965:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144230.928969:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144230.928973:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501239424:0@lo:38:kworker.0 00000100:00080000:0.0:1783144230.928984:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144230.928988:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144230.928993:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501239680:0@lo:38:kworker.0 00000100:00100000:3.0:1783144230.929010:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501240192:12345-0@lo:400:kworker.0 Request processed in 61us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144230.929018:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1783144230.929035:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:3.0:1783144230.929043:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501240064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144230.929070:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aca301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501240192:0@lo:400:kworker.0 00000100:00080000:2.0:1783144230.929121:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144230.929125:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144230.932242:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501240064:12345-0@lo:400:kworker.0 Request processed in 3191us (5688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144230.932258:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1783144230.934913:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501240064:0@lo:400:kworker.0 00000400:00000100:0.0:1783144231.010694:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481638400 offset 0 length 224: 4 00000100:00100000:0.0:1783144231.010765:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144231.010802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144231.010832:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144231.010886:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144231.010921:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481638784 00000100:00100000:2.0:1783144231.010931:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481638784 00000100:00100000:1.0:1783144231.010956:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481638912 00000100:00100000:1.0:1783144231.010962:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481638912 00000100:00100000:3.0:1783144231.010967:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481638528 00000100:00100000:3.0:1783144231.010973:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481638528 00000100:00100000:2.0:1783144231.011006:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1936 00000100:00100000:2.0:1783144231.011018:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481638784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:0.0:1783144231.011022:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144231.011023:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1937 00000100:00080000:0.0:1783144231.011027:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144231.011037:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481638912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144231.011080:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481638656 00000100:00100000:3.0:1783144231.011084:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481638656 00000100:00100000:2.0:1783144231.011092:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481638784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144231.011092:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481638912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144231.011110:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1937 00000100:00100000:2.0:1783144231.011120:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1936 00000100:00100000:0.0:1783144231.011146:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 704 00000100:00100000:0.0:1783144231.011159:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481638656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144231.011163:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 979 00000100:00100000:1.0:1783144231.011172:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481638528:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:1.0:1783144231.011191:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144231.011208:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481638656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144231.011224:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481638528:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 48us (457us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144231.011231:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 704 00000100:00100000:1.0:1783144231.011238:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 979 00000100:00080000:0.0:1783144231.011270:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783144231.886000:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144232.909849:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144233.486196:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501240448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144233.486264:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144233.486352:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501240448 00000100:00100000:0.0:1783144233.486359:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501240448 00000100:00100000:0.0:1783144233.486422:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:0.0:1783144233.486430:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501240448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144233.486453:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144233.486491:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501240448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144233.486496:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:0.0:1783144233.486542:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501240448:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783144233.486670:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144233.487150:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501240576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144233.487190:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144233.487288:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501240576 00000100:00100000:0.0:1783144233.487293:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501240576 00000100:00100000:0.0:1783144233.487346:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1783144233.487355:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501240576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144233.487372:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144233.487416:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501240576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144233.487423:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00080000:3.0:1783144233.487957:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144233.488083:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501240576:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783144233.935257:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144234.958276:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144235.982859:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783144236.045820:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144236.045826:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144236.045829:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783144236.045832:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501240704:0@lo:400:kworker.0 00000100:00080000:2.0:1783144236.045835:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2765 00000100:00080000:2.0:1783144236.045840:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783144236.045848:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144236.045879:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aefa54e00 x1869759501240832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1783144236.045903:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501240704 offset 0 length 224: 4 00000100:00080000:2.0:1783144236.045906:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144236.045911:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144236.045913:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144236.045918:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2765 00000100:00080000:2.0:1783144236.045921:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783144236.045926:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144236.045938:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aefa57100 x1869759501241088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144236.045941:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144236.045949:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501240960:0@lo:400:kworker.0 00000100:00080000:2.0:1783144236.045968:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144236.045972:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144236.045974:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144236.045978:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2765 00000100:00100000:3.0:1783144236.045979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144236.045985:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783144236.045991:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144236.046006:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aefa57480 x1869759501241344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144236.046009:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501240960 00000100:00100000:3.0:1783144236.046016:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501240960 00000100:00080000:2.0:1783144236.046043:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144236.046046:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144236.046048:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144236.046050:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2765 00000100:00080000:2.0:1783144236.046052:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783144236.046055:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144236.046062:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1783144236.046070:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501240960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144236.046072:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee433800 x1869759501241728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144236.046095:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501241472:0@lo:400:kworker.0 00000100:00100000:3.0:1783144236.046108:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501240960:12345-0@lo:400:kworker.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144236.046113:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00080000:3.0:1783144236.046130:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144236.046134:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144236.046141:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501241600:0@lo:400:kworker.0 00000100:00100000:3.0:1783144236.046163:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144236.046166:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783144236.046175:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501241216:0@lo:400:kworker.0 00000100:00100000:3.0:1783144236.046191:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501240960:0@lo:400:kworker.0 00000100:00100000:2.0:1783144236.046205:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144236.046226:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501240832:0@lo:38:kworker.0 00000100:00100000:3.0:1783144236.046245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144236.046259:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501241088:0@lo:38:kworker.0 00000100:00100000:3.0:1783144236.046272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144236.046286:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501241344:0@lo:38:kworker.0 00000100:00100000:3.0:1783144236.046301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144236.046318:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241216 00000100:00100000:3.0:1783144236.046322:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501241728:0@lo:38:kworker.0 00000100:00100000:1.0:1783144236.046324:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241216 00000100:00100000:3.0:1783144236.046350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144236.046375:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501240832 00000100:00100000:1.0:1783144236.046379:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501240832 00000100:00100000:3.0:1783144236.046385:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241088 00000100:00100000:3.0:1783144236.046389:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241088 00000100:00100000:1.0:1783144236.046395:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241728 00000100:00100000:1.0:1783144236.046400:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241728 00000100:00100000:3.0:1783144236.046413:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1783144236.046419:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1783144236.046422:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501241216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144236.046429:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501240832:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783144236.046447:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144236.046455:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501241216:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144236.046463:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1783144236.046482:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1783144236.046488:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501241088:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144236.046497:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501240832:12345-0@lo:38:kworker.0 Request processed in 66us (249us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144236.046497:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241472 00010000:00020000:3.0:1783144236.046501:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144236.046504:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241472 00000100:00100000:3.0:1783144236.046533:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501241088:12345-0@lo:38:kworker.0 Request processed in 45us (259us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144236.046538:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1783144236.046543:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241600 00000100:00100000:0.0:1783144236.046547:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241600 00000100:00100000:3.0:1783144236.046562:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1783144236.046567:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501241728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144236.046574:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144236.046578:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:0.0:1783144236.046588:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501241472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144236.046596:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501241728:12345-0@lo:38:kworker.0 Request processed in 27us (246us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144236.046600:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1783144236.046615:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241344 00000100:00100000:3.0:1783144236.046617:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241344 00000100:00100000:0.0:1783144236.046631:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501241472:12345-0@lo:400:kworker.0 Request processed in 45us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144236.046635:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673 00000100:00100000:3.0:1783144236.046640:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501241344:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144236.046650:0:78024:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144236.046654:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:3.0:1783144236.046673:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501241344:12345-0@lo:38:kworker.0 Request processed in 32us (371us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144236.046677:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1783144236.046681:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673 00000100:00100000:0.0:1783144236.046689:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501241600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144236.046716:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501241216:0@lo:400:kworker.0 00000100:00100000:3.0:1783144236.046750:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501241472:0@lo:400:kworker.0 00000100:00080000:2.0:1783144236.046813:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144236.046817:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144236.046819:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144236.046861:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144236.046867:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144236.046870:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501240832:0@lo:38:kworker.0 00000100:00080000:2.0:1783144236.046880:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144236.046883:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144236.046886:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501241088:0@lo:38:kworker.0 00000100:00080000:2.0:1783144236.046894:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144236.046897:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144236.046900:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501241344:0@lo:38:kworker.0 00000100:00080000:2.0:1783144236.046911:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144236.046914:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144236.046916:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501241728:0@lo:38:kworker.0 00000100:00100000:0.0:1783144236.047047:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501241600:12345-0@lo:400:kworker.0 Request processed in 361us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144236.047054:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:2.0:1783144236.047155:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501241600:0@lo:400:kworker.0 00000100:00100000:1.0:1783144236.047505:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1783144236.130672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144236.131049:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481639168 00000100:00100000:3.0:1783144236.131058:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481639168 00000100:00100000:3.0:1783144236.131131:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 983 00000100:00100000:3.0:1783144236.131139:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481639168:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:3.0:1783144236.131160:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144236.131216:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481639168:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 77us (553us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144236.131223:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 983 00000100:00100000:0.0:1783144236.131325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144236.131533:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000400:00000100:0.0:1783144236.131553:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481639040 offset 0 length 224: 4 00000100:00100000:0.0:1783144236.131570:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144236.131588:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481639552 00000100:00100000:0.0:1783144236.131591:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481639552 00000100:00100000:0.0:1783144236.131626:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481639424 00000100:00100000:0.0:1783144236.131630:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481639424 00000100:00100000:0.0:1783144236.131652:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1940 00000100:00100000:0.0:1783144236.131659:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481639552:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144236.131698:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481639552:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144236.131704:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1940 00000100:00100000:0.0:1783144236.131717:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1941 00000100:00100000:0.0:1783144236.131743:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481639424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144236.131777:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481639424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144236.131783:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1941 00000100:00100000:2.0:1783144236.131867:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481639296 00000100:00100000:2.0:1783144236.131871:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481639296 00000100:00100000:2.0:1783144236.131900:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 707 00000100:00100000:2.0:1783144236.131906:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481639296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144236.131932:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481639296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144236.131938:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 707 00000100:00080000:2.0:1783144236.132027:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144236.132031:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144236.132032:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783144237.009015:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783144237.456485:0:84980:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783144237.456490:0:84980:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783144237.456491:0:84980:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783144237.456599:0:84980:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c2af71e6800 00000020:01000004:3.0:1783144237.456613:0:84980:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783144237.456625:0:84980:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783144237.456638:0:84980:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2aee5919c0) 00000020:00000080:3.0:1783144237.456654:0:84980:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783144237.521427:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.527320:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783144237.529402:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.532292:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.532467:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.532641:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.533189:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.533415:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.533629:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.533909:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.534077:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.534311:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.534506:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.534671:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.534961:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.535165:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.535434:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.535597:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.535863:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.536064:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.536275:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.536440:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.536638:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.536886:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.537087:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.537335:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.537530:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.537863:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.538074:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.538314:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.538510:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.538707:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783144237.538991:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.539238:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.539476:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783144237.540241:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783144237.540572:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783144237.540826:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783144237.541060:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.541258:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.541523:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.541880:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783144237.542088:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.542247:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.542429:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783144237.542596:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.542837:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783144237.544517:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.544966:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.545211:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.545547:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.545835:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1783144237.546041:0:84980:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1783144237.546511:0:84980:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783144237.546779:0:84980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783144237.546787:0:84980:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783144237.546796:0:84980:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046f1d 00000020:01000004:0.0:1783144237.546802:0:84980:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783144237.546814:0:84980:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783144237.546818:0:84980:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2af71e6800 from MGS 00000020:01000004:0.0:1783144237.546822:0:84980:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783144237.546831:0:84980:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c2ad08db380) 00000020:00000080:0.0:1783144237.546841:0:84980:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783144237.546896:0:84980:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2af71e6800 from MGS, refs=2 00080000:01000000:0.0:1783144237.546900:0:84980:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783144237.546905:0:84980:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046f2b 00010000:00010000:0.0:1783144237.547007:0:84980:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1783144237.550433:0:84980:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783144237.551181:0:84984:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783144237.551217:0:84980:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783144237.551244:0:84980:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783144237.551601:0:84980:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783144237.554883:0:84980:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783144237.555106:0:84980:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783144237.555114:0:84980:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783144237.558863:0:84980:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783144237.558873:0:84980:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783144237.559188:0:84980:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783144237.559195:0:84980:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783144237.561238:0:84980:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783144237.561264:0:84980:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1783144237.561265:0:84980:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1783144237.561269:0:84980:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1783144237.561275:0:84980:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783144237.561281:0:84980:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783144237.570768:0:84980:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783144237.570772:0:84980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783144237.570782:0:84980:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2aeed24a80 x1869759501237504/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144241 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144237.570802:0:84980:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2addaad500 x1869759501239296/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144246 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144237.570817:0:84980:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2aefa55c00 x1869759501240704/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783144237.570831:0:84980:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783144237.570834:0:84980:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783144237.570835:0:84980:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783144237.570838:0:84980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1783144237.570884:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501240704:0@lo:400:kworker.0 00000100:00100000:3.0:1783144237.571080:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501237504:0@lo:400:kworker.0 00000100:00100000:0.0:1783144237.571165:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501239296:0@lo:400:kworker.0 10000000:01000000:2.0:1783144237.571208:0:84980:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1783144237.571231:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0e00/0xad8e53a423046bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046be3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571241:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0e00/0xad8e53a423046bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046be3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571247:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1783144237.571263:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571272:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0e00/0xad8e53a423046bdc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046be3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571288:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47de00/0xad8e53a423046b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046b49 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571294:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47de00/0xad8e53a423046b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046b49 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571298:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571301:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571304:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47de00/0xad8e53a423046b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046b49 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571312:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423046b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046b65 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571318:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423046b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046b65 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571323:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571343:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571347:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423046b5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046b65 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571356:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423046b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046b8f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571362:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423046b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046b8f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571367:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571370:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571373:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423046b88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046b8f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571381:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a423046b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046b9d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571387:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a423046b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046b9d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571392:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571394:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571396:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a423046b96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046b9d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571402:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0800/0xad8e53a423046bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046bb9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571407:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0800/0xad8e53a423046bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046bb9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571420:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571424:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571427:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0800/0xad8e53a423046bb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046bb9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571439:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423046bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046bc7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571445:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423046bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046bc7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571450:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571453:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571455:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423046bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046bc7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571463:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423046bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046bf1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571468:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423046bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046bf1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571473:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571476:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571479:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423046bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046bf1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571488:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fc00/0xad8e53a423046b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046b57 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571502:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fc00/0xad8e53a423046b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046b57 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571508:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571511:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571515:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fc00/0xad8e53a423046b50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046b57 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571526:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423046b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046b73 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571532:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423046b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046b73 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571536:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144237.571539:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571541:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423046b6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046b73 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571549:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423046b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046b81 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571555:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423046b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046b81 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571559:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783144237.571562:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571565:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423046b7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046b81 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571579:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423046ba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571585:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423046ba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571594:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783144237.571597:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571601:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423046ba4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.571609:0:84980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a423046bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423046bd5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144237.571614:0:84980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a423046bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423046bd5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.571619:0:84980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783144237.571622:0:84980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783144237.571625:0:84980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a423046bce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423046bd5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783144237.571639:0:84980:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2ac6d92000 already not connected (conn 50, was 0): DISCONN 00000100:00080000:2.0:1783144237.571644:0:84980:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144237.571648:0:84980:0:(import.c:512:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 2552 00000100:00080000:2.0:1783144237.571655:0:84980:0:(import.c:626:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c2ac6d92000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144237.571680:0:84980:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee433800 x1869759501241856/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144237.571714:0:84980:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1783144237.571809:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501241856:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783144237.571879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144237.571947:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241856 00000100:00100000:3.0:1783144237.571954:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241856 00000100:00100000:3.0:1783144237.571987:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783144237.571994:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1869759501241856:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783144237.572025:0:84986:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo t0 exp 0000000000000000 cur 2771 last 0 00000020:00000080:3.0:1783144237.572046:0:84986:0:(genops.c:1406:class_connect()) connect: client 4e9e4714-8000-4c64-bed6-3cadd5fdfc80, cookie 0xad8e53a423046f32 00000100:00080000:3.0:1783144237.572161:0:84986:0:(import.c:65:import_set_state_nolock()) ffff9c2aef585000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144237.572231:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3647:x1869759501241856:12345-0@lo:250:mount.lustre.0 Request processed in 235us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.572239:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783144237.572378:0:3647:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 23 00000100:00080000:2.0:1783144237.572385:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:2.0:1783144237.572390:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783144237.572393:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783144237.572396:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783144237.572398:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783144237.572418:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783144237.572427:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501241856:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1783144237.572443:0:84980:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1783144237.572451:0:84980:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783144237.572482:0:84980:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783144237.572487:0:84980:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783144237.572573:0:84980:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783144237.572602:0:84980:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783144237.572606:0:84980:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783144237.572608:0:84980:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144237.572609:0:84980:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144237.572610:0:84980:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144237.572611:0:84980:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144237.572612:0:84980:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144237.572614:0:84980:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144237.572615:0:84980:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144237.572617:0:84980:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144237.572618:0:84980:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783144237.572620:0:84980:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783144237.572622:0:84980:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783144237.572624:0:84980:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144237.572625:0:84980:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144237.572626:0:84980:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144237.572626:0:84980:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144237.572628:0:84980:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144237.572628:0:84980:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144237.572633:0:84980:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144237.572635:0:84980:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144237.572635:0:84980:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783144237.572647:0:84980:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783144237.572658:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501241984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783144237.572689:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.572708:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af69a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.572761:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501241984 00000100:00100000:0.0:1783144237.572823:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501241984 00000020:01000000:1.0:1783144237.572889:0:35504:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.104@tcp 10000000:01000000:1.0:1783144237.572901:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783144237.572904:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144237.572905:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144237.572906:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144237.572907:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144237.572908:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144237.572909:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144237.572910:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144237.572912:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144237.572913:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144237.572962:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501242112:0@lo:253:kworker.0 00000020:01000000:1.0:1783144237.572999:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783144237.573006:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783144237.573008:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144237.573064:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783144237.573065:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144237.573066:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144237.573067:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144237.573068:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144237.573070:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144237.573071:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144237.573072:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144237.573115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.573231:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:01000000:3.0:1783144237.573277:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783144237.573283:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1783144237.573285:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783144237.573286:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783144237.573287:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144237.573288:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144237.573289:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144237.573290:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144237.573292:0:35504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144237.573293:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144237.573294:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144237.573340:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501242112 00000100:00100000:1.0:1783144237.573345:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501242112 00000100:00100000:0.0:1783144237.573354:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783144237.573366:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:84980:x1869759501241984:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783144237.573377:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501242368:0@lo:253:kworker.0 20000000:01000000:0.0:1783144237.573406:0:84987:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783144237.573410:0:84987:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1783144237.573411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.573423:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501242240:0@lo:253:kworker.0 20000000:01000000:0.0:1783144237.573434:0:84987:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1783144237.573446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.573488:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501242368 00000100:00100000:2.0:1783144237.573492:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501242368 00000020:01000000:3.0:1783144237.573529:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783144237.573680:0:84989:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783144237.573844:0:84987:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 100 00000100:00100000:3.0:1783144237.573885:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501242240 00000100:00100000:3.0:1783144237.573889:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501242240 00000100:00100000:3.0:1783144237.573907:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783144237.573915:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3649:x1869759501242112:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783144237.573933:0:84988:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783144237.577107:0:84990:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783144237.577112:0:84990:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1783144237.577115:0:84990:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783144237.577118:0:84990:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783144237.577305:0:84990:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1783144237.577482:0:84987:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783144237.577998:0:84988:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783144237.578680:0:84987:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783144237.579574:0:84988:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783144237.579589:0:84988:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783144237.579916:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3649:x1869759501242112:12345-0@lo:253:kworker.0 Request processed in 5994us (6793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.579916:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:84980:x1869759501241984:12345-0@lo:253:mount.lustre.0 Request processed in 6547us (7219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.579936:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783144237.579952:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501241984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783144237.579969:0:84980:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 20000000:01000000:1.0:1783144237.579972:0:84989:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000020:01000004:2.0:1783144237.579973:0:84980:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783144237.579977:0:84980:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 10000000:01000000:1.0:1783144237.579977:0:84989:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:2.0:1783144237.579979:0:84980:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144237.579982:0:84980:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144237.579985:0:84980:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144237.579986:0:84980:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144237.579988:0:84980:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144237.579990:0:84980:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144237.579991:0:84980:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144237.579992:0:84980:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:3.0:1783144237.580002:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1783144237.580011:0:84980:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2af71e6800 from lustre-MDT0000 00000100:00100000:0.0:1783144237.580035:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783144237.580047:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3651:x1869759501242368:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783144237.580073:0:84987:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1783144237.580080:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1783144237.580084:0:84987:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783144237.580101:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:3651:x1869759501242240:12345-0@lo:253:kworker.0 10000000:01000000:2.0:1783144237.580112:0:84980:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783144237.580116:0:84980:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 20000000:01000000:3.0:1783144237.580120:0:84988:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1783144237.580125:0:84980:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2af71e6800 10000000:01000000:2.0:1783144237.580130:0:84980:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783144237.580135:0:84980:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2af71e6800 10000000:01000000:2.0:1783144237.580139:0:84980:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783144237.580150:0:84980:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2af71e6800 from 1 00010000:00010000:1.0:1783144237.580152:0:84989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.580154:0:84980:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783144237.580169:0:84989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783144237.580178:0:84989:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000201743s 00010000:00010000:1.0:1783144237.580183:0:84989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.580185:0:84980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.580195:0:84989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.580199:0:84980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.580203:0:84989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.580213:0:84980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.580214:0:84989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144237.580235:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783144237.580270:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1783144237.580285:0:3649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783144237.580288:0:3649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783144237.580290:0:3649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144237.580291:0:3649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144237.580292:0:3649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144237.580294:0:3649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144237.580295:0:3649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783144237.580297:0:3649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144237.580298:0:3649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783144237.580302:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501242112:0@lo:253:kworker.0 00000100:00100000:2.0:1783144237.580305:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af7162e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144237.580323:0:84986:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783144237.580330:0:84986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00010000:00010000:1.0:1783144237.580348:0:84989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144237.580353:0:84989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.580371:0:84989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.580383:0:84989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.580391:0:84989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.580397:0:84989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150000/0xad8e53a423046f39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144237.581040:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501242496 00000100:00100000:0.0:1783144237.581047:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501242496 00000100:00100000:2.0:1783144237.581272:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783144237.581280:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:84980:x1869759501242496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144237.581290:0:84991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144237.581304:0:84991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98f800/0xad8e53a423046f47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423046f40 expref: -99 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.581322:0:84991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98f800/0xad8e53a423046f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423046f40 expref: 8 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.581331:0:84991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98f800/0xad8e53a423046f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423046f40 expref: 8 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.581338:0:84991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f800, rc 0) 00000100:00100000:2.0:1783144237.581385:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:84980:x1869759501242496:12345-0@lo:101:mount.lustre.0 Request processed in 105us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.581397:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783144237.581546:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee433800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144237.581559:0:84980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.581568:0:84980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144237.581581:0:84980:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783144237.581596:0:84980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.581615:0:84980:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144237.581622:0:84980:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783144237.581627:0:84980:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783144237.581636:0:84980:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2af71e6800 10000000:01000000:0.0:1783144237.581639:0:84980:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783144237.581643:0:84980:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783144237.581645:0:84980:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783144237.581663:0:84980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.581672:0:84980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.581679:0:84980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144237.581696:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef606680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783144237.581762:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.581791:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144237.582071:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501242624 00000100:00100000:3.0:1783144237.582076:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501242624 00000100:00100000:2.0:1783144237.582109:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783144237.582115:0:84986:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:2.0:1783144237.582121:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:84980:x1869759501242624:12345-0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144237.582125:0:84986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00010000:00010000:2.0:1783144237.582131:0:84991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144237.582142:0:84991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98f400/0xad8e53a423046f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423046f4e expref: -99 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.582157:0:84991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98f400/0xad8e53a423046f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423046f4e expref: 9 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.582165:0:84991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98f400/0xad8e53a423046f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423046f4e expref: 9 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.582349:0:84991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f400, rc 0) 00000100:00100000:2.0:1783144237.582386:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84980:x1869759501242624:12345-0@lo:101:mount.lustre.0 Request processed in 269us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.582393:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783144237.582529:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef606680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144237.582541:0:84980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.582549:0:84980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144237.582599:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef606680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144237.582626:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.582651:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144237.582718:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501242752 00000100:00100000:2.0:1783144237.582750:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501242752 00000100:00100000:2.0:1783144237.582773:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783144237.582780:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84980:x1869759501242752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144237.582903:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501242752:12345-0@lo:501:mount.lustre.0 Request processed in 122us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.582911:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783144237.583023:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef606680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144237.583052:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef606680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144237.583093:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.583125:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.583182:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501242880 00000100:00100000:0.0:1783144237.583186:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501242880 00000100:00100000:0.0:1783144237.583216:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783144237.583222:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501242880:12345-0@lo:503:mount.lustre.0 20000000:01000000:0.0:1783144237.583678:0:84987:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783144237.583690:0:84987:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783144237.583788:0:84989:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783144237.583792:0:84989:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783144237.583808:0:84989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583818:0:84989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144237.583826:0:84989:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000201743s 00010000:00010000:0.0:1783144237.583830:0:84989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583837:0:84989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583843:0:84989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583850:0:84989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583856:0:84989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144237.583860:0:84989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583874:0:84989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583885:0:84989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583892:0:84989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.583899:0:84989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144237.584076:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:3651:x1869759501242368:12345-0@lo:253:kworker.0 Request processed in 4033us (10664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.584084:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1783144237.584112:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783144237.584115:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783144237.584117:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144237.584125:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144237.584126:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144237.584128:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144237.584129:0:3651:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144237.584131:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144237.584132:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783144237.584136:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501242368:0@lo:253:kworker.0 20000000:01000000:1.0:1783144237.584209:0:84988:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783144237.584630:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84980:x1869759501242880:12345-0@lo:503:mount.lustre.0 Request processed in 1407us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.584637:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783144237.584692:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef606680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501242880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144237.586233:0:84993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee432a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84993:1869759501243008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144237.586287:0:84993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.586325:0:84993:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af69a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144237.586338:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243008 00000100:00100000:3.0:1783144237.586345:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243008 00000100:00100000:3.0:1783144237.586387:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783144237.586395:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84993:x1869759501243008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144237.587203:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84993:x1869759501243008:12345-0@lo:502:llog_process_th.0 Request processed in 806us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.587211:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783144237.587529:0:84993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee432a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84993:1869759501243008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144237.587556:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144237.587569:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144237.587571:0:84993:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783144237.587576:0:84993:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783144237.587579:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783144237.587593:0:84993:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c29c31e4d40) 00000020:00000080:2.0:1783144237.587612:0:84993:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1783144237.587618:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783144237.587844:0:84993:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783144237.587853:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046f6a 20000000:01000000:3.0:1783144237.588074:0:84988:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783144237.588122:0:84988:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000020:00000080:2.0:1783144237.588260:0:84993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783144237.588265:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144237.588268:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144237.588270:0:84993:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783144237.588272:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144237.588275:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144237.588277:0:84993:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783144237.588280:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783144237.588287:0:84993:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c29c31e0000) 00000020:00000080:2.0:1783144237.588300:0:84993:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1783144237.588304:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783144237.588313:0:84993:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783144237.588316:0:84993:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783144237.588323:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783144237.588371:0:84993:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2af71e6800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783144237.588383:0:84993:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c29c31e3380) 00000020:00000080:2.0:1783144237.588393:0:84993:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000100:00100000:3.0:1783144237.588598:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3651:x1869759501242240:12345-0@lo:253:kworker.0 Request processed in 8493us (15147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.588608:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1783144237.588659:0:84989:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783144237.588664:0:84989:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:1.0:1783144237.588684:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783144237.588687:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783144237.588688:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144237.588689:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144237.588690:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144237.588692:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144237.588693:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144237.588695:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144237.588697:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144237.588700:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501242240:0@lo:253:kworker.0 00010000:00010000:0.0:1783144237.588785:0:84989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588801:0:84989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144237.588810:0:84989:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000201743s 00010000:00010000:0.0:1783144237.588815:0:84989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588821:0:84989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588835:0:84989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588842:0:84989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588848:0:84989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144237.588852:0:84989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588860:0:84989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588872:0:84989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588879:0:84989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.588885:0:84989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423046f7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:01000000:2.0:1783144237.589094:0:84993:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783144237.589102:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423046f86 00000020:00000080:2.0:1783144237.589202:0:84993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783144237.589210:0:84993:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783144237.589214:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad8e53a423046f8d 00080000:01000000:2.0:1783144237.589219:0:84993:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783144237.589224:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046f94 00010000:00010000:3.0:1783144237.639168:0:84993:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1783144237.639299:0:84993:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: cace81e7-a6f2-4d37-b197-caf34583781c idx: 0 lr: 0 srv lr: 94489280512 lx: 0 gen 22 00000001:00080000:3.0:1783144237.639338:0:84993:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 94489280512 lx: 0 gen 21 00000001:00000004:3.0:1783144237.639361:0:84993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:3.0:1783144237.639455:0:84993:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1783144237.639508:0:84993:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c29c26fa000: xid 1869759481633152, transno 94489280513, client gen 22, slot idx 0 00000020:00000080:3.0:1783144237.640447:0:84993:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c2aee593380) 00000020:00000080:3.0:1783144237.640467:0:84993:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1783144237.640531:0:84993:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783144237.640538:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046fb0 00000020:00000080:3.0:1783144237.642487:0:84993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783144237.645938:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad8e53a423046fb7 00000020:00000080:3.0:1783144237.646530:0:84993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783144237.646542:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144237.646548:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144237.646550:0:84993:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783144237.646553:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783144237.646556:0:84993:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783144237.646557:0:84993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144237.646559:0:84993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144237.646560:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783144237.646563:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144237.646565:0:84993:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783144237.646568:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144237.646573:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144237.646575:0:84993:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783144237.646580:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783144237.646623:0:84993:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783144237.646640:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144237.646644:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144237.646646:0:84993:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783144237.646656:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144237.646659:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144237.646661:0:84993:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783144237.646664:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783144237.646670:0:84993:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:3.0:1783144237.646695:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783144237.646708:0:84993:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c2aee594d40) 00000020:00000080:3.0:1783144237.646737:0:84993:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1783144237.646753:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783144237.646815:0:84993:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783144237.646820:0:84993:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783144237.646826:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046fc5 00010000:00080000:3.0:1783144237.646857:0:84993:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ae4b25800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1783144237.648570:0:84993:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1783144237.650022:0:84993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144237.650035:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783144237.650068:0:84993:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783144237.650089:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423046fcc 00000100:00080000:1.0:1783144237.650098:0:84993:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783144237.650105:0:84993:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2ae4b25800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144237.650135:0:84993:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeed24a80 x1869759501243136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144237.650168:0:84993:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1783144237.650264:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144237.650268:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.650270:0:84993:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783144237.650272:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783144237.650274:0:84993:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1783144237.650276:0:84993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:2.0:1783144237.650277:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501243136:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1783144237.650277:0:84993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144237.650278:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783144237.650280:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.650282:0:84993:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783144237.650284:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783144237.650288:0:84993:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783144237.650291:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.650292:0:84993:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783144237.650295:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783144237.650298:0:84993:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1783144237.650314:0:84993:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783144237.650316:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144237.650326:0:84993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c29c356cd40) 00000100:00100000:2.0:1783144237.650339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1783144237.650339:0:84993:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783144237.650343:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1783144237.650392:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243136 00000004:00080000:1.0:1783144237.650396:0:84993:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00100000:2.0:1783144237.650399:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243136 00080000:01000000:1.0:1783144237.650401:0:84993:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783144237.650405:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046fda 00000100:00100000:2.0:1783144237.650426:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00010000:00080000:1.0:1783144237.650429:0:84993:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac317e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00000100:00100000:2.0:1783144237.650433:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501243136:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783144237.650455:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2772 last 0 00000020:00000080:2.0:1783144237.650484:0:8446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423046fe1 00000004:00100000:2.0:1783144237.650496:0:8446:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783144237.650574:0:8446:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7b800 : changing import state from RECOVER to FULL 00010000:00010000:1.0:1783144237.650579:0:84993:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1783144237.650619:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501243136:12345-0@lo:38:llog_process_th.0 Request processed in 185us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.650626:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00100000:2.0:1783144237.650659:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783144237.650666:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1783144237.650861:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144237.650865:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144237.650868:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144237.650873:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2770 00000100:00080000:3.0:1783144237.650876:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783144237.650880:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144237.650885:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144237.650896:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aefa57100 x1869759501243392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144237.650901:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501243264:0@lo:400:kworker.0 00000100:00080000:2.0:1783144237.650918:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783144237.650925:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144237.650928:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144237.650930:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144237.650930:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783144237.650933:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b25800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1783144237.650934:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2770 00000100:00080000:3.0:1783144237.650937:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783144237.650941:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144237.650950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.650953:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501243136:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783144237.650959:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aefa56300 x1869759501243648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144237.650973:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501243392:0@lo:38:kworker.0 00000100:00080000:3.0:1783144237.650987:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783144237.650992:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501243520:0@lo:400:kworker.0 00000100:00080000:3.0:1783144237.650993:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144237.650997:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144237.651001:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2770 00000100:00100000:2.0:1783144237.651002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144237.651004:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783144237.651008:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144237.651020:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501243648:0@lo:38:kworker.0 00000100:00100000:3.0:1783144237.651021:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeeda6300 x1869759501243904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144237.651037:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144237.651047:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144237.651051:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144237.651053:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144237.651057:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2770 00000100:00080000:3.0:1783144237.651059:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1783144237.651063:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1783144237.651064:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144237.651073:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501244160:0@lo:400:kworker.0 00000100:00100000:3.0:1783144237.651080:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaac700 x1869759501244288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144237.651113:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501243776:0@lo:400:kworker.0 00000100:00100000:0.0:1783144237.651119:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144237.651150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.651161:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243392 00000100:00100000:0.0:1783144237.651166:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243392 00000100:00100000:2.0:1783144237.651171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144237.651173:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144237.651179:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501244032:0@lo:400:kworker.0 00000100:00100000:0.0:1783144237.651195:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243520 00000100:00100000:3.0:1783144237.651202:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.651213:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243520 00000100:00100000:0.0:1783144237.651268:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243776 00000100:00100000:0.0:1783144237.651272:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243776 00000100:00100000:0.0:1783144237.651286:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243648 00000100:00100000:0.0:1783144237.651290:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243648 00000100:00100000:0.0:1783144237.651305:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1783144237.651313:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1783144237.651315:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501243520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144237.651326:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501243776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144237.651362:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501243520:12345-0@lo:400:kworker.0 Request processed in 49us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.651372:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1783144237.651380:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501243776:12345-0@lo:400:kworker.0 Request processed in 58us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.651389:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000040:01000000:1.0:1783144237.652089:0:84993:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783144237.652110:0:84993:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1783144237.652196:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501243904:0@lo:38:kworker.0 00000100:00100000:2.0:1783144237.652226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.652247:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501244288:0@lo:38:kworker.0 00000100:00100000:2.0:1783144237.652268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.652294:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144237.652301:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501244416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144237.652327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.652360:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244288 00000100:00100000:2.0:1783144237.652364:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244288 00000100:00100000:0.0:1783144237.652421:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1783144237.652428:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501243392:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144237.652475:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501243392:12345-0@lo:38:kworker.0 Request processed in 46us (1471us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144237.652481:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1783144237.652498:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1783144237.652502:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501243648:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144237.652532:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501243648:12345-0@lo:38:kworker.0 Request processed in 28us (1363us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144237.652537:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1783144237.652560:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243264 00000100:00100000:0.0:1783144237.652564:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243264 00000100:00100000:0.0:1783144237.652590:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783144237.652597:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3649:x1869759501243264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144237.652643:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3649:x1869759501243264:12345-0@lo:400:kworker.0 Request processed in 47us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.652650:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783144237.652691:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501243520:0@lo:400:kworker.0 00000100:00100000:0.0:1783144237.652700:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501243264:0@lo:400:kworker.0 00000040:00080000:1.0:1783144237.652869:0:84993:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000040:00080000:1.0:1783144237.653479:0:84993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783144237.653513:0:84993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000100:00100000:2.0:1783144237.655280:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1783144237.655291:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501244288:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144237.655373:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501244288:12345-0@lo:38:kworker.0 Request processed in 81us (3103us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783144237.655375:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501243776:0@lo:400:kworker.0 00000100:00100000:2.0:1783144237.655380:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1783144237.655404:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244160 00000100:00100000:2.0:1783144237.655410:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244160 00000100:00100000:2.0:1783144237.655448:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244032 00000100:00100000:2.0:1783144237.655452:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244032 00000100:00100000:2.0:1783144237.655473:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1783144237.655485:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501244160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144237.655529:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501244160:12345-0@lo:400:kworker.0 Request processed in 44us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.655535:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1783144237.655546:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1783144237.655552:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501244032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144237.655578:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501244032:12345-0@lo:400:kworker.0 Request processed in 26us (4375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.655583:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1783144237.655623:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501243904 00000100:00100000:2.0:1783144237.655626:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501243904 00000100:00100000:2.0:1783144237.655641:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244416 00000100:00100000:2.0:1783144237.655643:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244416 00000100:00100000:2.0:1783144237.655658:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:2.0:1783144237.655663:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501243904:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144237.655813:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501243904:12345-0@lo:38:kworker.0 Request processed in 148us (3586us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783144237.655820:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:2.0:1783144237.655832:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:2.0:1783144237.655838:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501244416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783144237.655861:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144237.655896:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501244416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.655902:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:2.0:1783144237.655941:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501244416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144237.655964:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501244032:0@lo:400:kworker.0 00000100:00100000:2.0:1783144237.655999:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501244160:0@lo:400:kworker.0 00000100:00080000:2.0:1783144237.656028:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144237.656033:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144237.656036:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501243904:0@lo:38:kworker.0 00000100:00080000:2.0:1783144237.656157:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144237.656161:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144237.656164:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501244288:0@lo:38:kworker.0 00000100:00080000:2.0:1783144237.656174:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144237.656177:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144237.656180:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501243392:0@lo:38:kworker.0 00000100:00080000:2.0:1783144237.656398:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144237.656402:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144237.656405:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501243648:0@lo:38:kworker.0 00000040:00080000:1.0:1783144237.657816:0:84993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000040:00080000:3.0:1783144237.658334:0:84999:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:3.0:1783144237.658339:0:84999:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783144237.658794:0:84999:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:3.0:1783144237.658825:0:84999:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783144237.658984:0:84999:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:3.0:1783144237.658988:0:84999:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783144237.659082:0:84993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144237.659092:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783144237.659129:0:84993:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783144237.659162:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423046fe8 00000100:00080000:1.0:1783144237.659170:0:84993:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783144237.659176:0:84993:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2ac317e000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144237.659205:0:84993:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeed24a80 x1869759501244544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144237.659260:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501244544:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783144237.659320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.659383:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244544 00000100:00100000:0.0:1783144237.659389:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244544 00000100:00100000:0.0:1783144237.659418:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4912 00000100:00100000:0.0:1783144237.659424:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3647:x1869759501244544:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783144237.659448:0:26140:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2772 last 0 00000020:00000080:0.0:1783144237.659471:0:26140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423046fef 00002000:00100000:0.0:1783144237.659482:0:26140:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2ac9d62000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783144237.659485:0:26140:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783144237.659486:0:26140:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783144237.659525:0:26140:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783144237.659541:0:26140:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d67800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783144237.659581:0:84993:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783144237.659631:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144237.659636:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.659638:0:84993:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783144237.659641:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783144237.659643:0:84993:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1783144237.659645:0:84993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144237.659646:0:84993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144237.659648:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783144237.659650:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.659651:0:84993:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783144237.659653:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783144237.659657:0:84993:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783144237.659660:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.659662:0:84993:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783144237.659665:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783144237.659668:0:84993:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1783144237.659682:0:84993:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783144237.659684:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144237.659692:0:84993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c29c3568000) 00000020:00000080:1.0:1783144237.659701:0:84993:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783144237.659710:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783144237.659810:0:84993:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783144237.659816:0:84993:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783144237.659822:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423046ffd 00010000:00080000:1.0:1783144237.659846:0:84993:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac5d53000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144237.660008:0:84993:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783144237.660062:0:84993:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783144237.660073:0:84993:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783144237.660463:0:84993:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000040:00080000:1.0:1783144237.661045:0:84993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783144237.661073:0:84993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:1.0:1783144237.661178:0:84993:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000040:00080000:1.0:1783144237.661542:0:85001:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:1.0:1783144237.661546:0:85001:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1783144237.661588:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501244544:12345-0@lo:8:llog_process_th.0 Request processed in 2160us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.661598:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4912 00000100:00100000:2.0:1783144237.661688:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783144237.661697:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783144237.661704:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783144237.661708:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783144237.661711:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783144237.661783:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783144237.661790:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501244544:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783144237.661919:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783144237.661936:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501244672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144237.661978:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.662010:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244672 00000100:00100000:2.0:1783144237.662014:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244672 00000100:00100000:2.0:1783144237.662063:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1783144237.662070:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501244672:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783144237.662073:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783144237.662092:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144237.662128:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501244672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.662134:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1783144237.662166:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501244672:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1783144237.662214:0:84999:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783144237.662252:0:84999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2772015529350ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783144237.662257:0:84999:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:00000080:1.0:1783144237.662418:0:84993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144237.662428:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783144237.662464:0:84993:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783144237.662486:0:84993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047004 00000100:00080000:1.0:1783144237.662492:0:84993:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783144237.662497:0:84993:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2ac5d53000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144237.662517:0:84993:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeed24a80 x1869759501244800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144237.662568:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501244800:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783144237.662603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.662679:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244800 00000100:00100000:0.0:1783144237.662684:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244800 00000100:00100000:0.0:1783144237.662707:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:0.0:1783144237.662712:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1869759501244800:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783144237.662778:0:26150:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2772 last 0 00000020:00000080:0.0:1783144237.662799:0:26150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304700b 00002000:00100000:0.0:1783144237.662811:0:26150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2ac9d61800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783144237.662815:0:26150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783144237.662818:0:26150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783144237.662869:0:26150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783144237.662888:0:26150:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d65000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783144237.662951:0:84993:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783144237.663000:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144237.663005:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.663007:0:84993:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783144237.663020:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144237.663026:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.663027:0:84993:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783144237.663031:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783144237.663033:0:84993:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783144237.663042:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144237.663044:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.663046:0:84993:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783144237.663049:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144237.663052:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144237.663054:0:84993:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783144237.663058:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783144237.663085:0:84993:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84993:1869759501244928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144237.663131:0:84993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144237.663150:0:84993:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.663335:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501244800:12345-0@lo:8:llog_process_th.0 Request processed in 620us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.663342:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000100:00100000:2.0:1783144237.663354:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501244928 00000100:00100000:2.0:1783144237.663358:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501244928 00000100:00100000:2.0:1783144237.663392:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783144237.663400:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:84993:x1869759501244928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144237.663430:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783144237.663436:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783144237.663440:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783144237.663444:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783144237.663447:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d53000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783144237.663488:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783144237.663494:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501244800:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783144237.663496:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:84993:x1869759501244928:12345-0@lo:502:llog_process_th.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.663503:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783144237.663554:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144237.663561:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501245056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144237.663585:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.663641:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245056 00000100:00100000:0.0:1783144237.663645:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245056 00000100:00100000:0.0:1783144237.663677:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:0.0:1783144237.663684:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501245056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783144237.663700:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144237.663761:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501245056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.663777:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:0.0:1783144237.663813:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501245056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783144237.663835:0:84993:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84993:1869759501244928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144237.663855:0:84993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144237.663859:0:84993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144237.663861:0:84993:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783144237.663865:0:84993:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00080000:3.0:1783144237.664102:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:3.0:1783144237.664115:0:84980:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783144237.664137:0:84980:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783144237.664158:0:84980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144237.664170:0:84980:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144237.664177:0:84980:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2af71e6800 from 1 10000000:01000000:3.0:1783144237.664180:0:84980:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144237.664205:0:84980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144237.664212:0:84980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144237.664221:0:84980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144237.664234:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144237.664260:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783144237.664574:0:85001:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 3 count 2 00000040:00080000:1.0:1783144237.664593:0:85001:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:1.0:1783144237.664597:0:85001:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1783144237.664613:0:85001:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1783144237.664683:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144237.664753:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245184 00000100:00100000:2.0:1783144237.664759:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245184 00000100:00100000:2.0:1783144237.664786:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783144237.664792:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:84980:x1869759501245184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144237.664811:0:84988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144237.664824:0:84988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047012 expref: -99 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.664845:0:84988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047012 expref: 9 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.664862:0:84988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047012 expref: 9 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.664871:0:84988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e400, rc 0) 00000100:00100000:2.0:1783144237.664902:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84980:x1869759501245184:12345-0@lo:101:mount.lustre.0 Request processed in 110us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.664908:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783144237.664937:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501245312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783144237.664975:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.665014:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245312 00000100:00100000:2.0:1783144237.665018:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245312 00000100:00100000:2.0:1783144237.665040:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914 00000100:00100000:2.0:1783144237.665046:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501245312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783144237.665062:0:16470:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1666 count 1 00000004:00080000:1.0:1783144237.665062:0:85001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2772018339126ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783144237.665069:0:85001:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783144237.665123:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501245312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 77us (147us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144237.665130:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914 00000004:00080000:2.0:1783144237.665157:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c2aef485880, transno 0 00000004:00080000:2.0:1783144237.665161:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c2aef485880/1, rc -2, transno 0 00000100:00100000:2.0:1783144237.665179:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501245312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783144237.665217:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144237.665231:0:84980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.665239:0:84980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783144237.665261:0:85001:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1783144237.665278:0:85001:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1783144237.665718:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245440:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783144237.665783:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.665806:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eed540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144237.665853:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245440 00000100:00100000:3.0:1783144237.665858:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245440 00000004:00080000:2.0:1783144237.665863:0:84981:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783144237.665883:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783144237.665889:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac2ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84980:x1869759501245440:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783144237.665902:0:84992:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783144237.665918:0:84992:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783144237.665923:0:84992:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783144237.665926:0:84992:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783144237.665928:0:84992:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 103 00000100:00100000:3.0:1783144237.666001:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac2ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84980:x1869759501245440:12345-0@lo:256:mount.lustre.0 Request processed in 112us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.666021:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245440:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783144237.666207:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:01000000:2.0:1783144237.666533:0:84980:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783144237.666548:0:84980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.666557:0:84980:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144237.666565:0:84980:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2af71e6800 from 1 10000000:01000000:2.0:1783144237.666568:0:84980:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783144237.666586:0:84980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.666594:0:84980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.666601:0:84980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144237.666612:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783144237.666631:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.666652:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eed540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.666660:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245568 00000100:00100000:0.0:1783144237.666664:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245568 00000100:00100000:0.0:1783144237.666703:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783144237.666710:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac2ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:84980:x1869759501245568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144237.666718:0:84986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144237.666969:0:84986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423047027 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047020 expref: -99 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.666988:0:84986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423047027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047020 expref: 10 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.666997:0:84986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423047027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047020 expref: 10 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.667004:0:84986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7e00, rc 0) 00000100:00100000:0.0:1783144237.667087:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac2ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501245568:12345-0@lo:101:mount.lustre.0 Request processed in 377us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.667093:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783144237.669381:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144237.669414:0:84980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.669426:0:84980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144237.669495:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144237.669544:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.669588:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eed540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144237.669914:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245696 00000100:00100000:3.0:1783144237.669920:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245696 00000100:00100000:3.0:1783144237.669957:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783144237.669966:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac2ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501245696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144237.670157:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac2ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501245696:12345-0@lo:501:mount.lustre.0 Request processed in 191us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.670164:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783144237.671494:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144237.671535:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144237.671579:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.671610:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eed540 going to sleep for 11 seconds 00000004:00080000:0.0:1783144237.671882:0:84981:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783144237.671955:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245824 00000100:00100000:3.0:1783144237.671960:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245824 00000100:00100000:3.0:1783144237.671990:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783144237.671998:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501245824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144237.672088:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501245824:12345-0@lo:503:mount.lustre.0 Request processed in 90us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.672095:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783144237.672099:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501245824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144237.672427:0:85003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85003:1869759501245952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144237.672461:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.672487:0:85003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eede40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.672529:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501245952 00000100:00100000:0.0:1783144237.672533:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501245952 00000100:00100000:0.0:1783144237.672563:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783144237.672570:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:85003:x1869759501245952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144237.673156:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:85003:x1869759501245952:12345-0@lo:502:llog_process_th.0 Request processed in 584us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.673164:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783144237.673237:0:85003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85003:1869759501245952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144237.673260:0:85003:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144237.673268:0:85003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144237.673271:0:85003:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783144237.673278:0:85003:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2af71e6800 00000020:00000080:2.0:1783144237.673281:0:85003:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783144237.673289:0:85003:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144237.673291:0:85003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144237.673293:0:85003:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783144237.673303:0:85003:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144237.673306:0:85003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144237.673308:0:85003:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783144237.673312:0:85003:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2af71e6800 00000020:00000080:2.0:1783144237.673314:0:85003:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783144237.673444:0:85003:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85003:1869759501246080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144237.673477:0:85003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.673503:0:85003:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eede40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144237.673548:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246080 00000100:00100000:3.0:1783144237.673552:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246080 00000100:00100000:3.0:1783144237.673579:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783144237.673584:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:85003:x1869759501246080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144237.673656:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:85003:x1869759501246080:12345-0@lo:502:llog_process_th.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.673663:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783144237.673849:0:85003:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85003:1869759501246080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144237.673871:0:85003:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144237.673876:0:85003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144237.673878:0:85003:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783144237.673890:0:85003:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783144237.673964:0:84980:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783144237.673992:0:84980:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783144237.674013:0:84980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144237.674035:0:84980:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144237.674083:0:84980:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783144237.674087:0:84980:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2af71e6800 10000000:01000000:3.0:1783144237.674090:0:84980:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2af71e6800 10000000:01000000:3.0:1783144237.674094:0:84980:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783144237.674099:0:84980:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2af71e6800 from 1 10000000:01000000:3.0:1783144237.674101:0:84980:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144237.674124:0:84980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144237.674132:0:84980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144237.674140:0:84980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144237.674153:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501246208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144237.674179:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144237.674210:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.674255:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246208 00000100:00100000:0.0:1783144237.674259:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246208 00000100:00100000:0.0:1783144237.674319:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783144237.674326:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:84980:x1869759501246208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144237.674334:0:84991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144237.674347:0:84991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f6600/0xad8e53a423047035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304702e expref: -99 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.674366:0:84991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f6600/0xad8e53a423047035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304702e expref: 11 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.674375:0:84991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f6600/0xad8e53a423047035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304702e expref: 11 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.674383:0:84991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6600, rc 0) 00000100:00100000:0.0:1783144237.674421:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:84980:x1869759501246208:12345-0@lo:101:mount.lustre.0 Request processed in 95us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.674427:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783144237.674856:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501246208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144237.674868:0:84980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.674877:0:84980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144237.674921:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501246336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144237.674946:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.674967:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eed600 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.674987:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246336 00000100:00100000:0.0:1783144237.674993:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246336 00000100:00100000:0.0:1783144237.675033:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783144237.675041:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:84980:x1869759501246336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144237.675265:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:84980:x1869759501246336:12345-0@lo:501:mount.lustre.0 Request processed in 116us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.675275:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783144237.675837:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501246336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144237.675874:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501246464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144237.675911:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.675945:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eed600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144237.676008:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246464 00000100:00100000:3.0:1783144237.676013:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246464 00000100:00100000:3.0:1783144237.676078:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783144237.676086:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:84980:x1869759501246464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144237.676169:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:84980:x1869759501246464:12345-0@lo:503:mount.lustre.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144237.676176:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783144237.676272:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501246464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144237.676569:0:85005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85005:1869759501246592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144237.676608:0:85005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144237.676629:0:85005:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144237.676666:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246592 00000100:00100000:1.0:1783144237.676669:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246592 00000100:00100000:1.0:1783144237.676714:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783144237.676758:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c442b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:85005:x1869759501246592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144237.676845:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c442b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:85005:x1869759501246592:12345-0@lo:502:llog_process_th.0 Request processed in 125us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144237.676852:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783144237.676866:0:85005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85005:1869759501246592:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783144237.676918:0:85005:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783144237.676932:0:85005:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c2af9c7b380) 00000020:00000080:2.0:1783144237.676958:0:85005:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783144237.677166:0:85005:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2af71e6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783144237.677176:0:85005:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2af71e6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783144237.677179:0:85005:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af71e6800 4 00010000:00080000:2.0:1783144237.677205:0:85005:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2aee190000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1783144237.679075:0:85005:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783144237.679191:0:85005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783144237.679230:0:85005:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783144237.679242:0:85005:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad8e53a423047043 00000100:00080000:2.0:1783144237.679250:0:85005:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783144237.679256:0:85005:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2aee190000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144237.679286:0:85005:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeeda6300 x1869759501246720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144237.679308:0:85005:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783144237.679465:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501246720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783144237.679529:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.679699:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246720 00000100:00100000:0.0:1783144237.679710:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246720 00000100:00100000:0.0:1783144237.679777:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1783144237.679786:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501246720:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783144237.679844:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501246720:12345-0@lo:38:llog_process_th.0 Request processed in 59us (315us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144237.679852:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1783144237.680018:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783144237.680025:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aee190000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144237.680029:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144237.680033:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501246720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783144237.680097:0:85005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85005:1869759501246848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144237.680143:0:85005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.680262:0:85005:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144237.680354:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246848 00000100:00100000:0.0:1783144237.680358:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246848 00000100:00100000:0.0:1783144237.680432:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783144237.680439:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c442b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:85005:x1869759501246848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144237.680545:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c442b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:85005:x1869759501246848:12345-0@lo:502:llog_process_th.0 Request processed in 105us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144237.680554:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783144237.680626:0:85005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85005:1869759501246848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144237.680670:0:85005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85005:1869759501246976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144237.680705:0:85005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.680762:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501246976 00000100:00100000:2.0:1783144237.680873:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501246976 00000100:00100000:2.0:1783144237.680936:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783144237.680944:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:85005:x1869759501246976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144237.681010:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:85005:x1869759501246976:12345-0@lo:502:llog_process_th.0 Request processed in 67us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.681018:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783144237.681093:0:85005:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9eedc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144237.681107:0:85005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:85005:1869759501246976:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783144237.681125:0:85005:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783144237.681273:0:84980:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783144237.681298:0:84980:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144237.681349:0:84980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.681360:0:84980:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783144237.681403:0:84980:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783144237.681405:0:84980:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144237.681406:0:84980:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144237.681407:0:84980:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144237.681409:0:84980:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144237.681410:0:84980:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144237.681411:0:84980:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144237.681413:0:84980:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144237.681415:0:84980:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144237.681416:0:84980:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783144237.681424:0:84980:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783144237.681426:0:84980:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783144237.681427:0:84980:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144237.681428:0:84980:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144237.681429:0:84980:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144237.681430:0:84980:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144237.681431:0:84980:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144237.681432:0:84980:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144237.681433:0:84980:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144237.681434:0:84980:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144237.681435:0:84980:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783144237.681448:0:84980:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783144237.681457:0:84980:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef604000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501247104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783144237.681487:0:84980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144237.681507:0:84980:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad3febe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144237.681513:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501247104 00000100:00100000:1.0:1783144237.681519:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501247104 00000100:00100000:1.0:1783144237.681548:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783144237.681557:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:84980:x1869759501247104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144237.681588:0:84991:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783144237.681822:0:84991:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783144237.690142:0:84991:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783144237.690160:0:84991:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783144237.690562:0:84989:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783144237.690567:0:84989:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783144237.690585:0:84989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.690601:0:84989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047012 expref: 11 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.690609:0:84989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.690695:0:84989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423047012 expref: 11 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.690707:0:84989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423047012 expref: 11 pid: 84988 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144237.690790:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:84980:x1869759501247104:12345-0@lo:253:mount.lustre.0 Request processed in 9231us (9298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144237.690802:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783144237.690833:0:84989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef605f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:84989:1869759501247232:0@lo:104: 00000100:00100000:0.0:1783144237.691009:0:84989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.691011:0:84980:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef604000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:84980:1869759501247104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783144237.691025:0:84980:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783144237.691029:0:84980:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783144237.691031:0:84980:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144237.691033:0:84980:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144237.691034:0:84980:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144237.691036:0:84980:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144237.691037:0:84980:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144237.691039:0:84980:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144237.691040:0:84980:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144237.691042:0:84980:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144237.691044:0:84980:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144237.691059:0:84989:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca1cf180 going to sleep for 11 seconds 00000020:02000000:2.0:1783144237.691060:0:84980:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783144237.691099:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501247232 00000100:00100000:1.0:1783144237.691106:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501247232 00000100:00100000:1.0:1783144237.691153:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783144237.691164:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:84989:x1869759501247232:12345-0@lo:104: 00010000:00010000:1.0:1783144237.691177:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.691235:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783144237.691241:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:84989:x1869759501247232:12345-0@lo:104: Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144237.691247:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1783144237.691291:0:84989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef605f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:84989:1869759501247232:0@lo:104: 00010000:00010000:0.0:1783144237.691303:0:84989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.691783:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144237.691789:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.691798:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e600 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144237.691802:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.691811:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144237.691819:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144237.691826:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144237.691866:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.691874:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144237.691903:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.691910:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423047012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423047019 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144237.691927:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144237.691936:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144237.691940:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144237.692087:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144237.692100:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501247360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144237.692135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.692271:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501247360 00000100:00100000:2.0:1783144237.692277:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501247360 00010000:00010000:2.0:1783144237.692296:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423047012 expref: 11 pid: 84988 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144237.692329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:2.0:1783144237.692499:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3648:x1869759501247360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144237.692513:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144237.692525:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423047012 expref: 11 pid: 84988 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692536:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423047012 expref: 11 pid: 84988 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692551:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98e400/0xad8e53a423047019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423047012 expref: 11 pid: 84988 timeout: 2872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692565:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692574:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144237.692589:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002022489s 00010000:00010000:2.0:1783144237.692595:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692603:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692611:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692617:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692623:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144237.692627:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692644:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692668:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144237.692681:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144237.692962:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:3648:x1869759501247360:12345-0@lo:103:ldlm_bl.0 Request processed in 468us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.692970:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00010000:00010000:1.0:1783144237.693667:0:84989:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.693677:0:84989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144237.693684:0:84989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a42304704a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144237.693877:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501247360:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783144237.698569:0:84980:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:2.0:1783144237.698889:0:84980:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783144237.698913:0:85011:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:0.0:1783144237.698918:0:85011:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:0.0:1783144237.700129:0:85012:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1783144237.700192:0:85012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1783144237.700692:0:84980:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1783144237.701766:0:85013:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85013:1869759501247488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144237.701846:0:85013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.701882:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501247488 00000100:00100000:2.0:1783144237.701887:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501247488 00000100:00100000:2.0:1783144237.701926:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3677 00000100:00100000:2.0:1783144237.701934:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85013:x1869759501247488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144237.702002:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85013:x1869759501247488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.702008:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3677 00000100:00100000:2.0:1783144237.702044:0:85013:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144237.702068:0:85013:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85013:1869759501247488:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783144237.702096:0:85013:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783144237.702123:0:85013:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85013:1869759501247616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144237.702154:0:85013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.702197:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501247616 00000100:00100000:2.0:1783144237.702201:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501247616 00000100:00100000:2.0:1783144237.702222:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678 00000100:00100000:2.0:1783144237.702227:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85013:x1869759501247616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144237.702322:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85013:x1869759501247616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.702329:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678 00000100:00100000:2.0:1783144237.702351:0:85013:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144237.702365:0:85013:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85013:1869759501247616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144237.702407:0:85013:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85013:1869759501247744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144237.702429:0:85013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144237.702447:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501247744 00000100:00100000:2.0:1783144237.702450:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501247744 00000100:00100000:2.0:1783144237.702470:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679 00000100:00100000:2.0:1783144237.702476:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85013:x1869759501247744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144237.702516:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85013:x1869759501247744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 40us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144237.702522:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679 00000100:00100000:2.0:1783144237.702537:0:85013:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144237.702708:0:85013:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85013:1869759501247744:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1783144237.702860:0:85013:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783144237.704073:0:84980:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783144237.704104:0:84980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783144237.705860:0:84980:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783144237.705872:0:84980:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783144237.705923:0:84980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783144237.708598:0:85012:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783144237.708665:0:85012:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1783144237.709155:0:85013:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783144237.709209:0:85013:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783144237.709213:0:85013:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1783144237.710811:0:84980:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783144237.711392:0:84980:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783144237.711429:0:84980:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783144237.711557:0:84980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783144237.712106:0:84980:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00010000:00080000:3.0:1783144237.713620:0:84980:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280513 00010000:00080000:1.0:1783144237.714235:0:85014:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85014 00010000:02000000:1.0:1783144237.714249:0:85014:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783144237.714253:0:85014:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783144237.714256:0:85014:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1783144237.714310:0:84980:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783144237.714324:0:84980:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783144237.714342:0:84980:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783144237.714355:0:84980:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783144237.715431:0:84980:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783144237.715711:0:84980:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783144238.031639:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144238.606073:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783144238.606591:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501247872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144238.606666:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.606864:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144238.606876:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501248000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144238.607190:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.609750:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501247872 00000100:00100000:0.0:1783144238.609800:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248000 00000100:00100000:0.0:1783144238.609808:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248000 00000100:00100000:2.0:1783144238.609809:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501247872 00000100:00100000:1.0:1783144238.609931:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1783144238.609941:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501248000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144238.609966:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144238.610032:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501248000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.610038:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:0.0:1783144238.610085:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501248000:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783144238.610370:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144238.610424:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144238.610429:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1783144238.610437:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501247872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144238.610448:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144238.610483:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501247872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.610490:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:3.0:1783144238.610556:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501247872:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1783144238.733845:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783144238.733854:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2af71e6800 from 104 10000000:01000000:1.0:1783144238.733860:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783144238.733909:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.733921:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.733932:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.733958:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.734053:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.734104:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3480 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.734378:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248128 00000100:00100000:0.0:1783144238.734385:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248128 00000100:00100000:0.0:1783144238.734443:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783144238.734453:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac5dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:6518:x1869759501248128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144238.734468:0:84986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144238.734482:0:84986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047051 expref: -99 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.734507:0:84986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047051 expref: 11 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.734518:0:84986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047051 expref: 11 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.734528:0:84986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7c00, rc 0) 00000100:00100000:0.0:1783144238.734578:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac5dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501248128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.734595:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783144238.734794:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.734810:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.734820:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.734869:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.734902:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.734935:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.734968:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248256 00000100:00100000:2.0:1783144238.734973:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248256 00000100:00100000:2.0:1783144238.735008:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783144238.735014:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501248256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783144238.735029:0:84988:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783144238.735045:0:84988:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783144238.735048:0:84988:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 104 00000100:00100000:2.0:1783144238.735165:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501248256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.735169:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.735177:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 10000000:01000000:1.0:1783144238.735221:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783144238.735228:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.735237:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144238.735247:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144238.735250:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 52 10000000:01000000:1.0:1783144238.735253:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144238.735271:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.735279:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.735297:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.735309:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.735334:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.735359:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.735406:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248384 00000100:00100000:2.0:1783144238.735409:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248384 00000100:00100000:2.0:1783144238.735437:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783144238.735442:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501248384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144238.735447:0:84991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144238.735455:0:84991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98ec00/0xad8e53a423047066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304705f expref: -99 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.735465:0:84991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98ec00/0xad8e53a423047066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304705f expref: 12 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.735471:0:84991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98ec00/0xad8e53a423047066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304705f expref: 12 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.735480:0:84991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ec00, rc 0) 00000100:00100000:2.0:1783144238.735505:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501248384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.735509:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783144238.735561:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.735569:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.735575:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.735617:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.735633:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.735975:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.736262:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248512 00000100:00100000:2.0:1783144238.736267:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248512 00000100:00100000:2.0:1783144238.736303:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783144238.736311:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501248512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.736455:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501248512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.736463:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783144238.736711:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.736773:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.736818:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.736847:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.736926:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248640 00000100:00100000:2.0:1783144238.736930:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248640 00000100:00100000:2.0:1783144238.736952:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783144238.736957:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501248640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.737022:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501248640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.737026:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783144238.737201:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144238.738185:0:85092:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783144238.738391:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783144238.738422:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144238.738433:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.738442:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144238.738451:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783144238.738453:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2ac91e0000 from 101 10000000:01000000:3.0:1783144238.738456:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144238.738486:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.738495:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.738504:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.738519:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.738556:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.738590:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca1cf900 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.738941:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248768 00000100:00100000:2.0:1783144238.738947:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248768 00000100:00100000:2.0:1783144238.738988:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783144238.738996:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501248768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144238.739011:0:84992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144238.739023:0:84992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98ea00/0xad8e53a423047074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304706d expref: -99 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.739058:0:84992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98ea00/0xad8e53a423047074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304706d expref: 13 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.739067:0:84992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98ea00/0xad8e53a423047074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304706d expref: 13 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.739074:0:84992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ea00, rc 0) 00000100:00100000:2.0:1783144238.739120:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501248768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.739127:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783144238.739239:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144238.739255:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.739264:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.739309:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.739345:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.739374:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca1cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.739425:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501248896 00000100:00100000:0.0:1783144238.739429:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501248896 00000100:00100000:0.0:1783144238.739466:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783144238.739475:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501248896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783144238.739491:0:84986:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783144238.739508:0:84986:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783144238.739512:0:84986:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783144238.739515:0:84986:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783144238.739518:0:84986:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783144238.739521:0:84986:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:0.0:1783144238.739708:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501248896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 233us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.739716:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783144238.739832:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501248896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783144238.739906:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144238.739913:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.739921:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144238.739928:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783144238.739930:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783144238.739932:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783144238.739946:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.739952:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.739959:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.739971:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.739995:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.740016:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa834e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.740076:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249024 00000100:00100000:1.0:1783144238.740081:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249024 00000100:00100000:1.0:1783144238.740113:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783144238.740121:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501249024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.740136:0:84988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.740147:0:84988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150a00/0xad8e53a423047082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304707b expref: -99 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.740162:0:84988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150a00/0xad8e53a423047082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304707b expref: 14 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.740170:0:84988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150a00/0xad8e53a423047082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304707b expref: 14 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.740177:0:84988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150a00, rc 0) 00000100:00100000:1.0:1783144238.740212:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501249024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.740218:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783144238.740318:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144238.740329:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047082 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.740346:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047082 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.740391:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.740414:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.740480:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa834e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.740514:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249152 00000100:00100000:2.0:1783144238.740518:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249152 00000100:00100000:2.0:1783144238.740549:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783144238.740556:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501249152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.740802:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501249152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.740809:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783144238.740897:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.740926:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.740963:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.741025:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa834e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.741061:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249280 00000100:00100000:0.0:1783144238.741065:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249280 00000100:00100000:0.0:1783144238.741123:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783144238.741131:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501249280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.741807:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501249280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 675us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.741814:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783144238.741938:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144238.742982:0:85093:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1783144238.743178:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1783144238.743201:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783144238.743211:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047082 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.743221:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047082 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144238.743229:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783144238.743232:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2ac91e0000 from 1 10000000:01000000:2.0:1783144238.743244:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783144238.743272:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.743280:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.743288:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144238.743305:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.743348:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.743526:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.743583:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249408 00000100:00100000:1.0:1783144238.743589:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249408 00000100:00100000:1.0:1783144238.743634:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783144238.743643:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501249408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.743654:0:84988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.743664:0:84988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150000/0xad8e53a423047090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047089 expref: -99 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.743684:0:84988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150000/0xad8e53a423047090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047089 expref: 15 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.743694:0:84988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150000/0xad8e53a423047090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047089 expref: 15 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.743702:0:84988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150000, rc 0) 00000100:00100000:1.0:1783144238.743767:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501249408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.743774:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783144238.743849:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144238.743862:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047090 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.743871:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047090 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144238.743885:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783144238.743888:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047090 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.743896:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047090 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144238.743903:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783144238.743904:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2ac91e0000 from 7 10000000:01000000:2.0:1783144238.743907:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783144238.743927:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.743934:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.743941:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144238.743953:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.743978:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.744017:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.744115:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249536 00000100:00100000:1.0:1783144238.744119:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249536 00000100:00100000:1.0:1783144238.744149:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783144238.744157:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c46c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501249536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.744164:0:84992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.744174:0:84992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150c00/0xad8e53a42304709e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047097 expref: -99 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.744187:0:84992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150c00/0xad8e53a42304709e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047097 expref: 16 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.744195:0:84992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150c00/0xad8e53a42304709e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047097 expref: 16 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.744201:0:84992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150c00, rc 0) 00000100:00100000:1.0:1783144238.744228:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c46c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501249536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.744234:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783144238.744300:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144238.744310:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304709e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.744316:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304709e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144238.744360:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.744385:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.744407:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.744456:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249664 00000100:00100000:1.0:1783144238.744460:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249664 00000100:00100000:1.0:1783144238.744491:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783144238.744498:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501249664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.744611:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa82b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501249664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.744617:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783144238.744692:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.744925:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.744968:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.744993:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.745015:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249792 00000100:00100000:2.0:1783144238.745025:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249792 00000100:00100000:2.0:1783144238.745056:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783144238.745063:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501249792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.745144:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501249792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.745151:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783144238.745242:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144238.746148:0:85094:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783144238.746311:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783144238.746335:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783144238.746344:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304709e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.746354:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304709e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144238.746362:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144238.746365:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 52 10000000:01000000:2.0:1783144238.746368:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144238.746391:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.746399:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.746408:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144238.746424:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.746459:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.746492:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.746550:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501249920 00000100:00100000:1.0:1783144238.746555:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501249920 00000100:00100000:1.0:1783144238.746595:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783144238.746602:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501249920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.746612:0:84992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.746622:0:84992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150600/0xad8e53a4230470ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230470a5 expref: -99 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.746641:0:84992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150600/0xad8e53a4230470ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230470a5 expref: 17 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.746650:0:84992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150600/0xad8e53a4230470ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230470a5 expref: 17 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.746658:0:84992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150600, rc 0) 00000100:00100000:1.0:1783144238.746767:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501249920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.746774:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783144238.746944:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501249920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144238.746957:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.746965:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230470ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144238.747008:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.747031:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.747082:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144238.747112:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250048 00000100:00100000:3.0:1783144238.747116:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250048 00000100:00100000:3.0:1783144238.747173:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783144238.747180:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501250048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.747284:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501250048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144238.747291:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783144238.747354:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.747383:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.747420:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144238.747442:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f97480 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.747458:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250176 00000100:00100000:1.0:1783144238.747463:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250176 00000100:00100000:1.0:1783144238.747491:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783144238.747498:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501250176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.747578:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501250176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.747585:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783144238.747656:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144238.748501:0:85095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783144238.748642:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783144238.748661:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144238.748669:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.748687:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144238.748695:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783144238.748697:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783144238.748700:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783144238.749055:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.749064:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.749074:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.749089:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.749176:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.749235:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.749269:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250304 00000100:00100000:1.0:1783144238.749274:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250304 00000100:00100000:1.0:1783144238.749333:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783144238.749341:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501250304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.749357:0:84992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.749367:0:84992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02151200/0xad8e53a4230470ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230470b3 expref: -99 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.749386:0:84992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02151200/0xad8e53a4230470ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230470b3 expref: 18 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.749395:0:84992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02151200/0xad8e53a4230470ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230470b3 expref: 18 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.749402:0:84992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151200, rc 0) 00000100:00100000:1.0:1783144238.749434:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501250304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.749443:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783144238.749603:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144238.749614:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.749622:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230470ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.749666:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.749689:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.749906:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.749932:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250432 00000100:00100000:2.0:1783144238.749936:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250432 00000100:00100000:2.0:1783144238.749994:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783144238.750002:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501250432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.750119:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501250432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.750125:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783144238.750187:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.750211:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.750245:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.750258:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.753449:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250560 00000100:00100000:0.0:1783144238.753472:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250560 00000100:00100000:0.0:1783144238.753531:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783144238.753542:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501250560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.754230:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501250560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 689us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.754240:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783144238.754262:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144238.755325:0:85097:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783144238.755407:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783144238.755443:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783144238.755457:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.755470:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144238.755480:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144238.755482:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2b017f2000 from 7 10000000:01000000:3.0:1783144238.755485:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144238.755520:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.755528:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.755537:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.755558:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.755608:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144238.755659:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250688 00000100:00100000:3.0:1783144238.755662:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.755665:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250688 00000100:00100000:0.0:1783144238.755708:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783144238.755754:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501250688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144238.755767:0:84987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144238.755781:0:84987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7000/0xad8e53a4230470c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230470c1 expref: -99 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.755805:0:84987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7000/0xad8e53a4230470c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230470c1 expref: 19 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.755816:0:84987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7000/0xad8e53a4230470c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230470c1 expref: 19 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.755826:0:84987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7000, rc 0) 00000100:00100000:0.0:1783144238.756413:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501250688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 693us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.756423:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783144238.756540:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144238.756556:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.756573:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230470c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.756626:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.756659:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.756687:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.756697:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250816 00000100:00100000:0.0:1783144238.756703:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250816 00000100:00100000:0.0:1783144238.756763:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783144238.756771:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501250816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.756941:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501250816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.756950:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783144238.757105:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.757136:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.757173:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.757235:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.757417:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501250944 00000100:00100000:0.0:1783144238.757421:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501250944 00000100:00100000:0.0:1783144238.757445:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783144238.757451:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501250944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.757559:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501250944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.757567:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783144238.757625:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501250944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144238.760516:0:85098:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783144238.761024:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783144238.761057:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783144238.761071:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.761087:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144238.761109:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144238.761112:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 52 10000000:01000000:1.0:1783144238.761115:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144238.761158:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.761167:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.761177:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.761201:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.761272:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.761320:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.761368:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251072 00000100:00100000:2.0:1783144238.761375:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251072 00000100:00100000:2.0:1783144238.761429:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783144238.761439:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501251072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144238.761452:0:84991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144238.761465:0:84991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98ee00/0xad8e53a4230470d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230470cf expref: -99 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.761778:0:84991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98ee00/0xad8e53a4230470d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230470cf expref: 20 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.761788:0:84991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98ee00/0xad8e53a4230470d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230470cf expref: 20 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.761798:0:84991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ee00, rc 0) 00000100:00100000:2.0:1783144238.761842:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501251072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 404us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.761851:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783144238.761944:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.761959:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.761969:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230470d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.762034:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.762064:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.762095:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.762108:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251200 00000100:00100000:1.0:1783144238.762111:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251200 00000100:00100000:1.0:1783144238.762148:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783144238.762155:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501251200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.762266:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501251200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.762273:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783144238.762302:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.762332:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.762372:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.762389:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.762402:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251328 00000100:00100000:1.0:1783144238.762405:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251328 00000100:00100000:1.0:1783144238.762426:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783144238.762432:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501251328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.762511:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501251328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.762518:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783144238.762560:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144238.763270:0:85100:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783144238.763325:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783144238.763345:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144238.763353:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.763364:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144238.763384:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783144238.763387:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783144238.763390:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783144238.763412:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.763421:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.763430:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.763445:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.763479:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.763502:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.763515:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251456 00000100:00100000:1.0:1783144238.763519:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251456 00000100:00100000:1.0:1783144238.763545:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783144238.763553:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501251456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.763561:0:84987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.763571:0:84987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150e00/0xad8e53a4230470e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230470dd expref: -99 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.763587:0:84987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150e00/0xad8e53a4230470e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230470dd expref: 21 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.763597:0:84987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150e00/0xad8e53a4230470e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230470dd expref: 21 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.763616:0:84987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150e00, rc 0) 00000100:00100000:1.0:1783144238.763651:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501251456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.763659:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783144238.763698:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.763710:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.763719:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230470e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.763795:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.763819:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.763837:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.763848:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251584 00000100:00100000:1.0:1783144238.763851:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251584 00000100:00100000:1.0:1783144238.763872:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783144238.763879:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501251584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.763985:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501251584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.763991:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783144238.764021:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.764045:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.764078:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.764096:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01574540 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.764107:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251712 00000100:00100000:1.0:1783144238.764110:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251712 00000100:00100000:1.0:1783144238.764130:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783144238.764136:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501251712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.765392:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501251712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1251us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.765403:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783144238.765476:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144238.766694:0:85101:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783144238.767116:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783144238.767148:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783144238.767161:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.767174:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144238.767185:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783144238.767188:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2afaac8800 from 7 10000000:01000000:2.0:1783144238.767191:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783144238.767231:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.767240:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144238.767263:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144238.767288:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.767346:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144238.767531:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9e260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.767566:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251840 00000100:00100000:1.0:1783144238.767572:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251840 00000100:00100000:1.0:1783144238.767653:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783144238.767663:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501251840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.767685:0:84988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.767698:0:84988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee6d9e00/0xad8e53a4230470f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230470eb expref: -99 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.767756:0:84988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee6d9e00/0xad8e53a4230470f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230470eb expref: 22 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.767768:0:84988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee6d9e00/0xad8e53a4230470f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230470eb expref: 22 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.767776:0:84988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee6d9e00, rc 0) 00000100:00100000:1.0:1783144238.767830:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501251840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.767837:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783144238.767927:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144238.767942:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.767951:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230470f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144238.768001:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.768043:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144238.768980:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac92340c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144238.770471:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501251968 00000100:00100000:2.0:1783144238.770484:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501251968 00000100:00100000:2.0:1783144238.770539:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783144238.770548:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501251968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144238.770704:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501251968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144238.770712:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783144238.771758:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501251968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.771814:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.771862:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144238.771888:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac92340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.771915:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252096 00000100:00100000:0.0:1783144238.771919:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252096 00000100:00100000:0.0:1783144238.771949:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783144238.771956:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501252096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144238.772413:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501252096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 455us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.772421:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783144238.772462:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144238.774356:0:85103:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783144238.779101:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783144238.779146:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783144238.779160:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.779180:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230470f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144238.779190:0:6518:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1783144238.779193:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9c2ac6dd99c0 from 1 10000000:01000000:1.0:1783144238.779195:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783144238.779234:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.779243:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.779843:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144238.779873:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.779937:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144238.780025:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01574d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.781874:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252224 00000100:00100000:0.0:1783144238.781886:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252224 00000100:00100000:0.0:1783144238.781984:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783144238.781995:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501252224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144238.782021:0:84992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144238.782037:0:84992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f6800/0xad8e53a423047100 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230470f9 expref: -99 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.782063:0:84992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f6800/0xad8e53a423047100 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230470f9 expref: 23 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.782075:0:84992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f6800/0xad8e53a423047100 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230470f9 expref: 23 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144238.782083:0:84992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6800, rc 0) 00000100:00100000:0.0:1783144238.782144:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501252224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144238.782152:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783144238.782188:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144238.782207:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047100 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.782217:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047100 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144238.782236:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783144238.782241:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047100 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.782248:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047100 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144238.782256:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783144238.782258:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:3.0:1783144238.782261:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783144238.782283:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.782297:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.782306:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.782325:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.782359:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.785896:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99180 going to sleep for 11 seconds 00000100:00100000:1.0:1783144238.785908:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252352 00000100:00100000:1.0:1783144238.785918:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252352 00000100:00100000:1.0:1783144238.785977:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783144238.785988:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501252352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144238.786006:0:84987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144238.786025:0:84987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee6d8400/0xad8e53a42304710e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047107 expref: -99 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.786053:0:84987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee6d8400/0xad8e53a42304710e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047107 expref: 24 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.786078:0:84987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee6d8400/0xad8e53a42304710e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047107 expref: 24 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144238.786143:0:84987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee6d8400, rc 0) 00000100:00100000:1.0:1783144238.786212:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501252352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144238.786220:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783144238.786263:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144238.786283:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304710e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.786293:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304710e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144238.786368:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144238.786404:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144238.786428:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144238.786530:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252480 00000100:00100000:0.0:1783144238.786536:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252480 00000100:00100000:0.0:1783144238.786574:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783144238.786639:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501252480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144238.786883:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501252480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (478us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783144238.786892:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783144238.786927:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501252480:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783144238.786960:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783144238.786966:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304710e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144238.786974:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304710e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144239.055050:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783144239.887123:0:85264:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783144240.078644:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783144240.353524:0:85316:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783144240.353815:0:85316:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1783144240.790797:0:85366:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783144240.790948:0:85366:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783144241.102261:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144241.250477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144241.250523:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144241.250548:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144241.250579:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144241.250648:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481639936 00000100:00100000:3.0:1783144241.250658:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481639936 00000100:00100000:2.0:1783144241.250684:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481639680 00000100:00100000:2.0:1783144241.250690:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481639680 00000100:00100000:1.0:1783144241.250752:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481639808 00000100:00100000:1.0:1783144241.250757:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481639808 00000100:00100000:1.0:1783144241.250788:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 988 00000100:00100000:1.0:1783144241.250797:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481639808:12345-192.168.203.4@tcp:38:kworker.0 00010000:00080000:1.0:1783144241.250827:0:81077:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'cace81e7-a6f2-4d37-b197-caf34583781c' at ffff9c2aef586000, cookie 0xad8e53a423046f9b 00010000:00080000:1.0:1783144241.250833:0:81077:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp recovering/t94489280514 exp ffff9c2aef586000 cur 2775 last 1783144237 00010000:02000400:1.0:1783144241.250842:0:81077:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1783144241.250847:0:81077:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783144241.250872:0:81077:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783144241.250878:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:2.0:1783144241.250897:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2405:x1869759481639680:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:2.0:1783144241.250905:0:84986:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:2.0:1783144241.250980:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2405:x1869759481639680:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 92us (511us total) trans 0 rc -107/-107 00000100:00080000:1.0:1783144241.251011:0:81077:0:(import.c:65:import_set_state_nolock()) ffff9c2af728e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144241.251013:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:1.0:1783144241.251055:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481639808:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 257us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144241.251069:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 710 00000100:00100000:1.0:1783144241.251083:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 988 00000100:00100000:3.0:1783144241.251084:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481639936:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144241.251127:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481639936:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144241.251134:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 710 00000100:00080000:3.0:1783144241.251156:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144241.251355:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144241.251365:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640064 00000100:00100000:1.0:1783144241.251371:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640064 00000100:00080000:0.0:1783144241.251403:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144241.251418:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640192 00000100:00100000:1.0:1783144241.251422:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640192 00000100:00100000:3.0:1783144241.251427:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4915 00000100:00100000:3.0:1783144241.251440:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cace81e7-a6f2-4d37-b197-caf34583781c+5:2402:x1869759481640064:12345-192.168.203.4@tcp:9:kworker.0 00000100:00080000:0.0:1783144241.251444:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1783144241.251459:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046e05 00000100:00100000:1.0:1783144241.251461:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4916 00000100:00080000:3.0:1783144241.251470:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9c29c235f800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783144241.251475:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cace81e7-a6f2-4d37-b197-caf34583781c+5:2402:x1869759481640192:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1783144241.251490:0:26142:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046951 00000100:00080000:1.0:1783144241.251496:0:26142:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783144241.251690:0:26144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968822 00010000:00010000:0.0:1783144241.251753:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783144241.251791:0:26142:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968822 00010000:00010000:2.0:1783144241.251828:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144241.251900:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cace81e7-a6f2-4d37-b197-caf34583781c+2:2402:x1869759481640192:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 429us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144241.251908:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4916 00000100:00100000:3.0:1783144241.253058:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cace81e7-a6f2-4d37-b197-caf34583781c+2:2402:x1869759481640064:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 1619us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144241.253065:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4915 00000100:00100000:2.0:1783144241.257861:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144241.257991:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481634944 00000100:00100000:0.0:1783144241.258128:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481634944 00000100:00100000:0.0:1783144241.258188:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 989 00000100:00100000:0.0:1783144241.258199:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481634944:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00080000:0.0:1783144241.258214:0:66143:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280514, current: 94489280514, replaying 00000100:00100000:0.0:1783144241.258407:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481634944:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 209us (553us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144241.258415:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 989 00010000:00080000:1.0:1783144241.258423:0:85014:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1783144241.265177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144241.265364:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640320 00000100:00100000:1.0:1783144241.265373:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640320 00000100:00100000:1.0:1783144241.265420:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:1.0:1783144241.265428:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1869759481640320:12345-192.168.203.4@tcp:250:ptlrpcd_01_00.0 00010000:00080000:1.0:1783144241.265453:0:84987:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12@192.168.203.4@tcp t0 exp 0000000000000000 cur 2775 last 0 00000020:00000080:1.0:1783144241.265480:0:84987:0:(genops.c:1406:class_connect()) connect: client 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12, cookie 0xad8e53a423047115 00000100:00080000:1.0:1783144241.265604:0:84987:0:(import.c:65:import_set_state_nolock()) ffff9c2af728e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144241.265673:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:2402:x1869759481640320:12345-192.168.203.4@tcp:250:ptlrpcd_01_00.0 Request processed in 244us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144241.265681:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00010000:00010000:2.0:1783144242.126162:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144242.702008:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783144242.702030:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501252608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144242.702116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144242.702203:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252608 00000100:00100000:2.0:1783144242.702211:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252608 00000100:00100000:2.0:1783144242.702306:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3680 00000100:00100000:2.0:1783144242.702317:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501252608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783144242.702349:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144242.702399:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501252608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144242.702407:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000100:00080000:3.0:1783144242.702521:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144242.702526:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144242.702529:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144242.702537:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144242.702555:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2addaad500 x1869759501252864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144242.702584:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144242.702601:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144242.702603:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144242.702608:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144242.702621:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ac7da5c00 x1869759501253120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144242.702635:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144242.702639:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144242.702640:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144242.702645:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144242.702655:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ac7da4a80 x1869759501253376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144242.702673:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144242.702676:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144242.702678:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144242.702682:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144242.702691:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ac7da6300 x1869759501253760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144242.702739:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783144242.702743:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144242.702745:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2aee190000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144242.702750:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2aee190000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144242.702761:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ac7da7b80 x1869759501254144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144242.702796:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501253248:0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.702821:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501252992:0@lo:400:kworker.0 00000100:00100000:3.0:1783144242.702838:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144242.702878:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501254016:0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.702885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144242.702907:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501252736:0@lo:400:kworker.0 00000100:00100000:3.0:1783144242.702911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144242.702917:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501253888:0@lo:400:kworker.0 00000100:00100000:3.0:1783144242.702955:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254016 00000100:00100000:0.0:1783144242.702959:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144242.702960:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144242.702961:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254016 00000100:00100000:2.0:1783144242.702993:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501252864:0@lo:38:kworker.0 00000100:00100000:3.0:1783144242.703009:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501253888 00000100:00100000:1.0:1783144242.703017:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252736 00000100:00100000:0.0:1783144242.703021:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501253632:0@lo:400:kworker.0 00000100:00100000:2.0:1783144242.703023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144242.703023:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252736 00000100:00100000:3.0:1783144242.703026:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501253888 00000100:00100000:2.0:1783144242.703046:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501253120:0@lo:38:kworker.0 00000100:00100000:0.0:1783144242.703054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144242.703064:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501253632 00000100:00100000:3.0:1783144242.703068:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501253632 00000100:00100000:1.0:1783144242.703081:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783144242.703093:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501252736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144242.703098:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501252608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144242.703100:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1783144242.703112:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501254016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144242.703121:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783144242.703127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144242.703130:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501253504:0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.703143:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501252736:12345-0@lo:400:kworker.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.703151:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783144242.703154:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501253376:0@lo:38:kworker.0 00000100:00100000:0.0:1783144242.703163:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144242.703172:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501254016:12345-0@lo:400:kworker.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144242.703181:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1783144242.703187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144242.703191:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501252736:0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.703194:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501253248 00000100:00100000:3.0:1783144242.703200:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501253504 00000100:00100000:1.0:1783144242.703200:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501253248 00000100:00100000:3.0:1783144242.703207:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501253504 00000100:00100000:2.0:1783144242.703207:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501253760:0@lo:38:kworker.0 00000100:00100000:0.0:1783144242.703222:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:0.0:1783144242.703233:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501253888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.703234:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252992 00000100:00100000:2.0:1783144242.703238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144242.703240:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252992 00000100:00100000:3.0:1783144242.703245:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:3.0:1783144242.703256:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501253632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144242.703263:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501254144:0@lo:38:kworker.0 00000100:00100000:1.0:1783144242.703267:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501252864 00000100:00100000:1.0:1783144242.703272:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501252864 00000100:00100000:0.0:1783144242.703277:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501253888:12345-0@lo:400:kworker.0 Request processed in 46us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144242.703286:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1783144242.703291:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501253120 00000100:00100000:1.0:1783144242.703295:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501253120 00000100:00100000:2.0:1783144242.703300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144242.703306:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:3.0:1783144242.703312:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501253632:12345-0@lo:400:kworker.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.703314:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501253760 00000100:00100000:0.0:1783144242.703319:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501253504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.703320:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501253760 00000100:00100000:3.0:1783144242.703325:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1783144242.703337:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254144 00000100:00100000:1.0:1783144242.703342:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1783144242.703344:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254144 00000100:00100000:1.0:1783144242.703353:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501253248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783144242.703354:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144242.703361:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144242.703362:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501253504:12345-0@lo:400:kworker.0 Request processed in 46us (198us total) trans 0 rc 0/0 00000100:00080000:3.0:1783144242.703365:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144242.703365:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1783144242.703372:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1783144242.703379:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501252992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144242.703394:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501253504:0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.703402:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501253248:12345-0@lo:400:kworker.0 Request processed in 51us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.703411:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1783144242.703414:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501253632:0@lo:400:kworker.0 00000100:00100000:0.0:1783144242.703420:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1783144242.703424:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501252992:12345-0@lo:400:kworker.0 Request processed in 46us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144242.703429:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501252864:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144242.703430:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1783144242.703442:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1783144242.703448:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501253120:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783144242.703450:0:66143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000100:00100000:3.0:1783144242.703458:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501253248:0@lo:400:kworker.0 00000100:00100000:2.0:1783144242.703458:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1783144242.703464:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501253760:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783144242.703469:0:81077:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000100:00100000:3.0:1783144242.703485:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501254016:0@lo:400:kworker.0 00010000:00080000:2.0:1783144242.703485:0:66114:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:0.0:1783144242.703489:0:66143:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad8e53a42304711c 00000004:00100000:0.0:1783144242.703505:0:66143:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:1.0:1783144242.703512:0:81077:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad8e53a423047123 00000020:00000080:2.0:1783144242.703521:0:66114:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad8e53a42304712a 00000004:00100000:1.0:1783144242.703524:0:81077:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00100000:2.0:1783144242.703530:0:66114:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783144242.703541:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1783144242.703549:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501254144:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1783144242.703555:0:81077:0:(import.c:65:import_set_state_nolock()) ffff9c2af728f800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783144242.703556:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2affddf800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1783144242.703568:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:3.0:1783144242.703596:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad8e53a423047131 00000004:00100000:3.0:1783144242.703610:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783144242.703612:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869759501253760:12345-0@lo:38:kworker.0 Request processed in 145us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.703616:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869759501253120:12345-0@lo:38:kworker.0 Request processed in 165us (487us total) trans 0 rc 0/0 00000100:00080000:3.0:1783144242.703628:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144242.703628:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1783144242.703659:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501254144:12345-0@lo:38:kworker.0 Request processed in 111us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144242.704029:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501253376 00000100:00100000:2.0:1783144242.704034:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501253376 00000100:00100000:2.0:1783144242.704055:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:2.0:1783144242.704060:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501253376:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783144242.704253:0:78024:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2aef583800, cookie 0xad8e53a423046fa2 00010000:00080000:2.0:1783144242.704258:0:78024:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c2aef583800 cur 2777 last 1783144237 00000004:00100000:2.0:1783144242.704267:0:78024:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783144242.704283:0:78024:0:(import.c:65:import_set_state_nolock()) ffff9c2affddf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144242.704321:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501253376:12345-0@lo:38:kworker.0 Request processed in 259us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144242.704328:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00010000:00080000:2.0:1783144242.704361:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2ac7da5c00 x1869759501253120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144242.704374:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 23 00000100:00100000:1.0:1783144242.704487:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00010000:00080000:1.0:1783144242.704503:0:85014:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783144242.704507:0:85014:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 94489280514 00000020:00080000:1.0:1783144242.704512:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.704515:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280514, next_transno: 94489280514 00010000:00080000:1.0:1783144242.704519:0:85014:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280514) 00000020:00080000:1.0:1783144242.704521:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.704530:0:85014:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481634944 t94489280514 from 192.168.203.4@tcp req@ffff9c2af9d85880 x1869759481634944/t0(94489280514) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:352/0 lens 528/0 e 0 to 0 dl 1783144252 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144242.704657:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501252992:0@lo:400:kworker.0 00000100:00100000:1.0:1783144242.704664:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501253888:0@lo:400:kworker.0 00000100:00100000:3.0:1783144242.704832:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00080000:0.0:1783144242.704909:0:66143:0:(import.c:65:import_set_state_nolock()) ffff9c2af5dda000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144242.704946:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501252864:12345-0@lo:38:kworker.0 Request processed in 1516us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144242.704960:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000004:00080000:0.0:1783144242.705044:0:85014:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 471us 00000100:00080000:2.0:1783144242.705615:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2ac7da5c00 x1869759501253120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144267 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144242.705624:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783144242.705689:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144242.705695:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783144242.705700:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501253120:0@lo:38:kworker.0 00000100:00080000:2.0:1783144242.705750:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 23 00000100:00080000:2.0:1783144242.705758:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783144242.705761:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1783144242.705764:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00080000:2.0:1783144242.705768:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2af7208000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:2.0:1783144242.705771:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1783144242.706107:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501253376:0@lo:38:kworker.0 00010000:00080000:3.0:1783144242.706125:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2ac7da6300 x1869759501253760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144242.706136:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 23 00000100:00080000:3.0:1783144242.706929:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2ac7da6300 x1869759501253760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144267 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144242.706937:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783144242.706940:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783144242.706943:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783144242.706949:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501253760:0@lo:38:kworker.0 00010000:00080000:3.0:1783144242.706970:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2ac7da7b80 x1869759501254144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144242.706979:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 23 00000100:00080000:3.0:1783144242.706991:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783144242.706995:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783144242.706997:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aee190000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783144242.707002:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501254144:0@lo:38:kworker.0 00010000:00080000:3.0:1783144242.708547:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2addaad500 x1869759501252864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144242.708562:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 23 00010000:00080000:2.0:1783144242.709157:0:85380:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1783144242.709162:0:85380:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1783144242.709167:0:85380:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1783144242.710069:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2addaad500 x1869759501252864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144267 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144242.710076:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783144242.710080:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783144242.710082:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783144242.710086:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501252864:0@lo:38:kworker.0 00000100:00080000:2.0:1783144242.710264:0:85380:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1783144242.710333:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501254272:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783144242.710395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144242.710440:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254272 00000100:00100000:2.0:1783144242.710446:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254272 00000100:00100000:2.0:1783144242.710498:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:2.0:1783144242.710507:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501254272:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783144242.710526:0:8446:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2ac7da7b80 x1869759501254272/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:353/0 lens 224/0 e 0 to 0 dl 1783144253 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144242.710536:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501254272:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (142us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144242.710544:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00010000:00010000:1.0:1783144242.711664:0:85014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.711682:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.711697:0:85014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.711753:0:85014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.711773:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.711781:0:85014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712158:0:85014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712179:0:85014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712187:0:85014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712198:0:85014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144242.712202:0:85014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712210:0:85014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712236:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e300) 00010000:00010000:1.0:1783144242.712240:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144242.712244:0:85014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712252:0:85014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9a00/0xad8e53a423047138 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144242.712269:0:85014:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009880dbc1 reply state 00000000a05b67d2 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712286:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.712293:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ee00) 00010000:00010000:1.0:1783144242.712295:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144242.712298:0:85014:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783144242.712387:0:85014:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783144242.712409:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.712413:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000020:00080000:1.0:1783144242.712417:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.712419:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000100:00100000:2.0:1783144242.714109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144242.714172:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635456 00000100:00100000:0.0:1783144242.714179:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635456 00000100:00100000:0.0:1783144242.714259:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 994 00000100:00100000:0.0:1783144242.714268:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481635456:12345-192.168.203.4@tcp:36:rm.0 00010000:00080000:0.0:1783144242.714282:0:66114:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280515, current: 94489280515, replaying 00000100:00100000:0.0:1783144242.714299:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481635456:12345-192.168.203.4@tcp:36:rm.0 Request processed in 33us (194us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144242.714305:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 994 00000020:00080000:1.0:1783144242.714336:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.714339:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280515, next_transno: 94489280515 00010000:00080000:1.0:1783144242.714343:0:85014:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280515) 00000020:00080000:1.0:1783144242.714346:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.714354:0:85014:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481635456 t94489280515 from 192.168.203.4@tcp req@ffff9c2af9f1e680 x1869759481635456/t0(94489280515) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:353/0 lens 512/0 e 0 to 0 dl 1783144253 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783144242.714413:0:85014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714425:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714433:0:85014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714441:0:85014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714460:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714466:0:85014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714521:0:85014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714530:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714537:0:85014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714747:0:85014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714755:0:85014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714762:0:85014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714768:0:85014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144242.714772:0:85014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714780:0:85014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714791:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2aee58e700) 00010000:00010000:1.0:1783144242.714800:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783144242.714805:0:85014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714811:0:85014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8e00/0xad8e53a423047154 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714834:0:85014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714840:0:85014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714846:0:85014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714851:0:85014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144242.714854:0:85014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714860:0:85014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783144242.714869:0:84981:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280514 is committed 00010000:00010000:1.0:1783144242.714869:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e200) 00010000:00010000:1.0:1783144242.714875:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144242.714878:0:85014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.714883:0:85014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9200/0xad8e53a423047146 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144242.714892:0:85014:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ee4bf8b reply state 0000000005700fad transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.714911:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.714922:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.714929:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.715134:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.715144:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144242.715144:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ee00) 00010000:00010000:1.0:1783144242.715147:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144242.715150:0:85014:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144242.715157:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.715177:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.715189:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58ee00) 00010000:00010000:3.0:1783144242.715193:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144242.715197:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.715202:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8000/0xad8e53a42304713f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1783144242.715216:0:85014:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783144242.715230:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.715233:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000020:00080000:1.0:1783144242.715236:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.715238:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000100:00100000:1.0:1783144242.716537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144242.716599:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481635968 00000100:00100000:2.0:1783144242.716606:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481635968 00000100:00100000:2.0:1783144242.716655:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 995 00000100:00100000:2.0:1783144242.716665:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481635968:12345-192.168.203.4@tcp:101:lfs.0 00010000:00080000:2.0:1783144242.716678:0:81077:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280516, current: 94489280516, replaying 00000100:00100000:2.0:1783144242.716694:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481635968:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 32us (162us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144242.716700:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 995 00000020:00080000:1.0:1783144242.717306:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.717311:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280516, next_transno: 94489280516 00010000:00080000:1.0:1783144242.717315:0:85014:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280516) 00000020:00080000:1.0:1783144242.717318:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.717328:0:85014:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481635968 t94489280516 from 192.168.203.4@tcp req@ffff9c2aef484a80 x1869759481635968/t0(94489280516) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:353/0 lens 536/0 e 0 to 0 dl 1783144253 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783144242.717348:0:85014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144242.717367:0:85014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a42304715b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41985 expref: -99 pid: 85014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.717498:0:85014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.717520:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.717539:0:85014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.717553:0:85014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.717560:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.717566:0:85014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144242.717972:0:85014:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:1.0:1783144242.717988:0:85014:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0xad8e53a423046efa 00000004:00080000:1.0:1783144242.717990:0:85014:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xad8e53a423046efa in new mfd 00010000:00010000:1.0:1783144242.717998:0:85014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718004:0:85014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718010:0:85014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718015:0:85014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144242.718019:0:85014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718026:0:85014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718046:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:1.0:1783144242.718048:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144242.718063:0:85014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718070:0:85014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a423047162 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144242.718082:0:85014:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000cce0256 reply state 00000000e334fdc5 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718092:0:85014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718098:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c2aee58ef00) 00010000:00010000:1.0:1783144242.718101:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144242.718103:0:85014:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144242.718134:0:85014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a42304715b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 10 pid: 85014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718144:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:1.0:1783144242.718146:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144242.718149:0:85014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a42304715b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41985 expref: 10 pid: 85014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.718162:0:85014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee6d9c00, rc 0) 00010000:00080000:1.0:1783144242.718220:0:85014:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783144242.718235:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.718238:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000020:00080000:1.0:1783144242.718246:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.718247:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000100:00100000:2.0:1783144242.723933:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144242.723983:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640576 00000100:00100000:3.0:1783144242.723993:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640576 00000100:00100000:3.0:1783144242.724048:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:3.0:1783144242.724057:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:42333:x1869759481640576:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144242.724080:0:84988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144242.724097:0:84988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043e000/0xad8e53a423047177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4199a expref: -99 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.724122:0:84988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043e000/0xad8e53a423047177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4199a expref: 6 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.724131:0:84988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043e000/0xad8e53a423047177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4199a expref: 6 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.724139:0:84988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043e000, rc 0) 00000100:00100000:3.0:1783144242.724195:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481640576:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 139us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144242.724213:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:3.0:1783144242.725826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144242.725932:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640704 00000100:00100000:0.0:1783144242.725939:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640704 00000100:00100000:1.0:1783144242.726003:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1783144242.726014:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481640704:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783144242.726033:0:84991:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1783144242.726051:0:84991:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783144242.726055:0:84991:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783144242.726057:0:84991:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783144242.726060:0:84991:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783144242.726062:0:84991:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:1.0:1783144242.727602:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481640704:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 Request processed in 1585us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.727613:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1783144242.729653:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144242.729764:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640832 00000100:00100000:3.0:1783144242.729774:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640832 00000100:00100000:3.0:1783144242.729822:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1783144242.729831:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481640832:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144242.729844:0:84986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144242.729859:0:84986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043f600/0xad8e53a42304717e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419a1 expref: -99 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.729884:0:84986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043f600/0xad8e53a42304717e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419a1 expref: 7 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.729895:0:84986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043f600/0xad8e53a42304717e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419a1 expref: 7 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.729903:0:84986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043f600, rc 0) 00000100:00100000:3.0:1783144242.729943:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481640832:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144242.729951:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1783144242.734106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144242.734244:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640960 00000100:00100000:1.0:1783144242.734263:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640960 00000100:00100000:1.0:1783144242.734316:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1783144242.734330:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481640960:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144242.734519:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481640960:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 194us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.734527:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1783144242.736811:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144242.736864:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636224 00000100:00100000:3.0:1783144242.736872:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636224 00000100:00100000:0.0:1783144242.736934:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 996 00000100:00100000:0.0:1783144242.736946:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481636224:12345-192.168.203.4@tcp:101:lfs.0 00010000:00080000:0.0:1783144242.736965:0:66143:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280517, current: 94489280517, replaying 00000100:00100000:0.0:1783144242.736980:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481636224:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 38us (174us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144242.736987:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 996 00000100:00100000:2.0:1783144242.737085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00080000:1.0:1783144242.737146:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.737151:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280517, next_transno: 94489280517 00010000:00080000:1.0:1783144242.737155:0:85014:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280517) 00000020:00080000:1.0:1783144242.737158:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.737175:0:85014:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481636224 t94489280517 from 192.168.203.4@tcp req@ffff9c29ceada300 x1869759481636224/t0(94489280517) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:353/0 lens 736/0 e 0 to 0 dl 1783144253 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144242.737176:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641088 00000100:00100000:3.0:1783144242.737181:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641088 00010000:00010000:1.0:1783144242.737217:0:85014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783144242.737229:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00010000:00010000:1.0:1783144242.737238:0:85014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a423047185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4198c expref: -99 pid: 85014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144242.737240:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481641088:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000004:00200000:1.0:1783144242.737324:0:85014:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000100:00100000:3.0:1783144242.737391:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481641088:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 154us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144242.737399:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000004:00080000:1.0:1783144242.737473:0:85014:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0xad8e53a423046f0f 00000004:00080000:1.0:1783144242.737477:0:85014:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xad8e53a423046f0f in new mfd 00010000:00010000:1.0:1783144242.737508:0:85014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a423047185 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4198c expref: 12 pid: 85014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.737522:0:85014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:1.0:1783144242.737525:0:85014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783144242.737530:0:85014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a423047185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4198c expref: 12 pid: 85014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.737544:0:85014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee6d9c00, rc 0) 00010000:00080000:1.0:1783144242.737575:0:85014:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783144242.737588:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.737591:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000020:00080000:1.0:1783144242.737595:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.737597:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000100:00100000:2.0:1783144242.738943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144242.738999:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636608 00000100:00100000:0.0:1783144242.739007:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636608 00000100:00100000:0.0:1783144242.739044:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 211 00000100:00100000:0.0:1783144242.739053:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+11:2402:x1869759481636608:12345-192.168.203.4@tcp:35:lfs.0 00010000:00080000:0.0:1783144242.739067:0:80989:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280518, current: 94489280518, replaying 00000100:00100000:0.0:1783144242.739081:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+11:2402:x1869759481636608:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 29us (142us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144242.739100:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 211 00000020:00080000:1.0:1783144242.739106:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.739111:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280518, next_transno: 94489280518 00010000:00080000:1.0:1783144242.739115:0:85014:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280518) 00000020:00080000:1.0:1783144242.739118:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.739126:0:85014:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481636608 t94489280518 from 192.168.203.4@tcp req@ffff9c29ceadb800 x1869759481636608/t0(94489280518) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:353/0 lens 392/0 e 0 to 0 dl 1783144253 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144242.739290:0:85014:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783144242.739303:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.739305:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000020:00080000:1.0:1783144242.739308:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.739310:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000100:00100000:2.0:1783144242.740302:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144242.740328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144242.740341:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641216 00000100:00100000:3.0:1783144242.740348:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641216 00000100:00100000:3.0:1783144242.740389:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1783144242.740399:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481641216:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144242.740406:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481636864 00010000:00010000:3.0:1783144242.740409:0:84986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783144242.740412:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481636864 00010000:00010000:3.0:1783144242.740424:0:84986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043e600/0xad8e53a423047193 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419a8 expref: -99 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.740447:0:84986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043e600/0xad8e53a423047193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419a8 expref: 9 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.740457:0:84986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043e600/0xad8e53a423047193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419a8 expref: 9 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.740465:0:84986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043e600, rc 0) 00000100:00100000:0.0:1783144242.740487:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:3.0:1783144242.740498:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481641216:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 100us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144242.740500:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:2402:x1869759481636864:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1783144242.740514:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00010000:00080000:0.0:1783144242.740517:0:66116:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280519, current: 94489280519, replaying 00000100:00100000:0.0:1783144242.740534:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:2402:x1869759481636864:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 39us (206us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144242.740541:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00000020:00080000:1.0:1783144242.740546:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.740551:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280519, next_transno: 94489280519 00010000:00080000:1.0:1783144242.740554:0:85014:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280519) 00000020:00080000:1.0:1783144242.740558:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.740566:0:85014:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481636864 t94489280519 from 192.168.203.4@tcp req@ffff9c2ae4e9ce00 x1869759481636864/t0(94489280519) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:353/0 lens 392/0 e 0 to 0 dl 1783144253 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144242.740691:0:85014:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783144242.740714:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.740717:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000020:00080000:1.0:1783144242.740745:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.740748:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000100:00100000:2.0:1783144242.741659:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144242.741702:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641344 00000100:00100000:1.0:1783144242.741718:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641344 00000100:00100000:1.0:1783144242.741772:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1783144242.741778:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481641344:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144242.741867:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481641344:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.741874:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1783144242.742425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144242.742476:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641472 00000100:00100000:0.0:1783144242.742479:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641472 00000100:00100000:0.0:1783144242.742527:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 713 00000100:00100000:0.0:1783144242.742536:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+13:2402:x1869759481641472:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783144242.742550:0:66112:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2ae4e9e300 x1869759481641472/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:353/0 lens 224/0 e 0 to 0 dl 1783144253 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144242.742566:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+13:2402:x1869759481641472:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 Request processed in 32us (142us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144242.742572:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 713 00000020:00080000:1.0:1783144242.742589:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.742603:0:85014:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 94489280520 00010000:00080000:1.0:1783144242.742606:0:85014:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1783144242.742608:0:85014:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144242.742614:0:85014:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783144242.742616:0:85014:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1783144242.742716:0:85014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 98784247808 00000100:00100000:2.0:1783144242.743072:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144242.743162:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641600 00000100:00100000:3.0:1783144242.743167:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641600 00000100:00100000:3.0:1783144242.743199:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:3.0:1783144242.743207:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481641600:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144242.743287:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481641600:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144242.743297:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000001:00100000:2.0:1783144242.744334:0:84981:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:2.0:1783144242.744338:0:84981:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783144242.744352:0:84981:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:1.0:1783144242.744415:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744427:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744434:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744440:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144242.744443:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744450:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744462:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744467:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d8800/0xad8e53a42304714d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744490:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744497:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744510:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744515:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144242.744518:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744524:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744531:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.744536:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9000/0xad8e53a423047169 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85014 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783144242.744598:0:85014:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783144242.744626:0:85014:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783144242.744636:0:85014:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2ac7da7b80 x1869759501254272/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:353/0 lens 224/0 e 0 to 0 dl 1783144253 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783144242.744787:0:85014:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.203.4@tcp: req@ffff9c2ae4e9e300 x1869759481641472/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:353/0 lens 224/0 e 0 to 0 dl 1783144253 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144242.744831:0:85014:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1783144242.745791:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783144242.745810:0:3647:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9c29c5085f80 x1869759501254272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144258 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144242.745817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:2.0:1783144242.745826:0:3647:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c29c5085f80 x1869759501254272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144258 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144242.745834:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144242.745848:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783144242.745857:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641728 00000100:00080000:2.0:1783144242.745861:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a1b5429b): req@ffff9c29ceadb480 x1869759501236992/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144237 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144242.745865:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641728 00000100:00100000:2.0:1783144242.745884:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501254272:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783144242.745908:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:0.0:1783144242.745920:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481641728:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144242.745931:0:84986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144242.745946:0:84986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7a00/0xad8e53a42304719a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419af expref: -99 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144242.745949:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144242.745955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144242.745961:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501254400:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783144242.745984:0:84986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7a00/0xad8e53a42304719a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419af expref: 10 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.745996:0:84986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7a00/0xad8e53a42304719a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419af expref: 10 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144242.746001:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783144242.746011:0:84986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7a00, rc 0) 00000100:00100000:1.0:1783144242.746020:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501236992 00000100:00100000:1.0:1783144242.746032:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501236992 00000100:00100000:2.0:1783144242.746041:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254400 00000100:00100000:2.0:1783144242.746046:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254400 00000100:00100000:0.0:1783144242.746051:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481641728:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 131us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144242.746059:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1783144242.746071:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:1.0:1783144242.746082:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501236992:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144242.746097:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000004:00000024:1.0:1783144242.746104:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:2.0:1783144242.746108:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869759501254400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783144242.746123:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:1.0:1783144242.746153:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501236992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.746160:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:2.0:1783144242.746167:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869759501254400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144242.746173:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:2.0:1783144242.746207:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501254400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144242.746216:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501236992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144242.747788:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144242.747953:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481640448 00000100:00100000:1.0:1783144242.747969:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481640448 00000100:00100000:0.0:1783144242.748019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144242.748075:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 997 00000100:00100000:1.0:1783144242.748085:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:65107:x1869759481640448:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144242.748097:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144242.748112:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a4230471a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41993 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.748168:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a4230471a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144242.748171:0:84987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641856 00000100:00100000:2.0:1783144242.748177:0:84987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641856 00010000:00010000:1.0:1783144242.748182:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a4230471a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.748194:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a4230471a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144242.748211:0:84987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:2.0:1783144242.748219:0:84987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481641856:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000004:00200000:1.0:1783144242.748237:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144242.748243:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144242.748262:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a4230471a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.748285:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9c00/0xad8e53a4230471a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41993 expref: 8 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144242.748301:0:84987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481641856:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 82us (281us total) trans 0 rc -2/-2 00010000:00010000:1.0:1783144242.748304:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a4230471a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41993 expref: 7 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144242.748311:0:84987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00010000:00010000:1.0:1783144242.748320:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:1.0:1783144242.748323:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144242.748326:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee6d9800, rc 0) 00000100:00100000:1.0:1783144242.748355:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+7:65107:x1869759481640448:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 272us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.748362:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 997 00000100:00100000:0.0:1783144242.750946:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144242.750988:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481641984 00000100:00100000:1.0:1783144242.750996:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481641984 00000100:00100000:1.0:1783144242.751041:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 998 00000100:00100000:1.0:1783144242.751051:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:65107:x1869759481641984:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144242.751077:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:1.0:1783144242.751131:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:65107:x1869759481641984:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.751138:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 998 00000100:00100000:1.0:1783144242.753125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144242.753324:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481642112 00000100:00100000:2.0:1783144242.753333:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481642112 00000100:00100000:2.0:1783144242.753383:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 999 00000100:00100000:2.0:1783144242.753394:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:65107:x1869759481642112:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144242.753435:0:66114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144242.753512:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:65107:x1869759481642112:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 119us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144242.753520:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 999 00000100:00100000:0.0:1783144242.755586:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144242.755666:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481642240 00000100:00100000:2.0:1783144242.755674:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481642240 00000100:00100000:2.0:1783144242.755740:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4917 00000100:00100000:2.0:1783144242.755748:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2402:x1869759481642240:12345-192.168.203.4@tcp:8:lfs.0 00010000:00080000:2.0:1783144242.755783:0:26146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t0 exp 0000000000000000 cur 2777 last 0 00000020:00000080:2.0:1783144242.755823:0:26146:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a4230471af 00002000:00100000:2.0:1783144242.755834:0:26146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cace81e7-a6f2-4d37-b197-caf34583781c/ffff9c29c4cb6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783144242.755852:0:26146:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783144242.755933:0:26146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783144242.755955:0:26146:0:(import.c:65:import_set_state_nolock()) ffff9c29c4cb5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144242.756005:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481642240:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 257us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144242.756011:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4917 00000001:00100000:1.0:1783144242.758427:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:1.0:1783144242.758437:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:1.0:1783144242.758440:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2ad085b000/cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:1.0:1783144242.758456:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00000080:3.0:1783144242.758977:0:85014:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc16288613e10 00100000:10000000:3.0:1783144242.758987:0:85014:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:00000080:2.0:1783144242.759064:0:83802:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad085b000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0000 00000020:00000080:2.0:1783144242.759106:0:83802:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c235f800 for lustre-OST0000 00000004:00080000:1.0:1783144242.759600:0:85002:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:1.0:1783144242.759637:0:85002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85002:1869759501254528:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783144242.759714:0:85002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144242.759757:0:85002:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad03c0 going to sleep for 11 seconds 00000004:00080000:2.0:1783144242.760143:0:85000:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:2.0:1783144242.760160:0:85000:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef604000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85000:1869759501254656:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783144242.760185:0:85000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144242.760199:0:85000:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9e269c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144242.760491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144242.760579:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481642368 00000100:00100000:1.0:1783144242.760585:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481642368 00000100:00100000:1.0:1783144242.760647:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1532 00000100:00080000:3.0:1783144242.760653:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144242.760658:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:65107:x1869759481642368:12345-192.168.203.4@tcp:13:lfs.0 00000100:00100000:0.0:1783144242.760755:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254528 00000100:00100000:0.0:1783144242.760759:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254528 00000100:00100000:0.0:1783144242.760783:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254656 00002000:00000024:1.0:1783144242.760784:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144242.760786:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254656 00000100:00100000:0.0:1783144242.760807:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:0.0:1783144242.760813:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:85002:x1869759501254528:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783144242.760831:0:26140:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -63 00000100:00100000:1.0:1783144242.760832:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:65107:x1869759481642368:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 178us (342us total) trans 0 rc 0/0 00002000:02000040:0.0:1783144242.760835:0:26140:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1729) 00000100:00100000:1.0:1783144242.760846:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1532 00000100:00100000:2.0:1783144242.761038:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:2.0:1783144242.761046:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:85000:x1869759501254656:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783144242.761068:0:26149:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -613 00002000:02000040:2.0:1783144242.761070:0:26149:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1729) 00002000:00010000:0.0:1783144242.765809:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144242.765822:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.765855:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1783144242.765859:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144242.765866:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.765882:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.765892:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.765901:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.766525:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144242.766529:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.766538:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.766547:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.766552:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.766562:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.766581:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.766590:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a4230471b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.766613:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.766615:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.766617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144242.766645:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144242.766652:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.766661:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1783144242.766665:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144242.766669:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.766679:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.766698:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.766716:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.766751:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783144242.766831:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144242.766865:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481642496 00000100:00100000:0.0:1783144242.766874:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481642496 00000100:00100000:0.0:1783144242.766913:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4920 00000100:00100000:0.0:1783144242.766920:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2402:x1869759481642496:12345-192.168.203.4@tcp:8:lfs.0 00010000:00080000:0.0:1783144242.766951:0:26151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t0 exp 0000000000000000 cur 2777 last 0 00010000:00010000:1.0:1783144242.766958:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.766964:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.766971:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6c00 already unused, calling callback (ffffffffc0c0bce0) 00000020:00000080:0.0:1783144242.766979:0:26151:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a4230471c4 00010000:00010000:1.0:1783144242.766982:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.766990:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1783144242.766992:0:26151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cace81e7-a6f2-4d37-b197-caf34583781c/ffff9c2af5ddb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00010000:00010000:1.0:1783144242.767008:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1783144242.767013:0:26151:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00010000:1.0:1783144242.767018:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe58ea43/0xad8e53a4230471bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.767032:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.767034:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.767036:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144242.769276:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.769286:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769299:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.769303:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.769308:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769321:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769342:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769354:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769375:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144242.769426:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.769431:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769438:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.769442:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.769446:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769455:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769464:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769470:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783144242.769481:0:26151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00010000:1.0:1783144242.769501:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00080000:0.0:1783144242.769521:0:26151:0:(import.c:65:import_set_state_nolock()) ffff9c29c6cdb000 : changing import state from RECOVER to FULL 00002000:00010000:1.0:1783144242.769541:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.769548:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769556:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.769559:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.769563:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769572:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769581:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144242.769587:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481642496:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 2663us (2756us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144242.769595:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144242.769603:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4920 00010000:00010000:1.0:1783144242.769615:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783144242.769652:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.769658:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769667:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.769688:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.769693:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769714:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769743:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769751:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769763:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783144242.769799:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.769804:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769811:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.769814:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.769818:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769826:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769834:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769846:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769855:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783144242.769904:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.769910:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769918:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.769921:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.769926:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769935:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769943:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.769950:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.769955:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783144242.769961:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1783144242.769965:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144242.770003:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770008:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770021:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770024:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770028:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770037:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770045:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770062:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770072:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783144242.770107:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770113:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770121:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770124:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770129:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770139:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770158:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770166:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770173:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783144242.770207:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770212:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770220:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770223:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770227:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770237:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770247:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770262:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770268:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.770274:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770289:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770293:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1783144242.770307:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770315:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ef6bd23/0xad8e53a4230471cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770334:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1783144242.770338:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144242.770339:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770349:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770351:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.770357:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770368:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1783144242.770368:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770374:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770378:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770387:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770394:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770401:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770409:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783144242.770442:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770446:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770453:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770461:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770465:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770473:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770480:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770487:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770494:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1783144242.770508:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770523:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f34644df/0xad8e53a4230471d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144242.770530:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770537:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770538:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1783144242.770545:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770548:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770555:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144242.770562:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.770564:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770568:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770578:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770581:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770592:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770599:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770615:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770618:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000301cf02/0xad8e53a4230471d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770634:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1783144242.770639:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1783144242.770644:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770651:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.770661:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770669:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144242.770673:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770682:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.770683:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770703:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770718:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770748:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770758:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770766:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770772:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770780:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783144242.770815:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770824:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770837:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770840:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770844:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770854:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770863:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770871:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770881:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1783144242.770916:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.770921:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770928:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.770931:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.770935:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770945:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770963:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770971:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.770979:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1783144242.771016:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771022:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771030:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771033:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771038:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771047:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771054:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771061:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771077:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c0d884d/0xad8e53a4230471e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771081:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:0.0:1783144242.771104:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1783144242.771108:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771115:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.771119:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771128:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144242.771130:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771140:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771146:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771150:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771157:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144242.771161:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cac0358/0xad8e53a4230471e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771163:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771179:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771186:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1783144242.771189:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771192:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771210:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771211:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.771217:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771227:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:0.0:1783144242.771230:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771242:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144242.771250:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1783144242.771256:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d91d0ee0/0xad8e53a4230471ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144242.771267:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144242.771272:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1783144242.771274:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771277:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771292:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:0.0:1783144242.771294:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.771297:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771307:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771313:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771341:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771341:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771364:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.771366:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771378:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771387:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1783144242.771424:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771429:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771436:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771439:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771443:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771451:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771459:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771475:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771484:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00000001:00100000:3.0:1783144242.771496:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:3.0:1783144242.771502:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb7000/cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:3.0:1783144242.771518:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1783144242.771523:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771529:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144242.771532:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb7000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0001 00010000:00010000:1.0:1783144242.771539:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771543:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771548:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771556:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771563:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771571:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144242.771573:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac7fb0000 for lustre-OST0001 00010000:00010000:1.0:1783144242.771583:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1783144242.771615:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771621:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771633:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771636:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771640:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771648:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771656:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771663:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771670:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1783144242.771717:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771750:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771758:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771761:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771765:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771793:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771812:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771819:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771827:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1783144242.771872:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771877:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771885:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771888:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771892:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771900:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771908:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771915:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771934:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:1.0:1783144242.771969:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.771974:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771980:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.771982:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.771985:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771990:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771995:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.771999:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772004:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:1.0:1783144242.772027:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.772030:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772034:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.772040:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.772042:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772048:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772053:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772057:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772062:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:1.0:1783144242.772083:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.772086:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772090:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.772091:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.772094:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772098:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772102:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772110:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772115:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:1.0:1783144242.772138:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.772141:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772145:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.772147:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.772149:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772155:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772159:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772164:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772168:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:1.0:1783144242.772184:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.772187:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772195:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.772197:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.772199:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772205:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772212:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772219:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772227:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:1.0:1783144242.772260:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.772265:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772272:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.772274:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.772278:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772286:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772307:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772314:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772322:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:1.0:1783144242.772358:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144242.772363:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772370:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:1.0:1783144242.772372:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144242.772375:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772383:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772390:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772397:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772415:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00080000:1.0:1783144242.772554:0:26140:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:1.0:1783144242.772602:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:85002:x1869759501254528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11789us (12896us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.772608:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00010000:00010000:1.0:1783144242.772629:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:1.0:1783144242.772633:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772638:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.772640:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772646:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772653:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772657:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058cf5147/0xad8e53a4230471fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772669:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:1.0:1783144242.772671:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772683:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.772685:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772689:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772695:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772699:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a56553/0xad8e53a423047203 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772736:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006511cbfa/0xad8e53a4230471f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772756:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:0.0:1783144242.772760:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772761:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:1.0:1783144242.772769:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772773:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d9200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.772780:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772781:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee6d8000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.772787:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144242.772791:0:85002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85002:1869759501254528:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1783144242.772796:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772799:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144242.772806:0:85002:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x682:0x0] 00010000:00010000:0.0:1783144242.772815:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772818:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772825:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd59c869/0xad8e53a42304720a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772838:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048fae549/0xad8e53a423047211 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772856:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:1.0:1783144242.772860:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772865:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00000100:00100000:3.0:1783144242.772866:0:85002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85002:1869759501254912:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1783144242.772869:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.772872:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772873:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772893:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.772895:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772899:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144242.772905:0:85002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144242.772911:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772915:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144242.772925:0:85002:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e900 going to sleep for 11 seconds 00010000:00010000:1.0:1783144242.772926:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a423047218 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772938:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772942:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1783144242.772949:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772952:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a42304721f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772963:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.772973:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772975:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1783144242.772982:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.772986:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.772996:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.773002:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773005:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773016:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423047226 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773038:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773040:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1783144242.773045:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773052:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.773054:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773055:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773070:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773075:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304722d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773080:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773088:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a423047234 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773095:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1783144242.773101:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773104:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1783144242.773109:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773113:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773116:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47de00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.773119:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773120:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773137:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773142:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773145:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773157:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002021fb13/0xad8e53a423047242 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773171:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1783144242.773173:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773174:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773192:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47ca00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773196:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773196:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000026cd725/0xad8e53a42304723b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773218:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773245:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1783144242.773249:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773256:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.773259:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773267:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773277:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773280:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773287:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a5b024a/0xad8e53a423047249 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773299:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c3e195/0xad8e53a423047250 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773305:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1783144242.773308:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773313:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47cc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773316:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773317:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1783144242.773324:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773325:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773346:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.773346:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.773353:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773354:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423047257 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773374:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1783144242.773376:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773380:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773382:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773386:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773391:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773395:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea0bf944/0xad8e53a423047265 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773401:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783144242.773403:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773406:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47dc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773408:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773418:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773423:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773427:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304726c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773433:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783144242.773435:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773438:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773440:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773444:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773448:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773453:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c0e229/0xad8e53a423047273 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773465:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783144242.773468:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773471:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773473:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773477:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773482:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773486:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d57674c8/0xad8e53a42304727a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773491:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783144242.773493:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773496:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773498:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773508:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773513:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773516:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000517a4c2/0xad8e53a423047281 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773523:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144242.773525:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773528:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773529:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773533:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773538:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773544:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0f90b7c/0xad8e53a423047288 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773564:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144242.773566:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773570:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47ce00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773572:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773577:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773583:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773587:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000725cc7bf/0xad8e53a42304728f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773593:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.773595:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773599:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.773601:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773611:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773616:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773620:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba54677f/0xad8e53a423047296 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.773626:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.773627:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.773628:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144242.773635:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144242.773644:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501254784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144242.773664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144242.773735:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481642624 00000100:00100000:3.0:1783144242.773741:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481642624 00000100:00080000:1.0:1783144242.773784:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144242.773795:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254784 00010000:00010000:1.0:1783144242.773796:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144242.773799:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254784 00000100:00100000:3.0:1783144242.773819:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1533 00000100:00100000:3.0:1783144242.773826:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:65107:x1869759481642624:12345-192.168.203.4@tcp:13:lfs.0 00000100:00100000:1.0:1783144242.773832:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00002000:00000024:3.0:1783144242.773841:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144242.773846:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501254784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783144242.773862:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144242.773881:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:65107:x1869759481642624:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 56us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144242.773886:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1533 00000100:00100000:1.0:1783144242.773916:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501254784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.773924:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:3.0:1783144242.773931:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501254784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783144242.774616:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.774654:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.774661:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774672:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.774676:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.774681:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774694:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774715:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774752:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774766:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144242.774843:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.774849:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774857:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.774869:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.774873:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774881:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774888:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774895:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774911:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783144242.774951:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.774956:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.774963:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.774965:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.774969:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775088:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775102:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775110:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d163b049/0xad8e53a42304725e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775133:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144242.775137:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775150:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144242.775154:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775155:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775176:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775177:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775193:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775194:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775213:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92dff90/0xad8e53a42304729d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775225:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144242.775237:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144242.775243:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775249:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144242.775252:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775261:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144242.775261:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775266:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775273:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775274:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.775278:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.775278:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144242.775280:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000930061c2/0xad8e53a4230472a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775291:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775293:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144242.775296:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144242.775298:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144242.775300:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.775311:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=2777s v=(0 0) 00000100:00100000:0.0:1783144242.775313:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501254912 00010000:00010000:3.0:1783144242.775315:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775317:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1783144242.775319:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501254912 00010000:00010000:2.0:1783144242.775327:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775328:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096407d5a/0xad8e53a4230472ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775350:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144242.775353:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:0.0:1783144242.775363:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:85002:x1869759501254912:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1783144242.775373:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.775375:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775384:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775387:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.775391:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783144242.775396:0:26147:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00010000:00010000:2.0:1783144242.775406:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.775411:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.775416:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775423:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.775427:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775434:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775446:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.775450:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144242.775457:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008590e5ca/0xad8e53a4230472b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775461:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775475:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.775479:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144242.775480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.775483:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.775484:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.775497:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775507:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775516:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775535:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144242.775584:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.775590:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775600:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.775604:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.775609:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775620:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775637:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144242.775641:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775651:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775653:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775680:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.775683:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.775688:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775690:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144242.775697:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775701:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775744:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144242.775749:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775751:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775771:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775772:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f7dc6bd/0xad8e53a4230472b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775798:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.775800:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.775804:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.775806:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.775812:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230472c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775829:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.775838:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.775840:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.775856:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.775863:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.775892:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.775899:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775906:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.775910:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.775915:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775925:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775935:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775942:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.775963:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.776083:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.776089:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776096:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.776100:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776110:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776128:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776136:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230472c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776153:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.776156:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.776158:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.776219:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.776226:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776234:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.776237:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.776241:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776256:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776265:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776272:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776319:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144242.776364:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.776370:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776379:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.776381:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.776386:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776395:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776404:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776423:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776477:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144242.776482:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776490:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.776494:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776502:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776515:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776523:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230472ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776552:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.776556:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776563:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.776567:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776574:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776586:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.776593:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.776596:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.776599:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.776661:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144242.776666:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230472d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.776758:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.776763:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776771:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.776773:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.776777:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776786:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776794:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.776802:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.776954:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.776960:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.776968:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.776972:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.777042:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.777054:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.777063:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.777065:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.777067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144242.777133:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:85002:x1869759501254912:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1770us (4228us total) trans 4294968823 rc 0/0 00000100:00100000:0.0:1783144242.777142:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00010000:00010000:2.0:1783144242.777172:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144242.777178:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230472dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.777227:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.777233:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777240:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.777243:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.777248:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777257:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777265:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777272:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144242.777310:0:85002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85002:1869759501254912:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783144242.777323:0:85002:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00010000:00010000:1.0:1783144242.777404:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.777409:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.777417:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.777420:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.777429:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.777454:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.777464:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.777466:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.777467:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.777503:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144242.777507:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230472e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.777539:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.777567:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.777573:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777580:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.777583:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.777587:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777596:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777604:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777610:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777625:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.777642:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.777648:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.777658:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fe00 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:2.0:1783144242.777661:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.777669:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.777670:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777689:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:3.0:1783144242.777692:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777694:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144242.777716:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.777752:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230472ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.777767:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.777769:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.777770:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.777782:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777795:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777803:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777810:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777852:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144242.777889:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.777894:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777902:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.777904:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.777908:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777916:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777924:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.777941:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778054:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144242.778059:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778066:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.778070:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778078:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778090:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778097:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a4230472f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778112:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.778115:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778128:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.778131:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778138:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778148:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778156:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.778158:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.778159:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.778216:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144242.778220:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230472f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.778267:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.778272:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778280:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.778283:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.778287:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778295:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778303:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778310:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778350:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.778355:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778362:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.778365:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778372:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778383:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.778397:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.778398:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.778400:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.778430:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144242.778434:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230472ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778452:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.778482:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.778487:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778495:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.778498:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.778502:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778511:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778518:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778526:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778542:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.778564:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.778571:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.778578:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144242.778579:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.778587:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778587:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778596:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778608:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.778613:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144242.778614:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778617:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778627:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778647:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047306 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778649:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778669:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778675:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.778679:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.778683:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778691:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.778695:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778716:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778748:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778749:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144242.778761:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304730d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.778775:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.778778:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.778790:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.778802:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778811:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.778814:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.778818:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778826:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778847:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.778855:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.779606:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.779613:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.779620:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.779629:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.779634:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.779642:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.779652:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.779659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.779661:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.779662:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.779898:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144242.779905:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a423047314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.779974:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.779980:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.780055:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.780077:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.780080:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.780084:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780095:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780104:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780122:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780137:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.780163:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.780169:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.780175:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144242.780179:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144242.780183:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.780185:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780203:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:3.0:1783144242.780205:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780209:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.780217:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.780223:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780229:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.780249:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a42304731b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780250:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780270:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.780276:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.780280:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.780283:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.780290:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.780293:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.780301:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.780311:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780315:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144242.780319:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.780322:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.780322:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a423047322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.780390:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.780396:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780404:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.780406:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.780411:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780419:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780427:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.780435:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.781186:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144242.781194:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781197:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.781205:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144242.781209:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.781218:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.781230:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144242.781239:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.781241:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144242.781242:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.781285:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.781295:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144242.781301:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.781353:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.781358:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781376:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.781379:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.781383:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781393:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781401:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781408:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781426:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.781444:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.781450:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.781458:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.781464:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781476:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144242.781479:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:3.0:1783144242.781482:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781483:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.781491:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781496:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781508:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781513:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781527:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781535:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781544:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781546:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.781550:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.781553:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.781570:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144242.781601:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.781606:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781614:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.781616:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.781620:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781640:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781649:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781656:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781679:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783144242.781690:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144242.781696:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781713:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.781717:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.781737:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144242.781738:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781744:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781760:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781761:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.781768:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144242.781773:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a423047337 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781776:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781788:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144242.781790:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781791:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781807:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.781811:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781813:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781821:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781830:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781833:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781848:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304733e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781855:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.781856:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.781861:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781870:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.781872:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781877:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781885:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781889:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.781893:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144242.781896:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.781899:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.781900:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781901:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.781906:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.781912:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.781920:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.781924:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781934:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781942:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781950:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.781962:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.781970:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.781976:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.781984:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.781987:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782005:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782013:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782017:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304734c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782026:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782027:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782029:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.782078:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.782084:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782092:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.782094:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.782098:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782106:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782113:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782126:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782138:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.782148:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.782153:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782160:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.782163:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782170:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782180:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782197:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423047353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782212:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782214:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782217:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144242.782224:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.782230:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782236:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.782239:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.782242:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782250:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782256:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782262:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782275:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.782284:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.782289:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782298:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.782302:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782310:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.782312:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.782323:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782327:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782349:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a42304735a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782351:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.782359:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.782366:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782370:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782373:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.782378:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782383:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.782386:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782392:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782402:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.782411:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.782417:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782424:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.782427:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.782429:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.782437:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782440:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782445:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.782452:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.782456:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782460:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782463:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782477:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047361 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782499:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782504:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.782505:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782509:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782512:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.782524:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.782530:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.782536:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782545:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.782548:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.782551:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.782559:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782564:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.782569:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.782575:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782582:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782584:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782600:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782603:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782605:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782625:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047368 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782640:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782643:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782646:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.782655:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.782663:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.782669:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782676:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.782680:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782687:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144242.782690:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144242.782699:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782714:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782740:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=2777s v=(0 0) 00010000:00010000:2.0:1783144242.782744:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144242.782753:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782758:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a42304736f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782769:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782779:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.782779:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782782:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782785:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144242.782792:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144242.782806:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144242.782814:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144242.782819:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782827:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144242.782831:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782839:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782851:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782861:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423047376 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144242.782875:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782878:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144242.782886:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144242.783241:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783144242.785584:0:26149:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:2.0:1783144242.785696:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:85000:x1869759501254656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24647us (25505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144242.785798:0:85000:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef604000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85000:1869759501254656:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783144242.785813:0:85000:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:1.0:1783144242.785884:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501255040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144242.785884:0:85000:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85000:1869759501255168:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783144242.785917:0:85000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144242.785921:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144242.785940:0:85000:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d9d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144242.785947:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255168 00000100:00100000:1.0:1783144242.785957:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255040 00000100:00100000:3.0:1783144242.785964:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255168 00000100:00100000:1.0:1783144242.785964:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255040 00000100:00100000:2.0:1783144242.785994:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000100:00100000:1.0:1783144242.786019:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:3.0:1783144242.786024:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922 00000100:00100000:1.0:1783144242.786028:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501255040:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144242.786038:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:85000:x1869759501255168:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:1.0:1783144242.786049:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00080000:3.0:1783144242.786080:0:26144:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00000100:00100000:1.0:1783144242.786094:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501255040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144242.786101:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:1.0:1783144242.786133:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501255040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144242.787634:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:85000:x1869759501255168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1598us (1714us total) trans 4294968823 rc 0/0 00000100:00100000:3.0:1783144242.787644:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922 00000100:00100000:0.0:1783144242.787745:0:85000:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85000:1869759501255168:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783144242.787757:0:85000:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00010000:00010000:3.0:1783144243.151780:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144243.726214:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144243.726287:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501255296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144243.726349:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144243.729773:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255296 00000100:00100000:2.0:1783144243.729791:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255296 00000100:00100000:3.0:1783144243.729827:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501255424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144243.729836:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1783144243.729844:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501255296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144243.729864:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144243.729875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144243.729908:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501255296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144243.729914:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1783144243.729927:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255424 00000100:00100000:2.0:1783144243.729930:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255424 00000100:00100000:2.0:1783144243.729949:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:2.0:1783144243.729955:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501255424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144243.729964:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144243.729969:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501255296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144243.729992:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501255424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144243.729998:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:3.0:1783144243.730011:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501255424:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1783144243.736539:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783144244.173989:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144245.199801:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783144245.582249:0:85562:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1783144246.222835:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144246.377979:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144246.378026:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144246.378105:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144246.378137:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144246.378164:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144246.378213:0:84992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481642752 00000100:00100000:3.0:1783144246.378214:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481642880 00000100:00100000:3.0:1783144246.378224:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481642880 00000100:00100000:2.0:1783144246.378224:0:84992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481642752 00000100:00100000:3.0:1783144246.378280:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481643008 00000100:00100000:3.0:1783144246.378284:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481643008 00000100:00100000:2.0:1783144246.378290:0:84992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:2.0:1783144246.378302:0:84992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481642752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144246.378313:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 714 00000100:00100000:3.0:1783144246.378323:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481642880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144246.378372:0:84992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481642752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144246.378375:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481642880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144246.378385:0:84992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1783144246.378389:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 714 00000100:00100000:3.0:1783144246.378410:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 715 00000100:00100000:3.0:1783144246.378418:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481643008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144246.378462:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481643008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144246.378469:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 715 00000100:00080000:1.0:1783144246.378524:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144246.378528:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144246.378596:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481643136 00000100:00100000:0.0:1783144246.378601:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481643136 00000100:00100000:0.0:1783144246.378640:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481643264 00000100:00100000:0.0:1783144246.378643:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481643264 00000100:00100000:3.0:1783144246.378659:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1948 00000100:00100000:0.0:1783144246.378669:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1949 00000100:00100000:3.0:1783144246.378671:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+5:2403:x1869759481643136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144246.378689:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481643264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144246.378740:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481643264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144246.378747:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1949 00000100:00080000:1.0:1783144246.378829:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144246.378833:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144246.379329:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+5:2403:x1869759481643136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 660us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144246.379337:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1948 00000001:02000400:3.0:1783144246.484710:0:85610:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783144247.245934:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144247.822115:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501255552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144247.822179:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.822226:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501255680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144247.822250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.822269:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144247.822275:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501255808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144247.822296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144247.822323:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255552 00000100:00100000:0.0:1783144247.822330:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255552 00000100:00100000:0.0:1783144247.822373:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:0.0:1783144247.822382:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501255552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783144247.822422:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:1.0:1783144247.822534:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144247.822547:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501255936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144247.823420:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255680 00000100:00100000:2.0:1783144247.823425:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255680 00000100:00100000:2.0:1783144247.823462:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255808 00000100:00100000:2.0:1783144247.823466:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255808 00000100:00100000:2.0:1783144247.823495:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:2.0:1783144247.823504:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501255680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783144247.823524:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144247.823593:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1783144247.823603:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501255808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783144247.823620:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144247.823710:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501255552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1328us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144247.823718:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:00080000:0.0:1783144247.823761:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144247.823764:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144247.829300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.829376:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501255552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144247.829416:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501255936 00000100:00100000:1.0:1783144247.829422:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501255936 00000100:00100000:1.0:1783144247.829467:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:1.0:1783144247.829475:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501255936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783144247.829507:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:1.0:1783144247.829551:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501255936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.829558:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00100000:1.0:1783144247.829605:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501255936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144247.829778:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501256192:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.829808:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.829832:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501256704:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.829855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.829877:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783144247.829883:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501256320:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.829904:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.829920:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501256832:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830092:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.830123:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256704 00000100:00100000:1.0:1783144247.830127:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256704 00000100:00100000:1.0:1783144247.830162:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256832 00000100:00100000:1.0:1783144247.830166:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256832 00000100:00100000:1.0:1783144247.830189:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1783144247.830211:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501256704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830248:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501256704:12345-0@lo:400:kworker.0 Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.830255:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1783144247.830267:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1783144247.830273:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501256832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830300:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501256832:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.830306:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1783144247.830330:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501256832:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830340:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501256704:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830359:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501256064:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830384:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.830408:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501256576:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.830446:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869759501257088:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.830487:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783144247.830493:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501256448:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830513:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.830528:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501256960:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144247.830571:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256192 00000100:00100000:1.0:1783144247.830574:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256192 00000100:00100000:1.0:1783144247.830601:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256320 00000100:00100000:1.0:1783144247.830604:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256320 00000100:00100000:1.0:1783144247.830615:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256576 00000100:00100000:1.0:1783144247.830617:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256576 00000100:00100000:1.0:1783144247.830628:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257088 00000100:00100000:1.0:1783144247.830631:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257088 00000100:00100000:1.0:1783144247.830642:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256448 00000100:00100000:1.0:1783144247.830644:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256448 00000100:00100000:1.0:1783144247.830656:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256960 00000100:00100000:1.0:1783144247.830658:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256960 00000100:00100000:1.0:1783144247.830681:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1783144247.830688:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501256192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830740:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501256192:12345-0@lo:400:kworker.0 Request processed in 35us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.830746:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1783144247.830759:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783144247.830765:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501256320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830791:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501256320:12345-0@lo:400:kworker.0 Request processed in 26us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.830797:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783144247.830808:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783144247.830814:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501256576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830843:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501256576:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.830848:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783144247.830859:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783144247.830865:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869759501257088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.830891:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869759501257088:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.830902:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783144247.830915:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783144247.830921:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501256448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144247.831147:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1783144247.831157:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501256960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.831196:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501256448:12345-0@lo:400:kworker.0 Request processed in 275us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.831203:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783144247.831238:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501256320:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.831248:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501256192:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.831273:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501256448:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.831283:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501256576:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.831292:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869759501257088:0@lo:400:kworker.0 00000100:00080000:1.0:1783144247.831325:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144247.831329:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783144247.831331:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144247.831334:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144247.831417:0:84988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501256064 00000100:00100000:1.0:1783144247.831422:0:84988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501256064 00000100:00100000:1.0:1783144247.831450:0:84988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783144247.831457:0:84988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501256064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144247.831532:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501256960:12345-0@lo:400:kworker.0 Request processed in 377us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144247.831539:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1783144247.831564:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501256960:0@lo:400:kworker.0 00000100:00100000:1.0:1783144247.831767:0:84988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501256064:12345-0@lo:400:kworker.0 Request processed in 310us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144247.831774:0:84988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783144247.831790:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501255680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8287us (9537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144247.831798:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1783144247.831822:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501255680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144247.831882:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501256064:0@lo:400:kworker.0 00000100:00100000:3.0:1783144247.832209:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501255808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8607us (9911us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144247.832217:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1783144247.832273:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501255808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144247.981338:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144247.984599:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481643392 00000100:00100000:2.0:1783144247.984612:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481643392 00000100:00100000:2.0:1783144247.984750:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1000 00000100:00100000:2.0:1783144247.984762:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+7:65579:x1869759481643392:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144247.984791:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445011456 avail 1298771968 00000100:00100000:2.0:1783144247.984867:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+7:65579:x1869759481643392:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 108us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144247.984874:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1000 00000100:00100000:1.0:1783144247.987313:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144247.988463:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481643520 00000100:00100000:2.0:1783144247.988473:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481643520 00000100:00100000:2.0:1783144247.988659:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1001 00000100:00100000:2.0:1783144247.988680:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:65579:x1869759481643520:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144247.988715:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144247.988810:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:65579:x1869759481643520:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 142us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144247.988817:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1001 00000100:00100000:0.0:1783144247.991237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144247.991379:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481643648 00000100:00100000:2.0:1783144247.991397:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481643648 00000100:00100000:2.0:1783144247.991461:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1540 00000100:00100000:2.0:1783144247.991469:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:65579:x1869759481643648:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144247.991500:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144247.991547:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:65579:x1869759481643648:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144247.991552:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1540 00000100:00100000:3.0:1783144247.993333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144247.993434:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481643776 00000100:00100000:2.0:1783144247.993441:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481643776 00000100:00100000:2.0:1783144247.993520:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1541 00000100:00100000:2.0:1783144247.993529:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:65579:x1869759481643776:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144247.993547:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144247.993600:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:65579:x1869759481643776:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144247.993616:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1541 00000100:00100000:1.0:1783144248.029487:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144248.029563:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481644032 00000100:00100000:0.0:1783144248.029573:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481644032 00000100:00100000:0.0:1783144248.029650:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1002 00000100:00100000:0.0:1783144248.029660:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:65596:x1869759481644032:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144248.029688:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144248.029709:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a42304737d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419b6 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029797:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029811:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029837:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029854:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029861:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029868:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029941:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029950:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029956:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029962:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144248.029966:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029973:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.029985:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:0.0:1783144248.029988:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144248.029993:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030005:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030018:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030024:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030030:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030035:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144248.030039:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030045:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030053:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c29c3701400) 00010000:00010000:0.0:1783144248.030056:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144248.030059:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030069:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304738b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030102:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a42304737d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419b6 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030124:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:0.0:1783144248.030127:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144248.030131:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a42304737d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419b6 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144248.030141:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7200, rc 0) 00000100:00100000:0.0:1783144248.030199:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:65596:x1869759481644032:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 540us (718us total) trans 0 rc 301/301 00000100:00100000:0.0:1783144248.030206:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1002 00000100:00080000:1.0:1783144248.030297:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144248.033256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144248.033328:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481644160 00000100:00100000:1.0:1783144248.033336:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481644160 00000100:00100000:1.0:1783144248.033385:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1003 00000100:00100000:1.0:1783144248.033395:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:65596:x1869759481644160:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:1.0:1783144248.033460:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033472:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033479:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033488:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033493:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033496:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033548:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033552:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033564:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144248.033596:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144248.033605:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033615:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033622:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033628:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033633:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47de00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144248.033637:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033645:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033656:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:1.0:1783144248.033659:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144248.033663:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033681:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033693:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033705:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033712:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.033717:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47da00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144248.034466:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034477:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034486:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c2ac9857e00) 00010000:00010000:1.0:1783144248.034489:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144248.034492:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034498:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47da00/0xad8e53a423047399 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034513:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034519:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034525:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034530:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144248.034540:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034547:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034556:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c2ac9857900) 00010000:00010000:1.0:1783144248.034559:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144248.034562:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144248.034567:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a4230473a0 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144248.034859:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:65596:x1869759481644160:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 1463us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144248.034868:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1003 00010000:00010000:3.0:1783144248.270636:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144248.847618:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783144248.847640:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501257216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144248.847711:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144248.847769:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257216 00000100:00100000:3.0:1783144248.847776:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257216 00000100:00100000:3.0:1783144248.847819:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1783144248.847827:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501257216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144248.847854:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144248.847897:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501257216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144248.847903:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1783144248.847948:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c5085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501257216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144248.849489:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501257344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144248.849530:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144248.849625:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257344 00000100:00100000:3.0:1783144248.849631:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257344 00000100:00100000:3.0:1783144248.849674:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1783144248.849683:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501257344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144248.849699:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144248.849761:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501257344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144248.849769:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1783144248.849816:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501257344:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1783144248.850522:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968823 is committed 00000001:00080000:0.0:1783144248.851486:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968823 is committed 00000001:00100000:0.0:1783144248.851522:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00010000:00010000:3.0:1783144249.293884:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144250.320697:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783144251.328347:0:85805:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 01:50:50 (1783144250) 00010000:00010000:2.0:1783144251.344749:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144251.372306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144251.372365:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481644288 00000100:00100000:3.0:1783144251.372375:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481644288 00000100:00100000:3.0:1783144251.372464:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1004 00000100:00080000:2.0:1783144251.372469:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144251.372478:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+7:66178:x1869759481644288:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144251.372499:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144251.372537:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230473a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419bd expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372603:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372619:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372631:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372660:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372668:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372676:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372890:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372899:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372904:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.372910:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373670:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fe00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.373683:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373692:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373706:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:3.0:1783144251.373709:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.373714:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373775:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373789:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373796:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373802:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373806:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fa00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.373809:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373814:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373822:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2af565c900) 00010000:00010000:3.0:1783144251.373824:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.373834:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373840:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373876:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230473a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419bd expref: 8 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373887:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:3.0:1783144251.373889:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.373941:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230473a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419bd expref: 8 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.373952:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043f400, rc 0) 00000100:00100000:3.0:1783144251.374025:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+7:66178:x1869759481644288:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1552us (1728us total) trans 0 rc 301/301 00000100:00100000:3.0:1783144251.374033:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1004 00000100:00100000:2.0:1783144251.377321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144251.377470:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481644544 00000100:00100000:0.0:1783144251.377480:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481644544 00000100:00100000:0.0:1783144251.377537:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1005 00000100:00100000:0.0:1783144251.377548:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:66178:x1869759481644544:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1783144251.377605:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144251.377629:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee6d9800/0xad8e53a4230471a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41993 expref: 7 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.377656:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:0.0:1783144251.377667:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144251.377944:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.377958:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.377973:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.377986:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.377993:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.377999:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381251:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381272:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381285:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144251.381301:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f50be94 reply state 000000007dd7de5a transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381324:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381331:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:2.0:1783144251.381335:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144251.381338:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783144251.381344:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783144251.381352:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381359:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381365:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381371:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144251.381376:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381384:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381394:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af5ef1b00) 00010000:00010000:2.0:1783144251.381396:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144251.381400:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381406:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a4230473bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144251.381434:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f50be94 reply state 000000007dd7de5a transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381443:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144251.381449:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2af5ef1400) 00010000:00010000:2.0:1783144251.381451:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144251.381454:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783144251.384458:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:66178:x1869759481644544:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 6901us (7134us total) trans 98784247809 rc 0/0 00000100:00100000:2.0:1783144251.384470:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1005 00000100:00100000:3.0:1783144251.399134:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.399205:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481644672 00000100:00100000:1.0:1783144251.399216:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481644672 00000100:00100000:1.0:1783144251.399302:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1006 00000100:00100000:1.0:1783144251.399312:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+8:66182:x1869759481644672:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144251.399334:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144251.399358:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a4230473d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419c4 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.399421:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a4230473d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.399437:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a4230473d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.399458:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a4230473d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144251.399505:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144251.399509:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144251.399527:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a4230473d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.399551:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a4230473d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419c4 expref: 10 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.399566:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a4230473d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419c4 expref: 9 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.399575:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af9e7a900) 00010000:00010000:1.0:1783144251.399577:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144251.399580:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c600, rc 0) 00000100:00100000:1.0:1783144251.399653:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+9:66182:x1869759481644672:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 333us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144251.399661:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1006 00000100:00100000:2.0:1783144251.404664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144251.404749:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481644800 00000100:00100000:3.0:1783144251.404758:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481644800 00000100:00100000:3.0:1783144251.404811:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1007 00000100:00100000:3.0:1783144251.404821:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+9:66182:x1869759481644800:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144251.404839:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144251.404858:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230473df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419cb expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.404918:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.404942:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.404954:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.404964:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.404970:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.404976:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405057:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230473f4 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405065:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230473f4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405072:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230473f4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144251.405113:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783144251.405116:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144251.405137:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230473f4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405149:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405164:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405171:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405177:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fa00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.405182:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405189:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405201:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af9e7a900) 00010000:00010000:3.0:1783144251.405204:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.405208:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405215:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fa00/0xad8e53a4230473e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405226:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405231:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405237:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405241:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fe00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.405249:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405255:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405263:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2af5ef1400) 00010000:00010000:3.0:1783144251.405266:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.405269:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405274:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a4230473ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405299:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230473df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419cb expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405311:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230473f4 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419cb expref: 10 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.405318:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:3.0:1783144251.405319:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144251.405322:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043ec00, rc 0) 00000100:00100000:3.0:1783144251.405373:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:66182:x1869759481644800:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 554us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144251.405381:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1007 00000100:00100000:0.0:1783144251.407964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.408026:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481645056 00000100:00100000:1.0:1783144251.408035:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481645056 00000100:00100000:1.0:1783144251.408093:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1008 00000100:00100000:1.0:1783144251.408103:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+10:66182:x1869759481645056:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144251.408120:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144251.408136:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a4230473fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419d2 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144251.408237:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783144251.408328:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a4230473fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419d2 expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.408341:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af9e7a900) 00010000:00010000:1.0:1783144251.408344:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783144251.408349:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a4230473fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419d2 expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.408360:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c800, rc 0) 00000100:00100000:1.0:1783144251.408416:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+11:66182:x1869759481645056:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 315us (459us total) trans 98784247810 rc 301/301 00000100:00100000:1.0:1783144251.408423:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1008 00000100:00100000:2.0:1783144251.413500:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.413559:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481645312 00000100:00100000:1.0:1783144251.413570:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481645312 00000100:00100000:1.0:1783144251.413637:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1009 00000100:00100000:1.0:1783144251.413663:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+11:66182:x1869759481645312:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1783144251.413715:0:81077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144251.413760:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230473f4 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419cb expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.413776:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:1.0:1783144251.413781:0:81077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144251.413799:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.413819:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.413829:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144251.413965:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a8b74c4b reply state 00000000d8657fc2 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.413977:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144251.413984:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:1.0:1783144251.413986:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1783144251.413988:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783144251.413996:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000100:00100000:1.0:1783144251.414070:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+12:66182:x1869759481645312:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 423us (586us total) trans 98784247811 rc 0/0 00000100:00100000:1.0:1783144251.414078:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1009 00000100:00100000:2.0:1783144251.417972:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.418023:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481645568 00000100:00100000:1.0:1783144251.418032:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481645568 00000100:00100000:1.0:1783144251.418086:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:1.0:1783144251.418097:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+12:66182:x1869759481645568:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1783144251.418853:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+13:66182:x1869759481645568:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 756us (887us total) trans 98784247812 rc 0/0 00000100:00100000:1.0:1783144251.418862:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 213 00000100:00100000:0.0:1783144251.492264:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144251.492320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.492407:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481645952 00000100:00100000:1.0:1783144251.492417:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481645952 00000100:00080000:0.0:1783144251.492503:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144251.492512:0:84991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481645696 00000100:00100000:3.0:1783144251.492518:0:84991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481645696 00000100:00100000:2.0:1783144251.492541:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.492546:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1952 00000100:00100000:1.0:1783144251.492560:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+5:2405:x1869759481645952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144251.492567:0:84991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1783144251.492575:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144251.492581:0:84991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad3fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2405:x1869759481645696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144251.492622:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481645824 00000100:00100000:0.0:1783144251.492627:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481645824 00000100:00100000:3.0:1783144251.492661:0:84991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad3fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2405:x1869759481645696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144251.492670:0:84991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1783144251.492683:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+5:2405:x1869759481645952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 125us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144251.492689:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 722 00000100:00100000:1.0:1783144251.492691:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1952 00000100:00100000:0.0:1783144251.492698:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481645824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144251.492715:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646080 00000100:00100000:1.0:1783144251.492718:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646080 00000100:00100000:1.0:1783144251.492761:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1953 00000100:00100000:1.0:1783144251.492769:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481646080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144251.492773:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481645824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144251.492780:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 722 00000100:00100000:1.0:1783144251.492796:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481646080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00080000:0.0:1783144251.492798:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144251.492802:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144251.492803:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1953 00000001:00080000:2.0:1783144251.847228:0:84981:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247812 is committed 00010000:00010000:3.0:1783144251.847309:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847322:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847330:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847337:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.847342:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847351:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847368:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2af5ef1400) 00010000:00010000:3.0:1783144251.847371:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.847376:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847381:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a4230473c3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847401:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847408:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847422:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847428:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.847432:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847439:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847447:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:3.0:1783144251.847450:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.847453:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847458:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516c00/0xad8e53a4230473ca lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847474:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847481:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847486:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847491:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.847494:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847651:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847663:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:3.0:1783144251.847743:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144251.847748:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.847754:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047409 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144251.887170:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.887254:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646208 00000100:00100000:1.0:1783144251.887263:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646208 00000100:00100000:1.0:1783144251.887321:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1010 00000100:00100000:1.0:1783144251.887332:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+7:66194:x1869759481646208:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144251.887371:0:66947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:1.0:1783144251.887440:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+7:66194:x1869759481646208:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144251.887448:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1010 00000100:00100000:3.0:1783144251.889427:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144251.889695:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646336 00000100:00100000:0.0:1783144251.889703:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646336 00000100:00100000:0.0:1783144251.889798:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1011 00000100:00100000:0.0:1783144251.889818:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:66194:x1869759481646336:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:0.0:1783144251.889859:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:0.0:1783144251.890382:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:66194:x1869759481646336:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 565us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144251.890390:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1011 00000100:00100000:2.0:1783144251.893245:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144251.893431:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646464 00000100:00100000:3.0:1783144251.893439:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646464 00000100:00100000:3.0:1783144251.893491:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1544 00000100:00100000:3.0:1783144251.893501:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:66194:x1869759481646464:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1783144251.893962:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144251.894018:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:66194:x1869759481646464:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 519us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144251.894026:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1544 00000100:00100000:3.0:1783144251.896095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144251.897623:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646592 00000100:00100000:1.0:1783144251.897633:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646592 00000100:00100000:1.0:1783144251.897698:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1545 00000100:00100000:1.0:1783144251.897714:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:66194:x1869759481646592:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144251.897779:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144251.897850:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:66194:x1869759481646592:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 143us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144251.897858:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1545 00000100:00100000:3.0:1783144251.937075:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144251.937107:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646848 00000100:00100000:3.0:1783144251.937115:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646848 00000100:00100000:3.0:1783144251.937162:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1012 00000100:00100000:3.0:1783144251.937172:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:66201:x1869759481646848:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00010000:3.0:1783144251.937225:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144251.937254:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a4230473d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419c4 expref: 7 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937269:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af9e7a900) 00010000:00010000:3.0:1783144251.937281:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144251.937337:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937350:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937360:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937371:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937379:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937385:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937752:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937761:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937768:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937774:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fe00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144251.937783:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937790:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937799:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af565c900) 00010000:00010000:3.0:1783144251.937803:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144251.937806:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937813:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043fe00/0xad8e53a423047410 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144251.937826:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0caf190 reply state 000000004f561613 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937836:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.937843:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af565c700) 00010000:00010000:3.0:1783144251.937845:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144251.937848:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783144251.937918:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+8:66201:x1869759481646848:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 746us (850us total) trans 98784247813 rc 0/0 00000100:00100000:3.0:1783144251.937925:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1012 00000100:00100000:3.0:1783144251.951110:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144251.952739:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646976 00000100:00100000:0.0:1783144251.952751:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646976 00000100:00100000:0.0:1783144251.952845:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1013 00000100:00100000:0.0:1783144251.952857:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:66204:x1869759481646976:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1783144251.952880:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144251.952901:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7600/0xad8e53a42304741e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419d9 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.952963:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423047425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.952977:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423047425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.952988:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423047425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144251.953032:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783144251.953036:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144251.953056:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423047425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.953081:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7600/0xad8e53a42304741e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419d9 expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.953113:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423047425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419d9 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.953122:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af5ef1e00) 00010000:00010000:0.0:1783144251.953125:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783144251.953128:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6e00, rc 0) 00000100:00100000:0.0:1783144251.953184:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+9:66204:x1869759481646976:12345-192.168.203.4@tcp:101:rm.0 Request processed in 329us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144251.953192:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1013 00000100:00100000:3.0:1783144251.955095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144251.955260:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481647104 00000100:00100000:0.0:1783144251.955267:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481647104 00000100:00100000:0.0:1783144251.955312:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1014 00000100:00100000:0.0:1783144251.955323:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+9:66204:x1869759481647104:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1783144251.955338:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144251.955352:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a42304742c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419e0 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955400:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955510:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955521:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955534:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955552:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955559:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955632:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423047441 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955650:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423047441 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955658:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423047441 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144251.955694:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783144251.955698:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144251.955711:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423047441 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955745:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423047441 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955757:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955763:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955769:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955786:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955793:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144251.955797:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955806:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955817:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af5ef1e00) 00010000:00010000:0.0:1783144251.955820:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144251.955824:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955831:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423047433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955842:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955848:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955854:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955859:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144251.955862:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955879:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955887:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af565c700) 00010000:00010000:0.0:1783144251.955889:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144251.955892:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955898:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a42304743a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955920:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a42304742c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419e0 expref: 11 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955932:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423047441 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419e0 expref: 10 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.955940:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2af5ef1800) 00010000:00010000:0.0:1783144251.955942:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144251.955944:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6200, rc 0) 00000100:00100000:0.0:1783144251.955993:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:66204:x1869759481647104:12345-192.168.203.4@tcp:101:rm.0 Request processed in 672us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144251.955999:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1014 00000100:00100000:3.0:1783144251.959796:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144251.960317:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481647360 00000100:00100000:0.0:1783144251.960324:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481647360 00000100:00100000:0.0:1783144251.960380:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1015 00000100:00100000:0.0:1783144251.960390:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:66204:x1869759481647360:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1783144251.960498:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783144251.960521:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423047441 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419e0 expref: 10 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960536:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2af5ef1800) 00010000:00010000:0.0:1783144251.960551:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6e00/0xad8e53a423047425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419d9 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960558:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af5ef1e00) 00010000:00010000:0.0:1783144251.960563:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144251.960581:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960592:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960599:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960609:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960616:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960622:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960697:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960714:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960749:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960913:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960920:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960925:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960930:0:66143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960934:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960937:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960959:0:66143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144251.960974:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960980:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960985:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.960997:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144251.961002:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961009:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961017:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2af5ef1c00) 00010000:00010000:0.0:1783144251.961020:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783144251.961023:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961028:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7200/0xad8e53a423047456 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961042:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961047:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961053:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961058:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144251.961061:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961067:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961086:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af5ef1200) 00010000:00010000:0.0:1783144251.961088:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144251.961091:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961096:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a423047448 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144251.961109:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068f766fd reply state 00000000d82c8c1f transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.961111:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144251.961116:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961119:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144251.961125:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af565c700) 00010000:00010000:3.0:1783144251.961127:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144251.961127:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144251.961130:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144251.961131:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.961136:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.961144:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2af5ef1c00) 00010000:00010000:3.0:1783144251.961146:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783144251.961148:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.961153:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304745d lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144251.961165:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144251.961166:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144251.961168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144251.961247:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:66204:x1869759481647360:12345-192.168.203.4@tcp:36:rm.0 Request processed in 798us (1400us total) trans 98784247814 rc 0/0 00000100:00100000:0.0:1783144251.961254:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1015 00010000:00010000:1.0:1783144252.366272:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144252.941903:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501257472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144252.941968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.942006:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144252.942013:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501257600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144252.942041:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.942074:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501257728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144252.942103:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.942493:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501258240:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.942520:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.942547:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501258752:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.942569:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144252.942653:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501258240 00000100:00100000:3.0:1783144252.942660:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501258240 00000100:00100000:3.0:1783144252.942713:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1783144252.942741:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501258240:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783144252.942777:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef92e680 x1869759501258240/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:363/0 lens 224/224 e 0 to 0 dl 1783144263 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144252.942813:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501258240:12345-0@lo:400:kworker.0 Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144252.942819:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00080000:3.0:1783144252.942840:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144252.942907:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501259264:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.942927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.942964:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501258240:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.942976:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783144252.942981:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501257856:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.943003:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.943025:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501258368:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.943041:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.943054:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501258880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144252.943080:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.943103:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257472 00000100:00100000:1.0:1783144252.943107:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257472 00000100:00100000:1.0:1783144252.943131:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501258880 00000100:00100000:1.0:1783144252.943133:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501258880 00000100:00100000:1.0:1783144252.943149:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:1.0:1783144252.943154:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501257472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783144252.943169:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144252.943194:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501257472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.943200:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:1.0:1783144252.943211:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1783144252.943216:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501258880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144252.943225:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144252.943246:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501258880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.943252:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1783144252.943265:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257600 00000100:00100000:1.0:1783144252.943268:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257600 00000100:00100000:1.0:1783144252.943286:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257728 00000100:00100000:1.0:1783144252.943288:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257728 00000100:00100000:1.0:1783144252.943300:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:1.0:1783144252.943305:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501257600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783144252.943326:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:1.0:1783144252.943354:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501257600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.943360:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:1.0:1783144252.943377:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:1.0:1783144252.943383:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501257728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144252.943397:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00010000:00000080:1.0:1783144252.943405:0:8447:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c61ff100 x1869759501257728/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:363/0 lens 224/368 e 0 to 0 dl 1783144263 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144252.943428:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501257728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.943434:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:1.0:1783144252.943451:0:84986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257856 00000100:00100000:1.0:1783144252.943454:0:84986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257856 00000100:00100000:1.0:1783144252.943474:0:84986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783144252.943479:0:84986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac2ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501257856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.943502:0:84986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac2ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501257856:12345-0@lo:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.943508:0:84986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783144252.943528:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501259264 00000100:00100000:1.0:1783144252.943531:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501259264 00000100:00100000:1.0:1783144252.943546:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501258368 00000100:00100000:1.0:1783144252.943548:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501258368 00000100:00100000:1.0:1783144252.943563:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1783144252.943568:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501259264:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783144252.943578:0:66113:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef92d880 x1869759501259264/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:363/0 lens 224/224 e 0 to 0 dl 1783144263 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144252.943600:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501259264:12345-0@lo:400:kworker.0 Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.943605:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1783144252.943620:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1783144252.943625:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501258368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.943660:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501258368:12345-0@lo:400:kworker.0 Request processed in 35us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.943665:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1783144252.943708:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501258112:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.943748:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.943762:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501258624:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.943782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144252.943826:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501258112 00000100:00100000:3.0:1783144252.943830:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501258112 00000100:00100000:3.0:1783144252.943853:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1783144252.943858:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501258112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144252.943882:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501258112:12345-0@lo:400:kworker.0 Request processed in 24us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144252.943888:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00080000:3.0:1783144252.943906:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144252.943909:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144252.943911:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144252.944063:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501259136:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144252.944144:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501258752 00000100:00100000:2.0:1783144252.944148:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501258752 00000100:00100000:2.0:1783144252.944178:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501258624 00000100:00100000:2.0:1783144252.944180:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501258624 00000100:00100000:2.0:1783144252.944196:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:2.0:1783144252.944202:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501258752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144252.944232:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501258752:12345-0@lo:400:kworker.0 Request processed in 31us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144252.944238:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:2.0:1783144252.944257:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:2.0:1783144252.944262:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501258624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144252.944288:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501258624:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144252.944294:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:1.0:1783144252.944381:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501258112:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944392:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501258624:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944404:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783144252.944410:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501257984:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944430:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.944447:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501258496:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944466:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.944481:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501259008:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944498:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144252.944517:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501257984 00000100:00100000:1.0:1783144252.944520:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501257984 00000100:00100000:1.0:1783144252.944544:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501259008 00000100:00100000:1.0:1783144252.944547:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501259008 00000100:00100000:1.0:1783144252.944562:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1783144252.944574:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869759501257984:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783144252.944586:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4ea4380 x1869759501257984/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:363/0 lens 224/224 e 0 to 0 dl 1783144263 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144252.944617:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869759501257984:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.944623:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1783144252.944646:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1783144252.944652:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501259008:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783144252.944663:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4ea4000 x1869759501259008/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:363/0 lens 224/224 e 0 to 0 dl 1783144263 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144252.944684:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501259008:12345-0@lo:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.944690:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1783144252.944742:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501257600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144252.944765:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968823 gen 2 00000100:00100000:1.0:1783144252.944780:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501257472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144252.944800:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501258496 00000100:00100000:1.0:1783144252.944803:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501258496 00000100:00100000:1.0:1783144252.944822:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:1.0:1783144252.944827:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501258496:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783144252.944838:0:8447:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4ea4700 x1869759501258496/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:363/0 lens 224/224 e 0 to 0 dl 1783144263 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144252.944863:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501258496:12345-0@lo:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144252.944877:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:1.0:1783144252.944903:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501257984:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944912:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501258496:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944920:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501259008:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944946:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501257856:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944956:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501258368:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944964:0:3650:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968823 gen 2 00000100:00100000:1.0:1783144252.944975:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501258880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144252.944985:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501258752:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.944995:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501259264:0@lo:400:kworker.0 00000100:00100000:1.0:1783144252.945005:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501257728:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1783144252.945042:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783144252.945046:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144252.945048:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144252.945131:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501259136 00000100:00100000:2.0:1783144252.945135:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501259136 00000100:00100000:2.0:1783144252.945159:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1783144252.945165:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501259136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144252.945199:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501259136:12345-0@lo:400:kworker.0 Request processed in 34us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144252.945206:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1783144252.945232:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501259136:0@lo:400:kworker.0 00010000:00010000:3.0:1783144253.390027:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144253.965846:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144253.965856:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144253.965872:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501259520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144253.965873:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501259392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144253.965951:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144253.966047:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144253.966203:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501259520 00000100:00100000:2.0:1783144253.966209:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501259520 00000100:00100000:2.0:1783144253.966270:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501259392 00000100:00100000:2.0:1783144253.966272:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501259392 00000100:00100000:3.0:1783144253.966311:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1783144253.966319:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501259520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144253.966345:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144253.966383:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501259520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144253.966388:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1783144253.966402:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:3.0:1783144253.966406:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501259392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144253.966417:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144253.966436:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501259392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144253.966440:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:3.0:1783144253.966477:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501259520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144253.966554:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501259392:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144254.415074:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783144255.209457:0:86199:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1783144255.240554:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144255.240657:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481647488 00000100:00100000:2.0:1783144255.240667:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481647488 00000100:00080000:3.0:1783144255.240713:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144255.240748:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1016 00000100:00100000:2.0:1783144255.240758:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+10:66271:x1869759481647488:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144255.240777:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144255.240793:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423047464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419e7 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.240854:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a42304746b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.240864:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a42304746b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.240873:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a42304746b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144255.240910:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144255.240914:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144255.240946:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a42304746b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.240975:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423047464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419e7 expref: 12 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.240990:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a42304746b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419e7 expref: 11 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.240998:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ad48e8b00) 00010000:00010000:2.0:1783144255.241001:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144255.241004:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517600, rc 0) 00010000:00000080:2.0:1783144255.241011:0:66114:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb7480 x1869759481647488/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:366/0 lens 576/688 e 0 to 0 dl 1783144266 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144255.241071:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+11:66271:x1869759481647488:12345-192.168.203.4@tcp:101:touch.0 Request processed in 316us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144255.241077:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1016 00000100:00100000:3.0:1783144255.243633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144255.243803:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481647616 00000100:00100000:0.0:1783144255.243811:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481647616 00000100:00100000:0.0:1783144255.243861:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1017 00000100:00100000:0.0:1783144255.243871:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:66271:x1869759481647616:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144255.243889:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144255.243907:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8a00/0xad8e53a423047472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419ee expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.243962:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.243981:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.243992:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244006:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244014:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244021:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244092:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a423047487 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244101:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a423047487 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244108:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a423047487 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144255.244141:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783144255.244144:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144255.244167:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a423047487 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244178:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244194:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244200:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244206:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144255.244210:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244218:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244230:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ad48e8b00) 00010000:00010000:0.0:1783144255.244233:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144255.244238:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244243:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423047479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244254:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244260:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244267:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244271:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144255.244279:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244285:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244294:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c29c3f4d600) 00010000:00010000:0.0:1783144255.244296:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144255.244299:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244305:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9600/0xad8e53a423047480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244334:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8a00/0xad8e53a423047472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419ee expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244348:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a423047487 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419ee expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.244355:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c29c3f4d100) 00010000:00010000:0.0:1783144255.244357:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783144255.244359:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9400, rc 0) 00010000:00000080:0.0:1783144255.244366:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb7800 x1869759481647616/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:366/0 lens 592/688 e 0 to 0 dl 1783144266 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144255.244553:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+12:66271:x1869759481647616:12345-192.168.203.4@tcp:101:touch.0 Request processed in 683us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144255.244560:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1017 00000100:00100000:3.0:1783144255.246903:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144255.247027:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481647872 00000100:00100000:0.0:1783144255.247042:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481647872 00000100:00100000:0.0:1783144255.247092:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1018 00000100:00100000:0.0:1783144255.247103:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+12:66271:x1869759481647872:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144255.247122:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144255.247150:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a42304748e lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419f5 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247243:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247256:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247265:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247278:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247284:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247290:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247687:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247696:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.247703:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144255.247809:0:81077:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1783144255.247813:0:81077:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 0 -> 1783144255 00000004:00010000:1.0:1783144255.247815:0:81077:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 0 -> 1783144255 00000004:00010000:1.0:1783144255.247818:0:81077:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 0 -> 1783144255 00000004:00010000:1.0:1783144255.247820:0:81077:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:1.0:1783144255.247824:0:81077:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:1.0:1783144255.247830:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247848:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247854:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247859:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144255.247863:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247870:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247883:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c29c3f4d100) 00010000:00010000:1.0:1783144255.247886:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144255.247890:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247895:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423047495 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144255.247907:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096afa052 reply state 00000000af95a2fc transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247917:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247924:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c29c3f4d900) 00010000:00010000:1.0:1783144255.247926:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144255.247928:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144255.247957:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a42304748e lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 15 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247977:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 14 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144255.247984:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c29c3f4d000) 00010000:00010000:1.0:1783144255.247986:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1783144255.247988:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8c00, rc 0) 00010000:00000080:1.0:1783144255.247995:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb6680 x1869759481647872/t98784247815(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:366/0 lens 752/824 e 0 to 0 dl 1783144266 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144255.248052:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+15:66271:x1869759481647872:12345-192.168.203.4@tcp:101:touch.0 Request processed in 952us (1156us total) trans 98784247815 rc 0/0 00000100:00100000:1.0:1783144255.248059:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1018 00000100:00100000:3.0:1783144255.250947:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144255.251012:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481648128 00000100:00100000:0.0:1783144255.251020:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481648128 00000100:00100000:0.0:1783144255.251104:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1019 00000100:00100000:0.0:1783144255.251114:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+15:66271:x1869759481648128:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144255.251206:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.251222:0:66947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 15 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.251230:0:66947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.251263:0:66947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 15 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.251276:0:66947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 15 pid: 81077 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144255.251290:0:66947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:66947:1869759501259648:192.168.203.4@tcp:104: 00000100:00100000:0.0:1783144255.251355:0:66947:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af07383c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144255.253283:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144255.253354:0:66947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:66947:1869759501259648:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144255.253373:0:66947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144255.253552:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481648256 00000100:00100000:2.0:1783144255.253558:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481648256 00010000:00010000:2.0:1783144255.253583:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 16 pid: 81077 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144255.253628:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2537 00000100:00100000:2.0:1783144255.253638:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cace81e7-a6f2-4d37-b197-caf34583781c+16:2404:x1869759481648256:12345-192.168.203.4@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1783144255.253651:0:6507:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 16 pid: 81077 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.253662:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 16 pid: 81077 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.253672:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 16 pid: 81077 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.253685:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c29c3f4d000) 00010000:00010000:2.0:1783144255.253688:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783144255.253692:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.253700:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.253707:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144255.253744:0:6507:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 16 pid: 81077 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144255.253794:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cace81e7-a6f2-4d37-b197-caf34583781c+16:2404:x1869759481648256:12345-192.168.203.4@tcp:102:ldlm_bl.0 Request processed in 158us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144255.253802:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2537 00010000:00010000:0.0:1783144255.254775:0:66947:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.254784:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144255.255115:0:66947:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1783144255.255119:0:66947:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 1783144255 -> 1783144255 00000004:00010000:0.0:1783144255.255122:0:66947:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 1783144255 -> 1783144255 00000004:00010000:0.0:1783144255.255124:0:66947:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 1783144255 -> 1783144255 00000004:00010000:0.0:1783144255.255126:0:66947:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1783144255.255134:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000480a6c00 reply state 00000000c8111999 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.255148:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144255.255155:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c29c3f4d000) 00010000:00010000:0.0:1783144255.255158:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144255.255161:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783144255.255207:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb4700 x1869759481648128/t98784247816(0) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:366/0 lens 488/456 e 0 to 0 dl 1783144266 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144255.255254:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+17:66271:x1869759481648128:12345-192.168.203.4@tcp:36:touch.0 Request processed in 4141us (4314us total) trans 98784247816 rc 0/0 00000100:00100000:0.0:1783144255.255261:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1019 00000100:00100000:1.0:1783144255.258193:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144255.258272:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481648512 00000100:00100000:0.0:1783144255.258281:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481648512 00000100:00100000:0.0:1783144255.258365:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:0.0:1783144255.258377:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+17:66271:x1869759481648512:12345-192.168.203.4@tcp:35:touch.0 00010000:00000080:0.0:1783144255.258556:0:80989:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4ea4e00 x1869759481648512/t98784247817(0) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:366/0 lens 392/456 e 0 to 0 dl 1783144266 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144255.258610:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+18:66271:x1869759481648512:12345-192.168.203.4@tcp:35:touch.0 Request processed in 236us (424us total) trans 98784247817 rc 0/0 00000100:00100000:0.0:1783144255.258635:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 214 00010000:00010000:1.0:1783144255.437942:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783144256.166579:0:86297:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783144256.166646:0:86297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.166660:0:86297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.166667:0:86297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.166674:0:86297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.166688:0:86297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783144256.166693:0:86297:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783144256.166718:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783144256.166737:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783144256.166743:0:86297:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783144256.166777:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2aee190000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783144256.166834:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144256.166842:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.166851:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ee00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144256.166854:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.166862:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144256.166870:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144256.166893:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783144256.166895:0:9525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783144256.166897:0:9525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783144256.166923:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.166930:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144256.166949:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.166957:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a42304702e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047035 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.166969:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.166971:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.166973:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144256.166988:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501259904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144256.167050:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144256.167115:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501259904 00000100:00100000:1.0:1783144256.167121:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501259904 00000100:00100000:1.0:1783144256.167165:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1783144256.167173:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501259904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144256.167187:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144256.167200:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f6600/0xad8e53a423047035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304702e expref: 24 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.167211:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144256.167243:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3649:x1869759501259904:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144256.167256:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1783144256.167295:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501259904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144256.167602:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501259776:0@lo:39:umount.0 00000100:00100000:3.0:1783144256.167649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144256.167796:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501259776 00000100:00100000:2.0:1783144256.167801:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501259776 00000100:00100000:2.0:1783144256.167959:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1783144256.167968:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501259776:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783144256.167991:0:66113:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047131 00000100:00080000:2.0:1783144256.168012:0:66113:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1783144256.168042:0:66113:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5513800 x1869759501259776/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:367/0 lens 224/224 e 0 to 0 dl 1783144267 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144256.168092:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1869759501259776:12345-0@lo:39:umount.0 Request processed in 127us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144256.168100:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000020:00000080:2.0:1783144256.168109:0:66113:0:(genops.c:906:class_export_put()) final put ffff9c29c5a46800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1783144256.168125:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aee190000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783144256.168139:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501259776:0@lo:39:umount.0 00000100:00080000:1.0:1783144256.168175:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144256.168178:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783144256.168181:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783144256.168705:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144256.168867:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5a46800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144256.168914:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c5a45800 for lustre-MDT0000 00010000:00010000:1.0:1783144256.169497:0:86297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169509:0:86297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169517:0:86297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169524:0:86297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169542:0:86297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144256.169548:0:86297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169554:0:86297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169560:0:86297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169575:0:86297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169596:0:86297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144256.169603:0:86297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.169620:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144256.169623:0:86297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.169628:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169634:0:86297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.169642:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6400 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:1.0:1783144256.169646:0:86297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144256.169648:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.169668:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144256.169676:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144256.169681:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144256.169682:0:86297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783144256.169684:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783144256.169691:0:86297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169700:0:86297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169706:0:86297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169710:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144256.169710:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169713:0:86297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169717:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.169756:0:86297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783144256.169760:0:86297:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783144256.169763:0:86297:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1783144256.169790:0:86297:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1783144256.169845:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151a00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:3.0:1783144256.169849:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169856:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144256.169863:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.169875:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:3.0:1783144256.169878:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144256.169880:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144256.169881:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783144256.169883:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783144256.169886:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fa00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144256.169888:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.169895:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169898:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144256.169902:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169904:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1783144256.169907:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783144256.169909:0:9525:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783144256.169910:0:9525:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783144256.169921:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.169922:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169928:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2b02151a00/0xad8e53a423047051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047058 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.169928:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144256.169933:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169939:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144256.169939:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423047020 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047027 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169943:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.169948:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:3.0:1783144256.169951:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.169956:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144256.169958:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.169958:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144256.169959:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1783144256.169964:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144256.169970:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783144256.169972:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783144256.169974:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:01000000:1.0:1783144256.169988:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1783144256.169993:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1783144256.169994:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:1.0:1783144256.169999:0:86297:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1783144256.170000:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144256.170026:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144256.170034:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144256.170040:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423046f40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046f47 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144256.170047:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501260416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144256.170048:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.170051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144256.170053:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144256.170056:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144256.170062:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6400/0xad8e53a423046f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423046f55 expref: -99 pid: 84980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144256.170068:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501260160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144256.170087:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144256.170090:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144256.170093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144256.170098:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144256.170100:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501260288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144256.170125:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260416 00000100:00100000:3.0:1783144256.170130:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144256.170133:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260416 00000100:00100000:0.0:1783144256.170143:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144256.170152:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501260032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144256.170169:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260288 00000100:00100000:3.0:1783144256.170173:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260288 00000100:00100000:2.0:1783144256.170176:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1783144256.170186:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501260416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144256.170197:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144256.170210:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98f800/0xad8e53a423046f47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046f40 expref: 24 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144256.170211:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1783144256.170224:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3651:x1869759501260288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144256.170225:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144256.170235:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144256.170247:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7e00/0xad8e53a423047027 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047020 expref: 23 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144256.170258:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144256.170259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3648:x1869759501260416:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144256.170269:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1783144256.170293:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3651:x1869759501260288:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144256.170299:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00010000:00010000:3.0:1783144256.170318:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144256.170334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144256.170377:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501260288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144256.170896:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144256.170935:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501260416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144256.170939:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260160 00000100:00100000:3.0:1783144256.170945:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260160 00000100:00100000:0.0:1783144256.170964:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260032 00000100:00100000:0.0:1783144256.170969:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260032 00000100:00100000:3.0:1783144256.170979:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1783144256.170989:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3650:x1869759501260160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144256.170999:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783144256.171001:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00010000:00010000:3.0:1783144256.171012:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047051 expref: 22 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144256.171013:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3648:x1869759501260032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144256.171026:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144256.171028:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144256.171038:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98f400/0xad8e53a423046f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423046f4e expref: 21 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.171050:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144256.171063:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3650:x1869759501260160:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144256.171071:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1783144256.171086:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3648:x1869759501260032:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144256.171093:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1783144256.171102:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501260160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144256.171126:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501260032:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1783144256.173217:0:86297:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1783144256.174008:0:84981:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00000020:00000080:3.0:1783144256.174138:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1783144256.174147:0:86297:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2affdde000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144256.174153:0:86297:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2af728f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783144256.174189:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174200:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174214:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174221:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144256.174227:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174237:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174256:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af565c700) 00010000:00010000:0.0:1783144256.174259:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144256.174264:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174271:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a423047417 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174290:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174296:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174301:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174307:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144256.174310:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174328:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174337:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af565c700) 00010000:00010000:0.0:1783144256.174339:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144256.174343:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174350:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a42304744f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174372:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174379:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174387:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174392:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144256.174396:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174401:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174409:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c29c3f4d900) 00010000:00010000:0.0:1783144256.174411:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144256.174414:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174426:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a42304749c lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174442:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174448:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174455:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783144256.174457:0:86297:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2af5ddd800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783144256.174460:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8200 already unused, calling callback (ffffffffc18154f0) 00000020:00080000:3.0:1783144256.174462:0:86297:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aef583800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783144256.174463:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783144256.174469:0:86297:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aef586000 cace81e7-a6f2-4d37-b197-caf34583781c 192.168.203.4@tcp 9 (0 0 3) 0 0 0 0: 0000000000000000 98784247817 stale:0 00010000:00010000:0.0:1783144256.174469:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783144256.174475:0:86297:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c29c31e0000) has exports, disconnecting them 00000020:00080000:3.0:1783144256.174485:0:86297:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2affdde000), last request at 1783144242 00010000:00010000:0.0:1783144256.174487:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c29c3f4d000) 00010000:00010000:0.0:1783144256.174489:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00000080:3.0:1783144256.174492:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304712a 00010000:00010000:0.0:1783144256.174492:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.174497:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230474b1 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783144256.174498:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2affddf800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783144256.174518:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783144256.174520:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2affdde000): rc 0 00000020:00000080:3.0:1783144256.174523:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2affdde000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783144256.174545:0:86297:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2af728f000), last request at 1783144252 00000020:00000080:3.0:1783144256.174549:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047123 00000100:00080000:3.0:1783144256.174554:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2af728f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783144256.174566:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2af728f000): rc 0 00000020:00000080:3.0:1783144256.174567:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2af728f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783144256.174572:0:86297:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2af5ddd800), last request at 1783144252 00000020:00000080:3.0:1783144256.174575:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304711c 00000100:00080000:3.0:1783144256.174580:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2af5dda000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783144256.174596:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2af5ddd800): rc 0 00000020:00000080:3.0:1783144256.174598:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2af5ddd800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1783144256.174600:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783144256.174602:0:86297:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2aef583800), last request at 1783144237 00000020:00000080:3.0:1783144256.174620:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fa2 00000100:00080000:3.0:1783144256.174630:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2affddf000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783144256.174633:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.174661:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144256.174700:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2affdde000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783144256.174761:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783144256.174786:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5ddd800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783144256.175084:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2affddf800 for lustre-MDT0000 00000020:00000080:2.0:1783144256.175091:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af728f800 for lustre-MDT0000 00000020:00000080:2.0:1783144256.175093:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5dda000 for lustre-MDT0000 00000020:00080000:3.0:1783144256.175284:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aef583800): rc 0 00000020:00000080:3.0:1783144256.175286:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2aef583800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1783144256.175296:0:86297:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.4@tcp (ffff9c2aef586000), last request at 1783144255 00000020:00000080:3.0:1783144256.175301:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f9b 00000020:00000080:0.0:1783144256.175301:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aef583800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00010000:3.0:1783144256.175308:0:86297:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2aef586000: total 1 00000100:00080000:3.0:1783144256.175311:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2af728e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783144256.175322:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2aef586000): rc 0 00000004:00000080:3.0:1783144256.175332:0:86297:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc16280d93ae0 00000020:00000080:0.0:1783144256.175334:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2affddf000 for lustre-MDT0000 00000100:00080000:3.0:1783144256.175348:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783144256.175352:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:0.0:1783144256.175352:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2aef586000: total 0 00010000:00010000:0.0:1783144256.175397:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2aef586000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1783144256.175421:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a42304746b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419e7 expref: 4 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.175441:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230474a3 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 3 pid: 81077 timeout: 2889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.175458:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a423047487 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419ee expref: 2 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144256.175470:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2aef586000, canceled 3 locks, left on hash table 0. 00000100:00080000:3.0:1783144256.178035:0:86297:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783144256.178068:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b25800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783144256.178118:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501260544:0@lo:39:umount.0 00000100:00100000:1.0:1783144256.178199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144256.178430:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144256.178445:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968823 gen 3 00000004:00080000:3.0:1783144256.178463:0:86297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783144256.178578:0:86297:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783144256.178589:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783144256.178681:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501260672:0@lo:9:umount.0 00000100:00100000:1.0:1783144256.178708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144256.178777:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260544 00000100:00100000:1.0:1783144256.178784:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260544 00000100:00100000:1.0:1783144256.178838:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:1.0:1783144256.178847:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501260544:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783144256.178873:0:78024:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fe1 00000100:00080000:1.0:1783144256.178881:0:78024:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783144256.178897:0:78024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378731 00000100:00100000:1.0:1783144256.179028:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1869759501260544:12345-0@lo:39:umount.0 Request processed in 182us (828us total) trans 81604378732 rc 0/0 00000100:00100000:1.0:1783144256.179036:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00080000:1.0:1783144256.179083:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b25800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783144256.179088:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501260544:0@lo:39:umount.0 00010000:00010000:1.0:1783144256.179113:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144256.179138:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260672 00000100:00100000:2.0:1783144256.179143:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260672 00000100:00100000:2.0:1783144256.179194:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923 00000100:00100000:2.0:1783144256.179204:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501260672:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783144256.179218:0:26144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fef 00000100:00080000:2.0:1783144256.179231:0:26144:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d67800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783144256.179268:0:26144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968823 00000100:00100000:2.0:1783144256.179362:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501260672:12345-0@lo:9:umount.0 Request processed in 161us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144256.179369:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923 00000100:00080000:1.0:1783144256.179404:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144256.179424:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783144256.179440:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783144256.179442:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783144256.179445:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501260672:0@lo:9:umount.0 00010000:00010000:1.0:1783144256.179479:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144256.179747:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144256.179750:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968823 gen 3 00000004:00080000:3.0:1783144256.179801:0:86297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783144256.179911:0:86297:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783144256.179921:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d53000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783144256.179976:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c29c31e0000) has no exports 00000100:00100000:2.0:1783144256.180275:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501260800:0@lo:9:umount.0 00000100:00100000:2.0:1783144256.180310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144256.180364:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260800 00000100:00100000:3.0:1783144256.180369:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260800 00000100:00100000:3.0:1783144256.180407:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4924 00000100:00100000:3.0:1783144256.180416:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501260800:12345-0@lo:9:umount.0 00000100:00080000:2.0:1783144256.180418:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1783144256.180431:0:26139:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304700b 00000100:00080000:3.0:1783144256.180456:0:26139:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d65000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783144256.180487:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1783144256.180490:0:26139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968823 00000100:00100000:3.0:1783144256.180594:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501260800:12345-0@lo:9:umount.0 Request processed in 179us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144256.180600:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4924 00000100:00080000:2.0:1783144256.180739:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d53000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783144256.180747:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783144256.180748:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144256.180808:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501260800:0@lo:9:umount.0 00000020:00080000:3.0:1783144256.182017:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c29c31e0000) has no exports 00000020:00000080:0.0:1783144256.196142:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c2aef586000/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:1.0:1783144256.196229:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aef586000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-MDT0000 00000020:00000080:1.0:1783144256.196290:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af728e800 for lustre-MDT0000 00010000:00010000:1.0:1783144256.196302:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.196304:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.196307:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783144256.221085:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fb7 00000020:00000080:3.0:1783144256.221102:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2b017f6000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783144256.221185:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783144256.221235:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144256.221248:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783144256.221252:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c2aee593380) has no exports 00000020:00000080:2.0:1783144256.221434:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2b017f6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783144256.221545:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fb0 00000020:00000080:3.0:1783144256.221551:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2aefdd8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144256.221606:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144256.221637:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783144256.221640:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b26800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783144256.221643:0:86297:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b26800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783144256.221649:0:86297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1783144256.221916:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefdd8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783144256.221972:0:86297:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af7a14120 - data ffff9c2afa73faf8/ffff9c29c6f89000 00000020:01000000:3.0:1783144256.222105:0:86297:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c29c5312300 - data ffff9c2ad4108000/ffff9c29c4ef5800 00000100:00080000:3.0:1783144256.257318:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783144256.257327:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783144256.257342:0:86297:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c29c60b7b80 x1869759501260544/t81604378732(81604378732) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144266 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144256.257368:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783144256.258410:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144256.258414:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968823 gen 4 00000004:00080000:3.0:1783144256.258466:0:86297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144256.258469:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783144256.259044:0:84999:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783144256.259050:0:84999:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:1.0:1783144256.259059:0:84999:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:3.0:1783144256.259509:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144256.259513:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968823 gen 4 00000004:00080000:3.0:1783144256.259528:0:86297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144256.259531:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783144256.260194:0:85001:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783144256.260198:0:85001:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:1.0:1783144256.260205:0:85001:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:0.0:1783144256.261316:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f6a 00000020:00000080:0.0:1783144256.261326:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c29c3408000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144256.261348:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c3408000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783144256.261925:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f86 00000020:00000080:0.0:1783144256.261930:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2afab22000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783144256.261940:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783144256.261945:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144256.261956:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1783144256.261958:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afab22000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00080000:0.0:1783144256.261960:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c29c31e4d40) has no exports 00000004:01000000:0.0:1783144256.262077:0:86297:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783144256.262083:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047004 00000020:00000080:0.0:1783144256.262086:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d57000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783144256.262094:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783144256.262098:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144256.262106:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783144256.262108:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c29c3568000) has no exports 00000020:00000080:0.0:1783144256.262114:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046ffd 00000020:00000080:1.0:1783144256.262115:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d57000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783144256.262117:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d57800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144256.262184:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d57800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144256.262440:0:86297:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783144256.262452:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783144256.262456:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968823 gen 5 00000004:00080000:0.0:1783144256.262460:0:86297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144256.262462:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144256.262502:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144256.262510:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144256.262514:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fe8 00000020:00000080:0.0:1783144256.262518:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c29c496d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783144256.262521:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783144256.262524:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144256.262533:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1783144256.262567:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac5d53000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783144256.262573:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c29c496a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144256.262575:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783144256.262579:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144256.262664:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00080000:0.0:1783144256.262689:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c29c356cd40) has no exports 00000020:00000080:0.0:1783144256.262693:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fda 00000020:00000080:0.0:1783144256.262696:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2ac317c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144256.262840:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac317c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144256.263059:0:86297:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783144256.263062:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783144256.263065:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968823 gen 5 00000004:00080000:0.0:1783144256.263068:0:86297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144256.263069:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144256.263134:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144256.263141:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783144256.263149:0:86297:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783144256.263153:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fcc 00000020:00000080:0.0:1783144256.263156:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2aefdda800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144256.263173:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac317e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783144256.263177:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2aefdd9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144256.263179:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefdd9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783144256.263182:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783144256.263258:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783144256.263261:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144256.263266:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783144256.263268:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c2aee594d40) has no exports 00000020:00000080:0.0:1783144256.263272:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046fc5 00000020:00000080:0.0:1783144256.263275:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2ad085f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144256.263291:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefdda800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783144256.263426:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad085f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783144256.264782:0:86297:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1783144256.264786:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783144256.264788:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783144256.264792:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144256.264875:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144256.264883:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144256.264904:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144256.264908:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144256.264911:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144256.264914:0:86297:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783144256.264919:0:86297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144256.264983:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f8d 00000020:00000080:1.0:1783144256.264989:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2afab21000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783144256.265007:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ae4b25800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783144256.265013:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c29c340c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144256.265016:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c340c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783144256.265020:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783144256.265106:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783144256.265110:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144256.265114:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783144256.265117:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c29c31e3380) has no exports 00000020:00000080:1.0:1783144256.265133:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144256.265137:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783144256.265140:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f94 00000020:00000080:1.0:1783144256.265143:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2afab20800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783144256.265149:0:86297:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2af71e6800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783144256.265152:0:86297:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af71e6800 3 00000020:01000004:1.0:1783144256.265155:0:86297:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2af71e6800 from lustre-MDT0000 00000020:00000080:1.0:1783144256.265176:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144256.265183:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783144256.265186:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c29c3408800/lustre-MDT0000_UUID 00000020:00000080:3.0:1783144256.265208:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afab21000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783144256.265212:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2aefa79000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783144256.265214:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa79000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783144256.265218:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783144256.265250:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afab20800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144256.265269:0:86297:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c3408800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783144256.265276:0:86297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783144256.265306:0:86297:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783144256.265310:0:86297:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783144256.265313:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783144256.265316:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144256.265330:0:86297:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783144256.265340:0:86297:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2af7288800 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 192.168.203.4@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144256.265346:0:86297:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2aef585800 4e9e4714-8000-4c64-bed6-3cadd5fdfc80 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144256.265350:0:86297:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9c2ad08db380) has exports, disconnecting them 00000020:00080000:1.0:1783144256.265354:0:86297:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.4@tcp (ffff9c2af7288800), last request at 1783144241 00000020:00000080:1.0:1783144256.265370:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047115 00000020:00010000:1.0:1783144256.265375:0:86297:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2af7288800: total 0 00000100:00080000:1.0:1783144256.265378:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2af728e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144256.265392:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2af7288800): rc 0 00000020:00080000:1.0:1783144256.265395:0:86297:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2aef585800), last request at 1783144237 00000020:00000080:1.0:1783144256.265426:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f32 00000020:00010000:1.0:1783144256.265429:0:86297:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2aef585800: total 0 00000100:00080000:1.0:1783144256.265431:0:86297:0:(import.c:65:import_set_state_nolock()) ffff9c2aef585000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144256.265438:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aef585800): rc 0 00000020:00080000:1.0:1783144256.265441:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9c2ad08db380) has no exports 00000020:00010000:1.0:1783144256.265448:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2af7288800: total 0 00010000:00010000:1.0:1783144256.265451:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.265471:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2af7288800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783144256.265494:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af043e600/0xad8e53a423047193 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419a8 expref: 5 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265518:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af043f600/0xad8e53a42304717e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419a1 expref: 4 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265530:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7a00/0xad8e53a42304719a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419af expref: 3 pid: 84986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265542:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af043e000/0xad8e53a423047177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4199a expref: 2 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265550:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2af7288800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783144256.265568:0:6509:0:(genops.c:906:class_export_put()) final put ffff9c2af7288800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 00000020:00010000:1.0:1783144256.265575:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2aef585800: total 1 00010000:00010000:1.0:1783144256.265592:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2aef585800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783144256.265634:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.265645:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02151200/0xad8e53a4230470ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230470b3 expref: 14 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144256.265666:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af7288800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 for MGS 00000020:00000080:3.0:1783144256.265682:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af728e000 for MGS 00010000:00010000:1.0:1783144256.265714:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7000/0xad8e53a4230470c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230470c1 expref: 13 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265741:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98ee00/0xad8e53a4230470d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230470cf expref: 12 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265751:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98ec00/0xad8e53a423047066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304705f expref: 11 pid: 84991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265758:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150e00/0xad8e53a4230470e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230470dd expref: 10 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265766:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98ea00/0xad8e53a423047074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304706d expref: 9 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265782:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee6d9e00/0xad8e53a4230470f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230470eb expref: 8 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265790:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150000/0xad8e53a423047090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047089 expref: 7 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265800:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee6d8400/0xad8e53a42304710e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047107 expref: 6 pid: 84987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265807:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150a00/0xad8e53a423047082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304707b expref: 5 pid: 84988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265819:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f6800/0xad8e53a423047100 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230470f9 expref: 4 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265828:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150c00/0xad8e53a42304709e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047097 expref: 3 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265837:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150600/0xad8e53a4230470ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230470a5 expref: 2 pid: 84992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144256.265845:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2aef585800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783144256.265857:0:6509:0:(genops.c:906:class_export_put()) final put ffff9c2aef585800/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 00010000:00010000:1.0:1783144256.265866:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.265868:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144256.265870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144256.265930:0:84988:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2aca3a5200:84988] 2 exiting: rc = 0 00000100:00100000:1.0:1783144256.266018:0:84986:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2aca3a5000:84986] 0 exiting: rc = 1 00000100:00100000:1.0:1783144256.266071:0:84987:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2afa82e600:84987] 1 exiting: rc = 0 00000100:00100000:3.0:1783144256.266159:0:84991:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c29c4fb8200:84991] 3 exiting: rc = 0 00000020:00000080:3.0:1783144256.266198:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aef585800/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 for MGS 00000020:00000080:3.0:1783144256.266211:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aef585000 for MGS 00000100:00100000:1.0:1783144256.266804:0:84992:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff9c2afab75200:84992] 4 exiting: rc = 0 00000100:00100000:3.0:1783144256.266907:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.266916:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.266974:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.266985:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.266991:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267016:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267024:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267032:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267037:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267043:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267052:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267057:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267062:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267067:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267072:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267077:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267081:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267086:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267092:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267097:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267101:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267106:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267110:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267115:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267120:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267125:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267130:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267136:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267142:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267213:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267220:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267225:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267229:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267235:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267240:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267245:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267250:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267255:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267260:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267264:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267269:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267273:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267278:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267282:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267287:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267292:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267296:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267301:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267306:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267311:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267315:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267320:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267324:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267338:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267345:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267351:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267356:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267363:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267370:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267378:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267382:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267387:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267395:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783144256.267426:0:86297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1783144256.271376:0:86297:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c29c5312480 - data ffff9c2afa6acca8/ffff9c29c4ef6000 00000020:01000000:3.0:1783144256.271519:0:86297:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af6ad4060 - data ffff9c2acfcd7798/ffff9c2aee7e0800 00000020:00000080:3.0:1783144256.271996:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f2b 00000020:00000080:3.0:1783144256.272003:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2af5c4d800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783144256.272012:0:86297:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2af71e6800 from MGS, refs=2 00000020:01000004:3.0:1783144256.272015:0:86297:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af71e6800 2 00000020:01000004:3.0:1783144256.272023:0:86297:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2af71e6800 from MGS 00000020:00000080:3.0:1783144256.272041:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144256.272048:0:86297:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783144256.272050:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2af5c49800/MGS 00000020:00000080:3.0:1783144256.272053:0:86297:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c49800/MGS for MGS 00000020:01000000:3.0:1783144256.272059:0:86297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1783144256.272100:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c4d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783144256.272215:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783144256.272219:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144256.272229:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783144256.272235:0:86297:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c2aee196000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144256.272240:0:86297:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c2af9c7b380) has exports, disconnecting them 00000020:00080000:3.0:1783144256.272244:0:86297:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c2aee196000), last request at 1783144237 00000020:00000080:3.0:1783144256.272247:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047043 00000020:00080000:3.0:1783144256.272255:0:86297:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aee196000): rc 0 00000020:00000080:3.0:1783144256.272258:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2aee196000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783144256.272412:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee196000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783144256.274007:0:86297:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783144256.274013:0:86297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783144256.274029:0:86297:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783144256.274034:0:86297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144256.274065:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee190000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783144256.274177:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144256.274185:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783144256.274189:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2aee197000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783144256.274192:0:86297:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee197000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783144256.274196:0:86297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783144256.274254:0:86297:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af71e6800 1 00000020:00000080:0.0:1783144256.274257:0:86297:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423046f1d 00000020:00000080:0.0:1783144256.274261:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2af5c4a000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783144256.274265:0:86297:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783144256.274268:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144256.274271:0:86297:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783144256.274273:0:86297:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c2aee5919c0) has no exports 00000020:00000080:1.0:1783144256.274320:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c4a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783144256.303305:0:86297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144256.303316:0:86297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783144256.303321:0:86297:0:(genops.c:906:class_export_put()) final put ffff9c2af71e6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144256.303326:0:86297:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783144256.303334:0:86297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783144256.303444:0:86297:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9c2af71e3000 00000020:02000400:0.0:1783144256.303502:0:86297:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783144256.462451:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783144256.611152:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481648640 offset 0 length 224: 4 00000100:00100000:0.0:1783144256.611191:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144256.611222:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144256.611238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144256.611277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144256.611304:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481648768 00000100:00100000:0.0:1783144256.611312:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481648768 00000100:00100000:0.0:1783144256.611348:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481648896 00000100:00100000:0.0:1783144256.611351:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481648896 00000100:00100000:0.0:1783144256.611411:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 729 00000100:00100000:0.0:1783144256.611433:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481648896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144256.611519:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481648896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144256.611527:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 729 00000100:00100000:0.0:1783144256.611553:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1021 00000100:00100000:0.0:1783144256.611559:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1869759481648768:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:0.0:1783144256.611565:0:66112:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:0.0:1783144256.611597:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1869759481648768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (405us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144256.611603:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1021 00000100:00080000:0.0:1783144256.611651:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144256.611695:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481649024 00000100:00100000:3.0:1783144256.611700:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481649024 00000100:00100000:1.0:1783144256.611713:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481649152 00000100:00100000:1.0:1783144256.611718:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481649152 00000100:00100000:3.0:1783144256.611770:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1957 00000100:00100000:3.0:1783144256.611777:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481649024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144256.611785:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1958 00000100:00100000:1.0:1783144256.611797:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cace81e7-a6f2-4d37-b197-caf34583781c+5:2405:x1869759481649152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144256.611803:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481649024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144256.611809:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1957 00000100:00100000:1.0:1783144256.611836:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cace81e7-a6f2-4d37-b197-caf34583781c+5:2405:x1869759481649152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144256.611844:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1958 00000100:00080000:0.0:1783144256.612024:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144256.612028:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144256.614254:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144256.614419:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481649280 00000100:00100000:0.0:1783144256.614427:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481649280 00000100:00100000:0.0:1783144256.614478:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1022 00000100:00100000:0.0:1783144256.614486:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481649280:12345-192.168.203.4@tcp:38:ptlrpcd_01_01.0 00010000:00020000:0.0:1783144256.614509:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144256.614579:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481649280:12345-192.168.203.4@tcp:38:ptlrpcd_01_01.0 Request processed in 93us (333us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144256.614587:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1022 00010000:00010000:1.0:1783144257.485935:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144258.061966:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144258.061987:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501260928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144258.062062:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144258.062528:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260928 00000100:00100000:1.0:1783144258.062536:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260928 00000100:00100000:1.0:1783144258.062583:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:1.0:1783144258.062592:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3651:x1869759501260928:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1783144258.062609:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144258.062658:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3651:x1869759501260928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (594us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144258.062668:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00100000:2.0:1783144258.062678:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501261184:0@lo:400:kworker.0 00000100:00100000:2.0:1783144258.062714:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144258.062744:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501261440:0@lo:400:kworker.0 00000100:00100000:2.0:1783144258.062765:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501261696:0@lo:400:kworker.0 00000100:00100000:3.0:1783144258.062797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144258.062802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144258.062823:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783144258.062829:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501261312:0@lo:400:kworker.0 00000100:00100000:3.0:1783144258.062833:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501261952:0@lo:400:kworker.0 00000100:00100000:2.0:1783144258.062852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144258.062876:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501261056:0@lo:400:kworker.0 00000100:00100000:0.0:1783144258.062976:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501261184 00000100:00100000:1.0:1783144258.062979:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501261440 00000100:00100000:0.0:1783144258.062981:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501261184 00000100:00100000:1.0:1783144258.062985:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501261440 00000100:00100000:1.0:1783144258.063007:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501261312 00000100:00100000:1.0:1783144258.063011:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501261312 00000100:00100000:0.0:1783144258.063021:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1783144258.063027:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1869759501261440:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783144258.063033:0:66112:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144258.063048:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1783144258.063057:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501261312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144258.063543:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501261824:0@lo:400:kworker.0 00000400:00000100:3.0:1783144258.063547:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501261056 offset 0 length 224: 4 00000100:00100000:2.0:1783144258.063584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144258.063594:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501261568:0@lo:400:kworker.0 00000100:00100000:2.0:1783144258.063635:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1783144258.063636:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144258.063645:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869759501261184:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144258.063659:0:66947:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:02020000:3.0:1783144258.063664:0:3651:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1783144258.063669:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783144258.063675:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783144258.063679:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144258.063684:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144258.063689:0:3651:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2777 00000100:00100000:2.0:1783144258.063695:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869759501261184:12345-0@lo:400:kworker.0 Request processed in 50us (979us total) trans 0 rc -107/-107 00000100:00080000:3.0:1783144258.063697:0:3651:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144258.063707:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1783144258.063742:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501261568 00000100:00100000:2.0:1783144258.063746:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501261568 00000100:00100000:3.0:1783144258.063749:0:3651:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60b7480 x1869759501262080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144258.063770:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1783144258.063778:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501261568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144258.063787:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501262080:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783144258.063819:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501261568:12345-0@lo:400:kworker.0 Request processed in 41us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144258.063825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144258.063832:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1783144258.063851:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501261696 00000100:00100000:2.0:1783144258.063854:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501261696 00000100:00100000:2.0:1783144258.063932:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501261824 00000100:00100000:2.0:1783144258.063935:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501261824 00000100:00100000:2.0:1783144258.063956:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1783144258.063961:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501261696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144258.064119:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501261696:12345-0@lo:400:kworker.0 Request processed in 157us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144258.064122:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501262080 00000100:00100000:3.0:1783144258.064128:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501262080 00000100:00100000:2.0:1783144258.064130:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1783144258.064145:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:2.0:1783144258.064151:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501261824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144258.064176:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501261824:12345-0@lo:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144258.064181:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:2.0:1783144258.064204:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144258.064214:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:3.0:1783144258.064220:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501262080:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783144258.064231:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501261952 00010000:00020000:3.0:1783144258.064237:0:78024:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144258.064241:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501261952 00000100:00100000:2.0:1783144258.064263:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1783144258.064268:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1869759501261952:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144258.064273:0:66947:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783144258.064289:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501262080:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 66us (466us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144258.064302:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00100000:2.0:1783144258.064319:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1869759501261952:12345-0@lo:400:kworker.0 Request processed in 49us (115us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144258.064327:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00080000:3.0:1783144258.064338:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144258.064345:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144258.064349:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501262080:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1783144258.064357:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783144258.064370:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783144258.064375:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783144258.064379:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144258.064382:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2777 00000100:00100000:3.0:1783144258.064385:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501261568:0@lo:400:kworker.0 00000100:00080000:2.0:1783144258.064389:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144258.064406:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b37b80 x1869759501262208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144258.064425:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501261824:0@lo:400:kworker.0 00000100:00080000:3.0:1783144258.064434:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783144258.064437:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783144258.064440:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144258.064443:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144258.064446:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2777 00000100:00080000:3.0:1783144258.064450:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144258.064475:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60b7480 x1869759501262336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144258.064485:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501261184:0@lo:400:kworker.0 00000100:00100000:3.0:1783144258.064497:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501261696:0@lo:400:kworker.0 00000100:00100000:3.0:1783144258.064520:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501262208:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783144258.064540:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144258.064555:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501262336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783144258.064571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144258.064587:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501261952:0@lo:400:kworker.0 00000100:00100000:3.0:1783144258.064593:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501262208 00000100:00100000:3.0:1783144258.064622:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501262208 00000100:00080000:2.0:1783144258.064631:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144258.064636:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144258.064638:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501262336 00000100:00080000:2.0:1783144258.064639:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144258.064642:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501262336 00000100:00100000:2.0:1783144258.064656:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1783144258.064662:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501262208:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783144258.064673:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144258.064703:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501262208:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40us (161us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144258.065024:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1783144258.065033:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501262336:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783144258.065033:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00010000:00020000:3.0:1783144258.065045:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144258.065075:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501262336:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 43us (502us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144258.065082:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:2.0:1783144258.065092:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144258.065098:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144258.065101:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501262208:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783144258.065110:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144258.065114:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144258.065118:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501262336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783144258.065805:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1869759501261440:12345-0@lo:400:kworker.0 Request processed in 2775us (3007us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144258.065815:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1783144258.065816:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501261312:12345-0@lo:400:kworker.0 Request processed in 2758us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144258.065827:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00080000:2.0:1783144258.065898:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783144258.065902:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1783144258.065904:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501261312:0@lo:400:kworker.0 00000100:02000400:2.0:1783144258.065908:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783144258.065914:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144258.065918:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2777 00000100:00080000:2.0:1783144258.065924:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144258.065941:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b37b80 x1869759501262464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144258.065964:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501261440:0@lo:400:kworker.0 00000100:00100000:3.0:1783144258.066018:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501262464:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783144258.066044:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144258.066087:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501262464 00000100:00100000:2.0:1783144258.066092:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501262464 00000100:00100000:2.0:1783144258.066119:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1783144258.066123:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501262464:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783144258.066135:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144258.066175:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501262464:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 50us (130us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144258.066181:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00080000:0.0:1783144258.066210:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144258.066214:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144258.066218:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501262464:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1783144258.509974:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144259.085978:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144259.086002:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501262592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144259.086070:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144259.086187:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501262720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144259.086215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144259.086390:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501262592 00000100:00100000:3.0:1783144259.086398:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501262592 00000100:00100000:3.0:1783144259.086450:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501262720 00000100:00100000:3.0:1783144259.086453:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501262720 00000100:00100000:3.0:1783144259.086482:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1783144259.086490:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501262592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144259.086527:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144259.086575:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501262592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144259.086582:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1783144259.086609:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1783144259.086616:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501262720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144259.086630:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144259.086661:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501262720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144259.086682:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1783144259.086740:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501262592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144259.086772:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501262720:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783144259.534224:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144260.557964:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144261.581915:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783144261.647717:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144261.647759:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d61800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144261.647875:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d61800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783144261.647929:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9d65000 for lustre-OST0001 00000001:00100000:0.0:1783144261.648200:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783144261.648209:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378732 is committed 00000020:00000080:0.0:1783144261.648213:0:75517:0:(genops.c:906:class_export_put()) final put ffff9c2afab23000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144261.648267:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afab23000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783144261.648318:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aefa7b800 for lustre-MDT0001 00000001:00100000:3.0:1783144261.648686:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144261.648690:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d62000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144261.648744:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d62000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783144261.648776:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9d67800 for lustre-OST0000 00000400:00000100:3.0:1783144261.731295:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481649408 offset 0 length 224: 4 00000100:00100000:3.0:1783144261.731333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144261.731378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144261.731412:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144261.731441:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481649664 00000100:00100000:3.0:1783144261.731446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144261.731452:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481649664 00000100:00100000:3.0:1783144261.731468:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481649536 00000100:00100000:3.0:1783144261.731473:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481649536 00000100:00100000:2.0:1783144261.731564:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481649792 00000100:00100000:2.0:1783144261.731577:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481649792 00000100:00100000:0.0:1783144261.731584:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481649920 00000100:00100000:0.0:1783144261.731590:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481649920 00000100:00100000:2.0:1783144261.731614:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1961 00000100:00100000:2.0:1783144261.731626:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481649792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144261.731689:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481649792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144261.731936:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 732 00000100:00100000:3.0:1783144261.731948:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481649664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144261.731955:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1029 00000100:00100000:1.0:1783144261.731963:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1869759481649536:12345-192.168.203.4@tcp:38:kworker.0 00000100:00100000:3.0:1783144261.731975:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481649664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144261.731980:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 732 00010000:00020000:1.0:1783144261.731985:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1783144261.732014:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144261.732016:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1869759481649536:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 52us (570us total) trans 0 rc -19/-19 00000100:00080000:3.0:1783144261.732018:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144261.732022:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144261.732029:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1029 00000100:00100000:0.0:1783144261.732227:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1962 00000100:00100000:2.0:1783144261.732311:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1961 00000100:00100000:0.0:1783144261.732317:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481649920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144261.732350:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481649920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144261.732356:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1962 00010000:00010000:0.0:1783144262.605924:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144263.181912:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144263.181919:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144263.181922:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783144263.181935:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501262848:0@lo:400:kworker.0 00000100:00080000:3.0:1783144263.181944:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2792 00000100:00080000:3.0:1783144263.181955:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144263.181962:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000400:00000100:1.0:1783144263.181980:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501262848 offset 0 length 224: 4 00000100:00100000:3.0:1783144263.181985:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b3ad80 x1869759501262976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144263.182024:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501262976:0@lo:38:kworker.0 00000100:00080000:3.0:1783144263.182032:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783144263.182041:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1783144263.182042:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144263.182044:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144263.182050:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2792 00000100:00080000:3.0:1783144263.182054:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1783144263.182056:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501263104:0@lo:400:kworker.0 00000100:00080000:3.0:1783144263.182060:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144263.182064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144263.182094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144263.182122:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501262976 00000100:00100000:0.0:1783144263.182128:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501262976 00000100:00100000:1.0:1783144263.182209:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501263104 00000100:00100000:1.0:1783144263.182212:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501263104 00000100:00100000:0.0:1783144263.182220:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1783144263.182237:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501262976:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1783144263.182254:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:0.0:1783144263.182259:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144263.182263:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1783144263.182276:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501263104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144263.182323:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501263104:12345-0@lo:400:kworker.0 Request processed in 51us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144263.182331:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1783144263.182367:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501262976:12345-0@lo:38:kworker.0 Request processed in 130us (303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144263.182374:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501263104:0@lo:400:kworker.0 00000100:00100000:0.0:1783144263.182376:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00080000:2.0:1783144263.182435:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144263.182440:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144263.182443:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501262976:0@lo:38:kworker.0 00000100:00100000:3.0:1783144263.182646:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b3aa00 x1869759501263232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144263.182687:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144263.182693:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144263.182695:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783144263.182696:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501263232:0@lo:38:kworker.0 00000100:00080000:3.0:1783144263.182706:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2792 00000100:00080000:3.0:1783144263.182709:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144263.182714:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144263.182716:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144263.182745:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501263360:0@lo:400:kworker.0 00000100:00100000:2.0:1783144263.182746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144263.182755:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b38700 x1869759501263488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144263.182765:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501263232 00000100:00100000:1.0:1783144263.182772:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501263232 00000100:00100000:2.0:1783144263.182776:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501263488:0@lo:38:kworker.0 00000100:00100000:0.0:1783144263.182779:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144263.182805:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783144263.182805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144263.182815:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144263.182817:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783144263.182824:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501263360 00000100:00080000:3.0:1783144263.182828:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2792 00000100:00100000:1.0:1783144263.182830:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501263360 00000100:00080000:3.0:1783144263.182833:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1783144263.182837:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501263488 00000100:00100000:0.0:1783144263.182837:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00080000:3.0:1783144263.182841:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144263.182842:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501263488 00000100:00100000:0.0:1783144263.182845:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501263232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144263.182858:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144263.182864:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b3ad80 x1869759501263872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144263.182876:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:1.0:1783144263.182880:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1783144263.182882:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501263488:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144263.182891:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501263232:12345-0@lo:38:kworker.0 Request processed in 46us (144us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144263.182893:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501263360:12345-0@lo:400:kworker.0 00010000:00020000:2.0:1783144263.182894:0:23926:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144263.182902:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1783144263.182903:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501263616:0@lo:400:kworker.0 00000100:00100000:2.0:1783144263.182925:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501263488:12345-0@lo:38:kworker.0 Request processed in 42us (120us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144263.182933:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00100000:3.0:1783144263.182945:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144263.182954:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144263.182959:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501263360:12345-0@lo:400:kworker.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144263.182968:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1783144263.182971:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501263616 00000100:00100000:3.0:1783144263.182972:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144263.182976:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501263616 00000100:00100000:3.0:1783144263.182981:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501263744:0@lo:400:kworker.0 00000100:00100000:3.0:1783144263.183020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144263.183023:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501263360:0@lo:400:kworker.0 00000100:00100000:2.0:1783144263.183028:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1783144263.183033:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501263744 00000100:00100000:0.0:1783144263.183037:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501263744 00000100:00100000:2.0:1783144263.183038:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501263616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144263.183071:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1783144263.183078:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501263744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144263.183081:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501263616:12345-0@lo:400:kworker.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144263.183087:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:3.0:1783144263.183108:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501263872:0@lo:38:kworker.0 00000100:00080000:2.0:1783144263.183108:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144263.183113:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144263.183116:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501263744:12345-0@lo:400:kworker.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144263.183117:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501263616:0@lo:400:kworker.0 00000100:00100000:0.0:1783144263.183127:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:1.0:1783144263.183143:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501263744:0@lo:400:kworker.0 00000100:00100000:3.0:1783144263.183148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144263.183180:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144263.183184:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144263.183187:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501263488:0@lo:38:kworker.0 00000100:00080000:3.0:1783144263.183195:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144263.183197:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144263.183200:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501263232:0@lo:38:kworker.0 00000100:00100000:0.0:1783144263.184520:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501263872 00000100:00100000:0.0:1783144263.184527:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501263872 00000100:00100000:0.0:1783144263.184569:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1783144263.184575:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501263872:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144263.184588:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144263.184643:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501263872:12345-0@lo:38:kworker.0 Request processed in 67us (1497us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144263.184650:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00080000:2.0:1783144263.185080:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144263.185086:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144263.185090:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501263872:0@lo:38:kworker.0 00010000:00010000:2.0:1783144263.630140:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144264.205955:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501264000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144264.206012:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144264.206130:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501264000 00000100:00100000:1.0:1783144264.206136:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501264000 00000100:00100000:1.0:1783144264.206175:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1783144264.206181:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501264000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144264.206217:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144264.206353:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501264128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144264.206381:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501264000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144264.206388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144264.206392:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1783144264.206423:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501264128 00000100:00100000:1.0:1783144264.206426:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501264128 00000100:00100000:1.0:1783144264.206450:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:1.0:1783144264.206455:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501264128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783144264.206467:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144264.206781:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501264000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144264.206848:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501264128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 391us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144264.206852:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501264128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144264.206858:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00010000:00010000:2.0:1783144264.654520:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144265.677951:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144266.701954:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1783144266.851112:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481650048 offset 0 length 224: 4 00000100:00100000:3.0:1783144266.851153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144266.851350:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481650176 00000100:00100000:0.0:1783144266.851359:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481650176 00000100:00100000:0.0:1783144266.851416:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1033 00000100:00100000:0.0:1783144266.851423:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481650176:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:0.0:1783144266.851445:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144266.851506:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481650176:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 82us (353us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144266.851513:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1033 00000100:00100000:3.0:1783144266.851964:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144266.852421:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144266.852453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144266.852502:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481650432 00000100:00100000:1.0:1783144266.852507:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481650432 00000100:00100000:1.0:1783144266.852560:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481650560 00000100:00100000:1.0:1783144266.852564:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481650560 00000100:00100000:1.0:1783144266.852588:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1965 00000100:00100000:1.0:1783144266.852596:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481650432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144266.852631:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481650432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144266.852636:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1965 00000100:00100000:1.0:1783144266.852647:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1966 00000100:00100000:1.0:1783144266.852651:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481650560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144266.852664:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481650560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 14us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144266.852675:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1966 00000100:00100000:1.0:1783144266.852688:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481650304 00000100:00100000:1.0:1783144266.852690:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481650304 00000100:00100000:1.0:1783144266.852708:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 735 00000100:00100000:1.0:1783144266.852711:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481650304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144266.852744:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481650304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144266.852748:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 735 00000100:00080000:3.0:1783144266.856468:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144266.856476:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144266.856478:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783144267.725958:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783144268.302698:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783144268.302705:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501264256:0@lo:400:kworker.0 00000100:00080000:0.0:1783144268.302707:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144268.302713:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144268.302744:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2797 00000100:00080000:0.0:1783144268.302749:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783144268.302756:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000400:00000100:1.0:1783144268.302778:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501264256 offset 0 length 224: 4 00000100:00100000:0.0:1783144268.302802:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afa944380 x1869759501264384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144268.302861:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501264384:0@lo:38:kworker.0 00000100:00080000:0.0:1783144268.302861:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144268.302878:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144268.302881:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144268.302886:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2797 00000100:00080000:0.0:1783144268.302889:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783144268.302894:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144268.302899:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501264512:0@lo:400:kworker.0 00000100:00100000:0.0:1783144268.302911:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3dfd880 x1869759501264640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144268.302913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783144268.303025:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144268.303029:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144268.303032:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144268.303037:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2797 00000100:00080000:0.0:1783144268.303040:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1783144268.303047:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501264384 00000100:00100000:3.0:1783144268.303048:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501264640:0@lo:38:kworker.0 00000100:00080000:0.0:1783144268.303052:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144268.303056:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501264384 00000100:00100000:3.0:1783144268.303081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144268.303136:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3dfe680 x1869759501264896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144268.303195:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144268.303198:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144268.303200:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144268.303204:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2797 00000100:00080000:0.0:1783144268.303207:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783144268.303211:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144268.303245:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3dfed80 x1869759501265280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144268.303270:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501264768:0@lo:400:kworker.0 00000100:00100000:0.0:1783144268.303308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144268.303431:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501264640 00000100:00100000:1.0:1783144268.303436:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501264640 00000100:00100000:3.0:1783144268.303441:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501264768 00000100:00100000:3.0:1783144268.303447:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501264768 00000100:00100000:1.0:1783144268.303469:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1783144268.303474:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144268.303485:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501265024:0@lo:400:kworker.0 00000100:00100000:1.0:1783144268.303489:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501264384:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144268.303495:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1783144268.303506:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501264768:12345-0@lo:400:kworker.0 00010000:00020000:1.0:1783144268.303511:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144268.303537:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144268.303582:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501264384:12345-0@lo:38:kworker.0 Request processed in 94us (671us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144268.303586:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501264768:12345-0@lo:400:kworker.0 Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144268.303596:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1783144268.303603:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501264640:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144268.303621:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144268.303629:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1783144268.303635:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1783144268.303655:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501264640:12345-0@lo:38:kworker.0 Request processed in 50us (573us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144268.303664:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:3.0:1783144268.303668:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144268.303683:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501265152:0@lo:400:kworker.0 00000100:00100000:0.0:1783144268.303694:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265024 00000100:00100000:3.0:1783144268.303699:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144268.303708:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265024 00000100:00100000:1.0:1783144268.303715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144268.303759:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501264896:0@lo:38:kworker.0 00000100:00100000:3.0:1783144268.303784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144268.303802:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501265280:0@lo:38:kworker.0 00000100:00100000:3.0:1783144268.303829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144268.303855:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144268.303860:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144268.303863:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501264640:0@lo:38:kworker.0 00000100:00100000:0.0:1783144268.303870:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265152 00000100:00080000:3.0:1783144268.303876:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783144268.303876:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265152 00000100:00080000:3.0:1783144268.303888:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144268.303892:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501264384:0@lo:38:kworker.0 00000100:00100000:2.0:1783144268.303901:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501264512 00000100:00100000:2.0:1783144268.303908:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501264512 00000100:00100000:0.0:1783144268.303917:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1783144268.303929:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501265024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144268.303930:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501264896 00000100:00100000:3.0:1783144268.303937:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501264896 00000100:00100000:2.0:1783144268.303949:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265280 00000100:00100000:2.0:1783144268.303955:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265280 00000100:00100000:3.0:1783144268.303968:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:3.0:1783144268.303974:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501264896:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144268.303984:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00010000:00020000:3.0:1783144268.303987:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144268.303995:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501264512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144268.304020:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501264896:12345-0@lo:38:kworker.0 Request processed in 44us (233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144268.304027:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:3.0:1783144268.304060:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1783144268.304060:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501264512:12345-0@lo:400:kworker.0 Request processed in 65us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144268.304068:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501265280:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144268.304074:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00010000:00020000:3.0:1783144268.304083:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144268.304112:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501265280:12345-0@lo:38:kworker.0 Request processed in 45us (283us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144268.304118:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00080000:3.0:1783144268.304134:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144268.304137:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144268.304139:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144268.304156:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501264512:0@lo:400:kworker.0 00000100:00080000:3.0:1783144268.304176:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144268.304179:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144268.304182:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501264896:0@lo:38:kworker.0 00000100:00080000:3.0:1783144268.304189:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144268.304191:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144268.304200:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501265280:0@lo:38:kworker.0 00000100:00100000:3.0:1783144268.304241:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1783144268.304248:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501265152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144268.304280:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501265152:12345-0@lo:400:kworker.0 Request processed in 33us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144268.304287:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1783144268.304647:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501265024:12345-0@lo:400:kworker.0 Request processed in 721us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144268.304655:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:2.0:1783144268.304748:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501265024:0@lo:400:kworker.0 00000100:00100000:2.0:1783144268.304760:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501264768:0@lo:400:kworker.0 00000100:00100000:1.0:1783144268.304946:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501265152:0@lo:400:kworker.0 00010000:00010000:3.0:1783144268.749960:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144269.326067:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144269.326083:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501265408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144269.326142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144269.326222:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265408 00000100:00100000:0.0:1783144269.326229:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265408 00000100:00100000:0.0:1783144269.326277:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1783144269.326286:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501265408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144269.326313:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144269.326356:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501265408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144269.326363:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1783144269.326410:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501265408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144269.326828:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144269.326838:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501265536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144269.326868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144269.326935:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265536 00000100:00100000:2.0:1783144269.326939:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265536 00000100:00100000:2.0:1783144269.326974:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1783144269.326982:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501265536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144269.327007:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144269.327048:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501265536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144269.327055:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1783144269.327081:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501265536:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783144269.774944:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144270.800545:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144271.821913:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144271.976018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144271.976063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144271.976066:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481650816 00000100:00100000:0.0:1783144271.976081:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481650816 00000100:00100000:3.0:1783144271.976092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144271.976100:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481651072 00000100:00100000:2.0:1783144271.976107:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481651072 00000100:00100000:3.0:1783144271.976122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144271.976125:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481650944 00000100:00100000:0.0:1783144271.976131:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481650944 00000400:00000100:3.0:1783144271.976145:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481651328 offset 0 length 520: 4 00000100:00100000:2.0:1783144271.976171:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481651200 00000100:00100000:2.0:1783144271.976176:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481651200 00000100:00100000:2.0:1783144271.976216:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4925 00000100:00100000:2.0:1783144271.976227:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:cace81e7-a6f2-4d37-b197-caf34583781c+5:2402:x1869759481651072:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:2.0:1783144271.976257:0:26150:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230471af 00000100:00080000:2.0:1783144271.976266:0:26150:0:(import.c:65:import_set_state_nolock()) ffff9c29c4cb5000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783144271.976281:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 738 00000100:00100000:3.0:1783144271.976287:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4926 00000100:00100000:0.0:1783144271.976295:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481650944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144271.976301:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cace81e7-a6f2-4d37-b197-caf34583781c+5:2402:x1869759481651200:12345-192.168.203.4@tcp:9:kworker.0 00000001:00000004:2.0:1783144271.976313:0:26150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968823 00000020:00000080:3.0:1783144271.976319:0:26147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230471c4 00000100:00080000:3.0:1783144271.976327:0:26147:0:(import.c:65:import_set_state_nolock()) ffff9c29c6cdb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783144271.976364:0:26147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968823 00000100:00100000:0.0:1783144271.976373:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481650944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144271.976383:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 738 00000100:00100000:0.0:1783144271.976408:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1037 00000100:00100000:0.0:1783144271.976413:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481650816:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:0.0:1783144271.976431:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144271.976459:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:cace81e7-a6f2-4d37-b197-caf34583781c+2:2402:x1869759481651072:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 233us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144271.976467:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481650816:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 51us (458us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144271.976472:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4925 00000100:00100000:3.0:1783144271.976474:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cace81e7-a6f2-4d37-b197-caf34583781c+2:2402:x1869759481651200:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 175us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144271.976486:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1037 00000100:00100000:3.0:1783144271.976491:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4926 00010000:00010000:3.0:1783144271.976532:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783144271.976870:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144271.976874:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144271.976876:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783144271.976884:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783144272.148155:0:86915:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783144272.148162:0:86915:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783144272.148163:0:86915:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783144272.148282:0:86915:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c2aee192000 00000020:01000004:0.0:1783144272.148296:0:86915:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783144272.148311:0:86915:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783144272.148325:0:86915:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2ad08db380) 00000020:00000080:0.0:1783144272.148342:0:86915:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783144272.214155:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783144272.215392:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783144272.217676:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783144272.220490:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783144272.220711:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783144272.221040:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783144272.221264:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783144272.221492:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783144272.221752:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783144272.222052:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783144272.222253:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783144272.222470:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1783144272.222681:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.223057:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.223343:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.224073:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.224674:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.225099:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.225263:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.225434:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.225622:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.226004:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.226287:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.226530:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.226779:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.226993:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.227160:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.227400:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.227637:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.227846:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.228104:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.228296:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783144272.228557:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.228814:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.229048:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783144272.229889:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783144272.230309:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783144272.230684:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783144272.230967:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783144272.231151:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783144272.231672:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783144272.231920:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783144272.232058:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783144272.232206:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783144272.232340:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783144272.232647:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783144272.233812:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783144272.237611:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144272.238300:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783144272.238549:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144272.239029:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144272.240821:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144272.241284:0:86915:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1783144272.241978:0:86915:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783144272.242253:0:86915:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783144272.242263:0:86915:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783144272.242277:0:86915:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a4230474bf 00000020:01000004:3.0:1783144272.242286:0:86915:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783144272.242304:0:86915:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783144272.242310:0:86915:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2aee192000 from MGS 00000020:01000004:3.0:1783144272.242314:0:86915:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783144272.242328:0:86915:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c2aee594d40) 00000020:00000080:3.0:1783144272.242341:0:86915:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783144272.242426:0:86915:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aee192000 from MGS, refs=2 00080000:01000000:3.0:1783144272.242431:0:86915:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783144272.242436:0:86915:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a4230474cd 00010000:00010000:3.0:1783144272.242574:0:86915:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783144272.249367:0:86915:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783144272.250656:0:86919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783144272.250704:0:86915:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783144272.250789:0:86915:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783144272.252685:0:86915:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783144272.253077:0:86915:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783144272.253218:0:86915:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783144272.253224:0:86915:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783144272.255354:0:86915:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783144272.255424:0:86915:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783144272.255864:0:86915:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783144272.255871:0:86915:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783144272.256345:0:86915:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783144272.256831:0:86915:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783144272.256835:0:86915:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783144272.256838:0:86915:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1783144272.256844:0:86915:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783144272.256851:0:86915:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783144272.256862:0:86915:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783144272.256864:0:86915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783144272.256873:0:86915:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2ac7def100 x1869759501261056/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144272.256930:0:86915:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2ae4b3a680 x1869759501262848/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144272.256981:0:86915:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2afa947480 x1869759501264256/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783144272.256995:0:86915:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783144272.256998:0:86915:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783144272.257000:0:86915:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783144272.257003:0:86915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1783144272.257055:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501264256:0@lo:400:kworker.0 00000100:00100000:0.0:1783144272.257115:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501261056:0@lo:400:kworker.0 00000100:00100000:3.0:1783144272.257200:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501262848:0@lo:400:kworker.0 10000000:01000000:1.0:1783144272.257248:0:86915:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1783144272.257263:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047100 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257274:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047100 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257280:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1783144272.257298:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257307:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee6d8a00/0xad8e53a4230470f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047100 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257321:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257328:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257344:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257348:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257352:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a42304705f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047066 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257371:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047082 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257377:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047082 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257382:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257385:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257389:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a42304707b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047082 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257398:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230470ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257404:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230470ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257409:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257412:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257415:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f200/0xad8e53a4230470a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230470ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257421:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230470ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257439:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230470ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257444:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257448:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257452:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230470b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230470ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257461:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230470d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257467:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230470d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257471:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257474:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257477:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2b02151800/0xad8e53a4230470cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230470d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257486:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230470e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257492:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230470e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257508:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257512:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257515:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2b02151000/0xad8e53a4230470dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230470e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257536:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304710e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257542:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304710e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257547:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257551:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257555:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304710e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257565:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257572:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257577:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257580:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257584:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304706d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047074 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257595:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047090 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257601:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047090 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257606:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144272.257614:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257619:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423047089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047090 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257636:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304709e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257642:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304709e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257647:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783144272.257654:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257659:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98f600/0xad8e53a423047097 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304709e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257668:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230470c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257674:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230470c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257679:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783144272.257693:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257697:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a4230470c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230470c8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.257706:0:86915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230470f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144272.257712:0:86915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230470f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144272.257747:0:86915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783144272.257751:0:86915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783144272.257756:0:86915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a4230470eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230470f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783144272.257774:0:86915:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2ac6d92000 already not connected (conn 51, was 0): DISCONN 00000100:00080000:1.0:1783144272.257780:0:86915:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144272.257785:0:86915:0:(import.c:512:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 2771 00000100:00080000:1.0:1783144272.257792:0:86915:0:(import.c:626:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c2ac6d92000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144272.257816:0:86915:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b3aa00 x1869759501265664/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144272.257842:0:86915:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1783144272.257875:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501265664:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783144272.257933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.257963:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265664 00000100:00100000:3.0:1783144272.257971:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265664 00000100:00100000:3.0:1783144272.258013:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783144272.258020:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1869759501265664:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783144272.258042:0:86921:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo t0 exp 0000000000000000 cur 2806 last 0 00000020:00000080:3.0:1783144272.258065:0:86921:0:(genops.c:1406:class_connect()) connect: client 4e9e4714-8000-4c64-bed6-3cadd5fdfc80, cookie 0xad8e53a4230474d4 00000100:00080000:3.0:1783144272.258185:0:86921:0:(import.c:65:import_set_state_nolock()) ffff9c2aefdd9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144272.258243:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3647:x1869759501265664:12345-0@lo:250:mount.lustre.0 Request processed in 221us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.258260:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783144272.258332:0:3647:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 24 00000100:00080000:0.0:1783144272.258340:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1783144272.258347:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783144272.258350:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783144272.258352:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783144272.258355:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783144272.258369:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00080000:1.0:1783144272.258387:0:86915:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1783144272.258396:0:86915:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783144272.258422:0:86915:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783144272.258426:0:86915:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783144272.258526:0:86915:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783144272.258554:0:86915:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783144272.258558:0:86915:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783144272.258559:0:86915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144272.258561:0:86915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144272.258562:0:86915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144272.258563:0:86915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144272.258564:0:86915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144272.258566:0:86915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144272.258567:0:86915:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144272.258569:0:86915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144272.258570:0:86915:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783144272.258572:0:86915:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783144272.258575:0:86915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783144272.258580:0:86915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144272.258581:0:86915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144272.258582:0:86915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144272.258583:0:86915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144272.258584:0:86915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144272.258585:0:86915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144272.258586:0:86915:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144272.258587:0:86915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144272.258588:0:86915:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783144272.258601:0:86915:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783144272.258613:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501265792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783144272.258646:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.258670:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b840 going to sleep for 11 seconds 00000020:01000000:1.0:1783144272.258711:0:41298:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.104@tcp 10000000:01000000:1.0:1783144272.258740:0:41298:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783144272.258743:0:41298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144272.258745:0:41298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144272.258746:0:41298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144272.258748:0:41298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144272.258749:0:41298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144272.258751:0:41298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144272.258751:0:41298:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144272.258753:0:41298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144272.258754:0:41298:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783144272.258778:0:41298:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783144272.258785:0:41298:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783144272.258786:0:41298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144272.258788:0:41298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783144272.258788:0:41298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144272.258789:0:41298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144272.258790:0:41298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144272.258791:0:41298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144272.258792:0:41298:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144272.258794:0:41298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144272.258795:0:41298:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783144272.258814:0:41298:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783144272.258820:0:41298:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783144272.258821:0:41298:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144272.258828:0:41298:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783144272.258829:0:41298:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144272.258830:0:41298:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144272.258831:0:41298:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144272.258833:0:41298:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144272.258834:0:41298:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144272.258835:0:41298:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144272.258836:0:41298:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783144272.258849:0:41298:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1783144272.258868:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144272.258876:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501265920:0@lo:253:kworker.0 00000100:00100000:1.0:1783144272.258903:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.258934:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501266048:0@lo:253:kworker.0 00000100:00100000:1.0:1783144272.258960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.258972:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144272.258977:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501266176:0@lo:253:kworker.0 00000100:00100000:1.0:1783144272.258999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.259073:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265792 00000100:00100000:3.0:1783144272.259078:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265792 00000100:00100000:3.0:1783144272.259097:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501265920 00000100:00100000:3.0:1783144272.259100:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501265920 00000100:00100000:3.0:1783144272.259107:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266048 00000100:00100000:3.0:1783144272.259108:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266048 00000100:00100000:3.0:1783144272.259114:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266176 00000100:00100000:3.0:1783144272.259116:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266176 00000100:00100000:3.0:1783144272.259124:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783144272.259130:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86915:x1869759501265792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783144272.259157:0:86923:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783144272.259159:0:86923:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783144272.259162:0:86923:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:3.0:1783144272.259194:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783144272.259199:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3650:x1869759501265920:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783144272.259212:0:86921:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1783144272.259444:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501265664:0@lo:250:mount.lustre.0 10000000:01000000:2.0:1783144272.262075:0:86924:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783144272.262218:0:86923:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 104 20000000:01000000:0.0:1783144272.264299:0:86925:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783144272.264309:0:86925:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783144272.264313:0:86925:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783144272.264316:0:86925:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783144272.264785:0:86925:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783144272.265082:0:86923:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783144272.265105:0:86923:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783144272.265134:0:86921:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783144272.268192:0:86921:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783144272.268212:0:86921:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783144272.268392:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86915:x1869759501265792:12345-0@lo:253:mount.lustre.0 Request processed in 9253us (9737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.268414:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783144272.268474:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783144272.268488:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3648:x1869759501266048:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783144272.268540:0:86924:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 20000000:01000000:1.0:1783144272.268542:0:86923:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1783144272.268552:0:86924:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783144272.268562:0:86923:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1783144272.268577:0:86924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268596:0:86924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144272.268605:0:86924:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054728s 00010000:00010000:2.0:1783144272.268610:0:86924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268617:0:86924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268624:0:86924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268632:0:86924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268639:0:86924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144272.268643:0:86924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268670:0:86924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268687:0:86924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268698:0:86924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.268704:0:86924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516c00/0xad8e53a4230474db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144272.268823:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3650:x1869759501265920:12345-0@lo:253:kworker.0 Request processed in 9622us (9918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.268834:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783144272.268861:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783144272.268872:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:3648:x1869759501266176:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783144272.268893:0:86921:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:1.0:1783144272.268903:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783144272.268906:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144272.268908:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144272.268908:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144272.268909:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144272.268911:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144272.268912:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144272.268913:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144272.268915:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144272.268929:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501265920:0@lo:253:kworker.0 00000100:00100000:3.0:1783144272.269006:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501265792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783144272.269017:0:86915:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783144272.269019:0:86915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783144272.269020:0:86915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783144272.269021:0:86915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144272.269022:0:86915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144272.269023:0:86915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144272.269023:0:86915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144272.269024:0:86915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144272.269025:0:86915:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783144272.269031:0:86915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144272.269032:0:86915:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783144272.269048:0:86915:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2aee192000 from lustre-MDT0000 10000000:01000000:3.0:1783144272.269080:0:86915:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783144272.269083:0:86915:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783144272.269093:0:86915:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2aee192000 10000000:01000000:3.0:1783144272.269096:0:86915:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783144272.269100:0:86915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2aee192000 10000000:01000000:3.0:1783144272.269102:0:86915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783144272.269105:0:86915:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2aee192000 from 1 10000000:01000000:3.0:1783144272.269108:0:86915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783144272.269142:0:86915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.269150:0:86915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.269158:0:86915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144272.269177:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144272.269208:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.269238:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9ee2540 going to sleep for 11 seconds 00000100:00100000:2.0:1783144272.269275:0:86922:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783144272.269285:0:86922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:3.0:1783144272.271544:0:86923:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783144272.271558:0:86923:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783144272.271610:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266304 00000100:00100000:0.0:1783144272.271619:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266304 20000000:01000000:2.0:1783144272.271697:0:86924:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144272.271702:0:86924:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144272.271719:0:86924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271749:0:86924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144272.271757:0:86924:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054854s 00010000:00010000:2.0:1783144272.271761:0:86924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271767:0:86924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271775:0:86924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783144272.271781:0:86921:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1783144272.271799:0:86924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271806:0:86924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144272.271809:0:86924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271817:0:86924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271827:0:86924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271834:0:86924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.271841:0:86924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517a00/0xad8e53a4230474e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144272.271935:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783144272.271946:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:86915:x1869759501266304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144272.271966:0:86926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144272.271978:0:86926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230474f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230474e2 expref: -99 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.271997:0:86926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230474f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230474e2 expref: 8 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.272008:0:86926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230474f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230474e2 expref: 8 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.272015:0:86926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9e00, rc 0) 00000100:00100000:3.0:1783144272.272112:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3648:x1869759501266048:12345-0@lo:253:kworker.0 Request processed in 3628us (13148us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.272114:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86915:x1869759501266304:12345-0@lo:101:mount.lustre.0 Request processed in 168us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.272127:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783144272.272186:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144272.272206:0:86915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144272.272213:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00010000:00010000:2.0:1783144272.272216:0:86915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144272.272219:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783144272.272226:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144272.272230:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144272.272234:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144272.272236:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144272.272237:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144272.272240:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144272.272242:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783144272.272246:0:86915:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:1.0:1783144272.272248:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501266048:0@lo:253:kworker.0 00010000:00010000:2.0:1783144272.272266:0:86915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.272287:0:86915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144272.272295:0:86915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783144272.272300:0:86915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783144272.272306:0:86915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2aee192000 10000000:01000000:2.0:1783144272.272308:0:86915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783144272.272311:0:86915:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783144272.272313:0:86915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783144272.272338:0:86915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.272350:0:86915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.272358:0:86915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144272.272377:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783144272.272414:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144272.272456:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9dcaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144272.272481:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783144272.272482:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266432 00000100:00100000:1.0:1783144272.272492:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266432 00000100:00100000:0.0:1783144272.272549:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783144272.272565:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:86915:x1869759501266432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144272.272577:0:86926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144272.272593:0:86926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9c00/0xad8e53a4230474fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230474f7 expref: -99 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.272607:0:86926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9c00/0xad8e53a4230474fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230474f7 expref: 8 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.272615:0:86926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9c00/0xad8e53a4230474fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230474f7 expref: 8 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.272621:0:86926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9c00, rc 0) 00000100:00100000:0.0:1783144272.272652:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86915:x1869759501266432:12345-0@lo:101:mount.lustre.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.272667:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783144272.272687:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144272.272699:0:86915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.272707:0:86915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144272.272794:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144272.272817:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144272.272875:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9dcaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144272.272944:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266560 00000100:00100000:3.0:1783144272.272949:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266560 00000100:00100000:3.0:1783144272.272981:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783144272.272987:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86915:x1869759501266560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144272.273133:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:86915:x1869759501266560:12345-0@lo:501:mount.lustre.0 Request processed in 146us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.273140:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783144272.273422:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144272.273447:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144272.273480:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.273627:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266688 00000100:00100000:2.0:1783144272.273631:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9dcaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144272.273632:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266688 00000100:00100000:0.0:1783144272.273668:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783144272.273675:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:86915:x1869759501266688:12345-0@lo:503:mount.lustre.0 20000000:01000000:0.0:1783144272.274710:0:86921:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783144272.274749:0:86921:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783144272.274905:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:86915:x1869759501266688:12345-0@lo:503:mount.lustre.0 Request processed in 1228us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.274914:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783144272.274919:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:3648:x1869759501266176:12345-0@lo:253:kworker.0 Request processed in 6047us (15916us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.274930:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1783144272.274962:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783144272.274964:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783144272.274966:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144272.274967:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144272.274968:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144272.274969:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144272.274971:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144272.274972:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144272.274974:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144272.274977:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501266176:0@lo:253:kworker.0 20000000:01000000:2.0:1783144272.274988:0:86924:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144272.274993:0:86924:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144272.275009:0:86924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275019:0:86924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144272.275027:0:86924:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054854s 00010000:00010000:2.0:1783144272.275031:0:86924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275037:0:86924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275043:0:86924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275049:0:86924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275065:0:86924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144272.275068:0:86924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275075:0:86924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275085:0:86924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275091:0:86924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.275097:0:86924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516200/0xad8e53a423047505 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144272.275167:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501266688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144272.275477:0:86927:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7def100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86927:1869759501266816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.275523:0:86927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.275577:0:86927:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.275604:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266816 00000100:00100000:1.0:1783144272.275609:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266816 00000100:00100000:1.0:1783144272.275666:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783144272.275673:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86927:x1869759501266816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144272.278265:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86927:x1869759501266816:12345-0@lo:502:llog_process_th.0 Request processed in 2588us (2737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.278276:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783144272.278296:0:86927:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7def100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86927:1869759501266816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144272.278330:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144272.278342:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.278344:0:86927:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783144272.278351:0:86927:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783144272.278353:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144272.278370:0:86927:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c2ad08d99c0) 00000020:00000080:0.0:1783144272.278390:0:86927:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1783144272.278395:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783144272.278470:0:86927:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783144272.278481:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047513 00000020:00000080:0.0:1783144272.278692:0:86927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783144272.278696:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.278699:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.278701:0:86927:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783144272.278703:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144272.278707:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.278708:0:86927:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783144272.278711:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144272.278717:0:86927:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c2ad08dcd40) 00000020:00000080:0.0:1783144272.278757:0:86927:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1783144272.278762:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783144272.278765:0:86927:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783144272.278768:0:86927:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783144272.278774:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783144272.278816:0:86927:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aee192000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783144272.278827:0:86927:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c29cb1399c0) 00000020:00000080:0.0:1783144272.278838:0:86927:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1783144272.278884:0:86927:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783144272.278892:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047528 00000020:00000080:0.0:1783144272.278977:0:86927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783144272.278984:0:86927:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783144272.278988:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad8e53a42304752f 00080000:01000000:0.0:1783144272.278992:0:86927:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783144272.278996:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047536 00010000:00010000:0.0:1783144272.317415:0:86927:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1783144272.317554:0:86927:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: cace81e7-a6f2-4d37-b197-caf34583781c idx: 0 lr: 94489280519 srv lr: 98784247808 lx: 0 gen 22 00000001:00080000:0.0:1783144272.317594:0:86927:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 21 00000001:00000004:0.0:1783144272.317618:0:86927:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:0.0:1783144272.317761:0:86927:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1783144272.317816:0:86927:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2aca3d1840: xid 1869759481645568, transno 98784247812, client gen 22, slot idx 0 00000001:00080000:0.0:1783144272.317827:0:86927:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2aca3d10c0: xid 1869759481645312, transno 98784247811, client gen 22, slot idx 1 00000020:00000080:0.0:1783144272.318200:0:86927:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c29cb138000) 00000020:00000080:0.0:1783144272.318219:0:86927:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1783144272.318284:0:86927:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783144272.318291:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047552 00000020:00000080:0.0:1783144272.320412:0:86927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783144272.324622:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad8e53a423047559 00000020:00000080:1.0:1783144272.325140:0:86927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783144272.325153:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144272.325160:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144272.325162:0:86927:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783144272.325167:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783144272.325180:0:86927:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1783144272.325182:0:86927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144272.325199:0:86927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144272.325202:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783144272.325206:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144272.325207:0:86927:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783144272.325211:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144272.325216:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144272.325218:0:86927:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783144272.325223:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783144272.325271:0:86927:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783144272.325292:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144272.325297:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144272.325298:0:86927:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783144272.325301:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144272.325304:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144272.325306:0:86927:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783144272.325309:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783144272.325314:0:86927:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:1.0:1783144272.325339:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144272.325354:0:86927:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c29c356cd40) 00000020:00000080:1.0:1783144272.325373:0:86927:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783144272.325379:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783144272.325437:0:86927:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783144272.325442:0:86927:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783144272.325449:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047567 00010000:00080000:1.0:1783144272.325482:0:86927:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac91e4800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144272.327183:0:86927:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1783144272.329466:0:86927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144272.329477:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783144272.329516:0:86927:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783144272.329540:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304756e 00000100:00080000:0.0:1783144272.329550:0:86927:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144272.329556:0:86927:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2ac91e4800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144272.329587:0:86927:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ac7def100 x1869759501266944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144272.329608:0:86927:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783144272.329636:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501266944:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1783144272.329697:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.329701:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.329702:0:86927:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783144272.329705:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783144272.329707:0:86927:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1783144272.329708:0:86927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783144272.329709:0:86927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783144272.329710:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783144272.329712:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.329713:0:86927:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783144272.329715:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783144272.329737:0:86927:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000100:00100000:3.0:1783144272.329750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1783144272.329756:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.329758:0:86927:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783144272.329762:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783144272.329766:0:86927:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:0.0:1783144272.329783:0:86927:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783144272.329785:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144272.329797:0:86927:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c29cb13b380) 00000020:00000080:0.0:1783144272.329812:0:86927:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1783144272.329816:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1783144272.329818:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501266944 00000100:00100000:3.0:1783144272.329825:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501266944 00000100:00100000:3.0:1783144272.329863:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000004:00080000:0.0:1783144272.329870:0:86927:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00100000:3.0:1783144272.329872:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501266944:12345-0@lo:38:llog_process_th.0 00080000:01000000:0.0:1783144272.329876:0:86927:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783144272.329881:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a42304757c 00010000:00080000:0.0:1783144272.329901:0:86927:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac7fb4800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00080000:3.0:1783144272.329910:0:8447:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2806 last 0 00000020:00000080:3.0:1783144272.329962:0:8447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047583 00000004:00100000:3.0:1783144272.329974:0:8447:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783144272.330054:0:8447:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317c000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1783144272.330071:0:86927:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1783144272.330133:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501266944:12345-0@lo:38:llog_process_th.0 Request processed in 260us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.330142:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:2.0:1783144272.330165:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783144272.330173:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1783144272.330179:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783144272.330184:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783144272.330186:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783144272.330202:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501266944:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783144272.330270:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783144272.330279:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501267072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144272.330306:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144272.330332:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267072 00000100:00100000:2.0:1783144272.330337:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267072 00000100:00080000:1.0:1783144272.330371:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144272.330375:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144272.330377:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144272.330381:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2802 00000100:00080000:1.0:1783144272.330385:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1783144272.330387:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00080000:1.0:1783144272.330394:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144272.330399:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501267072:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144272.330412:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b39f80 x1869759501267200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144272.330457:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501267328:0@lo:400:kworker.0 00000100:00100000:0.0:1783144272.330481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.330567:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267328 00000100:00100000:3.0:1783144272.330571:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267328 00000004:00000024:2.0:1783144272.330662:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144272.330711:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1783144272.330739:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501267328:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783144272.330745:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144272.330750:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144272.330753:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144272.330758:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2802 00000100:00080000:1.0:1783144272.330761:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783144272.330766:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144272.330783:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b39c00 x1869759501267456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144272.330808:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144272.330811:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144272.330813:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144272.330816:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2802 00000100:00080000:1.0:1783144272.330819:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783144272.330822:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144272.330844:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b3aa00 x1869759501267712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144272.332539:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501267072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2140us (2228us total) trans 0 rc 0/0 00000100:00080000:1.0:1783144272.332543:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144272.332547:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1783144272.332549:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00080000:1.0:1783144272.332549:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144272.332553:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2802 00000100:00080000:1.0:1783144272.332557:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783144272.332570:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144272.332592:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af7b12a00 x1869759501268096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144272.332630:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501267840:0@lo:400:kworker.0 00000100:00100000:1.0:1783144272.332671:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.332701:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144272.332707:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501267584:0@lo:400:kworker.0 00000100:00100000:1.0:1783144272.332750:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144272.332824:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267840 00000100:00100000:2.0:1783144272.332830:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267840 00000100:00100000:1.0:1783144272.332847:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501267968:0@lo:400:kworker.0 00000100:00100000:2.0:1783144272.332864:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1783144272.332872:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501267840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144272.332872:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.332901:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267968 00000100:00100000:1.0:1783144272.332905:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267968 00000100:00100000:2.0:1783144272.332912:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501267840:12345-0@lo:400:kworker.0 Request processed in 42us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144272.332919:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1783144272.332965:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501267328:12345-0@lo:400:kworker.0 Request processed in 2247us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.332977:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1783144272.332989:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267584 00000100:00100000:3.0:1783144272.332992:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267584 00000100:00100000:0.0:1783144272.332993:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501267328:0@lo:400:kworker.0 00000100:00100000:3.0:1783144272.333014:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1783144272.333021:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501267584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144272.333024:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501267072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144272.333050:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501267584:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.333055:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00080000:3.0:1783144272.333071:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144272.333075:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144272.333077:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144272.333153:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1783144272.333162:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501267968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144272.333211:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501267968:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.333217:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1783144272.333242:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501267584:0@lo:400:kworker.0 00000100:00100000:1.0:1783144272.333251:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501267840:0@lo:400:kworker.0 00000100:00100000:3.0:1783144272.333258:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501267968:0@lo:400:kworker.0 00000100:00100000:1.0:1783144272.333273:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501267200:0@lo:38:kworker.0 00000100:00100000:1.0:1783144272.333307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.333328:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501267456:0@lo:38:kworker.0 00000100:00100000:0.0:1783144272.333336:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267200 00000100:00100000:0.0:1783144272.333342:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267200 00000100:00100000:1.0:1783144272.333349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.333538:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267456 00000100:00100000:0.0:1783144272.333542:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267456 00000100:00100000:0.0:1783144272.333615:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:0.0:1783144272.333622:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501267200:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144272.333636:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1783144272.333642:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501267456:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144272.333674:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501267200:12345-0@lo:38:kworker.0 Request processed in 50us (365us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144272.333684:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1783144272.333688:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501267456:12345-0@lo:38:kworker.0 Request processed in 43us (337us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783144272.333696:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1783144272.333823:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501267712:0@lo:38:kworker.0 00000100:00100000:1.0:1783144272.333854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.333875:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501268096:0@lo:38:kworker.0 00000100:00100000:1.0:1783144272.333894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144272.333926:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144272.333930:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144272.333934:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501267200:0@lo:38:kworker.0 00000100:00100000:0.0:1783144272.333938:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268096 00000100:00080000:1.0:1783144272.333942:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144272.333946:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144272.333951:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501267456:0@lo:38:kworker.0 00000100:00100000:0.0:1783144272.333952:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268096 00000100:00100000:0.0:1783144272.333986:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1783144272.333992:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501268096:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144272.334005:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501267712 00000100:00100000:3.0:1783144272.334009:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501267712 00000100:00100000:3.0:1783144272.334035:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:3.0:1783144272.334046:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501267712:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144272.334046:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501268096:12345-0@lo:38:kworker.0 Request processed in 48us (145us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144272.334060:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00080000:1.0:1783144272.334085:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783144272.334087:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501267712:12345-0@lo:38:kworker.0 Request processed in 44us (231us total) trans 0 rc -11/-11 00000100:00080000:1.0:1783144272.334088:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144272.334091:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501268096:0@lo:38:kworker.0 00000100:00100000:3.0:1783144272.334093:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00080000:1.0:1783144272.334105:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144272.334109:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144272.334112:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501267712:0@lo:38:kworker.0 00000040:01000000:1.0:1783144272.334276:0:86927:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783144272.334300:0:86927:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783144272.334926:0:86927:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1783144272.335667:0:86927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783144272.335715:0:86927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:1.0:1783144272.339154:0:86927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:1.0:1783144272.339493:0:86933:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:1.0:1783144272.339508:0:86933:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783144272.339651:0:86933:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1783144272.339672:0:86933:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783144272.339847:0:86933:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:1.0:1783144272.339856:0:86933:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783144272.340011:0:86927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144272.340024:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783144272.340060:0:86927:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783144272.340082:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304758a 00000100:00080000:0.0:1783144272.340092:0:86927:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144272.340098:0:86927:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2ac7fb4800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144272.340129:0:86927:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b3aa00 x1869759501268224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144272.340155:0:86927:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783144272.340246:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501268224:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1783144272.340455:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.340460:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.340461:0:86927:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783144272.340465:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783144272.340467:0:86927:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1783144272.340469:0:86927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783144272.340470:0:86927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783144272.340471:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783144272.340473:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.340474:0:86927:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783144272.340477:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783144272.340480:0:86927:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783144272.340483:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.340484:0:86927:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783144272.340486:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783144272.340490:0:86927:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000100:00100000:1.0:1783144272.340492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783144272.340528:0:86927:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783144272.340530:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144272.340540:0:86927:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c29c3f119c0) 00000020:00000080:0.0:1783144272.340555:0:86927:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1783144272.340560:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1783144272.340587:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268224 00000100:00100000:3.0:1783144272.340594:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268224 00000004:00080000:0.0:1783144272.340619:0:86927:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783144272.340624:0:86927:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000100:00100000:3.0:1783144272.340628:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4927 00000020:00000080:0.0:1783144272.340630:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047598 00000100:00100000:3.0:1783144272.340642:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3647:x1869759501268224:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783144272.340660:0:86927:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2b017f6000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00080000:3.0:1783144272.340668:0:26140:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2806 last 0 00000020:00000080:3.0:1783144272.340688:0:26140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304759f 00002000:00100000:3.0:1783144272.340701:0:26140:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2ac9c73800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783144272.340706:0:26140:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783144272.340709:0:26140:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:0.0:1783144272.340884:0:86927:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00002000:00080000:3.0:1783144272.340909:0:26140:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783144272.340931:0:26140:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c71800 : changing import state from RECOVER to FULL 00000040:01000000:0.0:1783144272.340938:0:86927:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783144272.340951:0:86927:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783144272.341019:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501268224:12345-0@lo:8:llog_process_th.0 Request processed in 377us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.341026:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4927 00000100:00100000:1.0:1783144272.341090:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783144272.341098:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783144272.341104:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783144272.341108:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783144272.341110:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783144272.341173:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783144272.341180:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501268224:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783144272.341224:0:86933:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783144272.341264:0:86933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2806694541007ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783144272.341269:0:86933:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:0.0:1783144272.341708:0:86927:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:2.0:1783144272.342142:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783144272.342156:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501268352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144272.342236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.342271:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268352 00000100:00100000:0.0:1783144272.342277:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268352 00000100:00080000:3.0:1783144272.342311:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144272.342336:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1783144272.342345:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501268352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783144272.342365:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144272.342415:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501268352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.342421:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:3.0:1783144272.342587:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501268352:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783144272.342829:0:86927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783144272.342856:0:86927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:0.0:1783144272.343098:0:86927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:3.0:1783144272.343742:0:86935:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:3.0:1783144272.343746:0:86935:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783144272.343860:0:86935:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1783144272.343875:0:86935:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783144272.343977:0:86935:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:3.0:1783144272.343980:0:86935:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1783144272.344954:0:86916:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:0.0:1783144272.344963:0:86927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144272.344975:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783144272.345011:0:86927:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783144272.345031:0:86927:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a4230475a6 00000100:00080000:0.0:1783144272.345038:0:86927:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144272.345043:0:86927:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2b017f6000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144272.345069:0:86927:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b39c00 x1869759501268480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144272.345091:0:86927:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1783144272.345118:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501268480:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1783144272.345134:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.345140:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.345142:0:86927:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783144272.345150:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144272.345156:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.345158:0:86927:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783144272.345162:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783144272.345164:0:86927:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783144272.345168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783144272.345170:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.345174:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.345176:0:86927:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783144272.345178:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144272.345180:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.345182:0:86927:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783144272.345186:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783144272.345214:0:86927:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86927:1869759501268608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.345260:0:86927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.345270:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268480 00000100:00100000:3.0:1783144272.345277:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268480 00000100:00100000:0.0:1783144272.345282:0:86927:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad1388c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144272.345312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928 00000100:00100000:3.0:1783144272.345321:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1869759501268480:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783144272.345339:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2806 last 0 00000020:00000080:3.0:1783144272.345360:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a4230475ad 00002000:00100000:3.0:1783144272.345375:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2ac9c70000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783144272.345377:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783144272.345379:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783144272.345413:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783144272.345429:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c76000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144272.345473:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501268480:12345-0@lo:8:llog_process_th.0 Request processed in 145us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.345479:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928 00000100:00100000:0.0:1783144272.345509:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783144272.345518:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783144272.345524:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783144272.345528:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783144272.345531:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2b017f6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783144272.345541:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268608 00000100:00100000:1.0:1783144272.345547:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268608 00000100:00100000:1.0:1783144272.345578:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783144272.345591:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86927:x1869759501268608:12345-0@lo:502:llog_process_th.0 00000004:00080000:0.0:1783144272.345607:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783144272.345618:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501268480:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783144272.345658:0:86935:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783144272.345683:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86927:x1869759501268608:12345-0@lo:502:llog_process_th.0 Request processed in 97us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.345691:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:2.0:1783144272.345697:0:86935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2806698974068ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783144272.345705:0:86935:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783144272.345769:0:86927:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86927:1869759501268608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144272.345798:0:86927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.345802:0:86927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.345804:0:86927:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783144272.345809:0:86927:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783144272.345871:0:86915:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783144272.345893:0:86915:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783144272.345906:0:86915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.345914:0:86915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144272.345920:0:86915:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2aee192000 from 1 10000000:01000000:0.0:1783144272.345922:0:86915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783144272.345940:0:86915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.345946:0:86915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.345953:0:86915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144272.345964:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501268736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783144272.345990:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.346029:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144272.346123:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501268864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783144272.346149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.346186:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268864 00000100:00100000:1.0:1783144272.346219:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268736 00000100:00100000:1.0:1783144272.346223:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268736 00000100:00100000:1.0:1783144272.346252:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783144272.346259:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:86915:x1869759501268736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144272.346267:0:86923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144272.346281:0:86923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230475b4 expref: -99 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.346308:0:86923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 9 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.346318:0:86923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 9 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.346327:0:86923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47de00, rc 0) 00000100:00100000:1.0:1783144272.346404:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:86915:x1869759501268736:12345-0@lo:101:mount.lustre.0 Request processed in 145us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.346411:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783144272.346461:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268864 00000100:00100000:0.0:1783144272.346479:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501268736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144272.346508:0:86915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.346519:0:86915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144272.346527:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1783144272.346537:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501268864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783144272.346554:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144272.346599:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501268864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.346605:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00080000:3.0:1783144272.346623:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144272.347103:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501268992:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783144272.347137:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.347156:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144272.347183:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501268864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144272.347353:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501268992 00000100:00100000:2.0:1783144272.347357:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501268992 00000100:00100000:2.0:1783144272.347379:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783144272.347386:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:86915:x1869759501268992:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783144272.347401:0:86921:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783144272.347416:0:86921:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783144272.347420:0:86921:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783144272.347423:0:86921:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783144272.347426:0:86921:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 107 00000100:00100000:2.0:1783144272.347517:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:86915:x1869759501268992:12345-0@lo:256:mount.lustre.0 Request processed in 130us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.347519:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501268992:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783144272.347531:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1783144272.348001:0:86916:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:0.0:1783144272.348066:0:86915:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783144272.348087:0:86915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.348096:0:86915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144272.348103:0:86915:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2aee192000 from 1 10000000:01000000:0.0:1783144272.348106:0:86915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783144272.348124:0:86915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.348131:0:86915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.348139:0:86915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144272.348159:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783144272.348182:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.348206:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:3.0:1783144272.348214:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501269120 00000100:00100000:3.0:1783144272.348288:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501269120 00000100:00100000:3.0:1783144272.348320:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783144272.348328:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:86915:x1869759501269120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144272.348336:0:86923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144272.348349:0:86923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043fa00/0xad8e53a4230475c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230475c2 expref: -99 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.348364:0:86923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043fa00/0xad8e53a4230475c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230475c2 expref: 10 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.348385:0:86923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043fa00/0xad8e53a4230475c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230475c2 expref: 10 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.348392:0:86923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043fa00, rc 0) 00000100:00100000:3.0:1783144272.348425:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86915:x1869759501269120:12345-0@lo:101:mount.lustre.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.348432:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783144272.348450:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144272.348462:0:86915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.348471:0:86915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144272.348525:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144272.348548:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.348598:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.348626:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501269248 00000100:00100000:1.0:1783144272.348630:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501269248 00000100:00100000:1.0:1783144272.348657:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783144272.348663:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86915:x1869759501269248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144272.348863:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86915:x1869759501269248:12345-0@lo:501:mount.lustre.0 Request processed in 199us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.348870:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783144272.348912:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144272.348932:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144272.348968:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.349025:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.349053:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501269376 00000100:00100000:1.0:1783144272.349057:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501269376 00000100:00100000:1.0:1783144272.349080:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783144272.349086:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86915:x1869759501269376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144272.349194:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86915:x1869759501269376:12345-0@lo:503:mount.lustre.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.349198:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783144272.349258:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144272.349646:0:86937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86937:1869759501269504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.349672:0:86937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.349688:0:86937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144272.349700:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501269504 00000100:00100000:2.0:1783144272.349705:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501269504 00000100:00100000:2.0:1783144272.349754:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783144272.349762:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86937:x1869759501269504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144272.350287:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86937:x1869759501269504:12345-0@lo:502:llog_process_th.0 Request processed in 522us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144272.350294:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783144272.350306:0:86937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86937:1869759501269504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144272.350325:0:86937:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144272.350337:0:86937:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.350340:0:86937:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783144272.350348:0:86937:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2aee192000 00000020:00000080:0.0:1783144272.350350:0:86937:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783144272.350358:0:86937:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.350361:0:86937:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.350362:0:86937:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783144272.350364:0:86937:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144272.350367:0:86937:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.350368:0:86937:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783144272.350371:0:86937:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2aee192000 00000020:00000080:0.0:1783144272.350373:0:86937:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783144272.350443:0:86937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86937:1869759501269632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.350473:0:86937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.350514:0:86937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144272.350628:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501269632 00000100:00100000:3.0:1783144272.350632:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501269632 00000100:00100000:3.0:1783144272.350663:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783144272.350669:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86937:x1869759501269632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144272.350776:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86937:x1869759501269632:12345-0@lo:502:llog_process_th.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.350782:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783144272.350916:0:86937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86937:1869759501269632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144272.350933:0:86937:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144272.350936:0:86937:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144272.350938:0:86937:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783144272.350941:0:86937:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783144272.351038:0:86915:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783144272.351062:0:86915:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783144272.351073:0:86915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.351083:0:86915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144272.351131:0:86915:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783144272.351134:0:86915:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2aee192000 10000000:01000000:3.0:1783144272.351137:0:86915:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2aee192000 10000000:01000000:3.0:1783144272.351141:0:86915:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783144272.351146:0:86915:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2aee192000 from 1 10000000:01000000:3.0:1783144272.351154:0:86915:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144272.351175:0:86915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.351184:0:86915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.351191:0:86915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144272.351203:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144272.351247:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.351279:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9dcaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.351299:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501269760 00000100:00100000:1.0:1783144272.351304:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501269760 00000100:00100000:1.0:1783144272.351342:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783144272.351348:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac4dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:86915:x1869759501269760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144272.351361:0:86926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144272.351371:0:86926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47da00/0xad8e53a4230475d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230475d0 expref: -99 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.351390:0:86926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47da00/0xad8e53a4230475d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230475d0 expref: 11 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.351401:0:86926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47da00/0xad8e53a4230475d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230475d0 expref: 11 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.351408:0:86926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47da00, rc 0) 00000100:00100000:1.0:1783144272.351445:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac4dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86915:x1869759501269760:12345-0@lo:101:mount.lustre.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.351451:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783144272.351554:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144272.351566:0:86915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.351575:0:86915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144272.351617:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144272.351640:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.351660:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9dcaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.351704:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501269888 00000100:00100000:1.0:1783144272.351708:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501269888 00000100:00100000:1.0:1783144272.351756:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783144272.351763:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86915:x1869759501269888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144272.351856:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86915:x1869759501269888:12345-0@lo:501:mount.lustre.0 Request processed in 94us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.351866:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783144272.352093:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501269888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144272.352116:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501270016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144272.352148:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.352172:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9dcaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.352267:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270016 00000100:00100000:1.0:1783144272.352271:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270016 00000100:00100000:1.0:1783144272.352299:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783144272.352306:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86915:x1869759501270016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144272.352382:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86915:x1869759501270016:12345-0@lo:503:mount.lustre.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.352394:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783144272.352464:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501270016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144272.353085:0:86939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86939:1869759501270144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.353121:0:86939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.353148:0:86939:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.353189:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270144 00000100:00100000:1.0:1783144272.353193:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270144 00000100:00100000:1.0:1783144272.354341:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783144272.354352:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86939:x1869759501270144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144272.354468:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86939:x1869759501270144:12345-0@lo:502:llog_process_th.0 Request processed in 118us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.354476:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783144272.354718:0:86939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86939:1869759501270144:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783144272.354796:0:86939:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783144272.354809:0:86939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c29c3f10000) 00000020:00000080:0.0:1783144272.354838:0:86939:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783144272.354993:0:86939:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aee192000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783144272.354997:0:86939:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aee192000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783144272.355005:0:86939:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aee192000 4 00010000:00080000:0.0:1783144272.355033:0:86939:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac7528000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1783144272.357674:0:86939:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1783144272.357802:0:86939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783144272.357847:0:86939:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783144272.357858:0:86939:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad8e53a4230475e5 00000100:00080000:0.0:1783144272.357867:0:86939:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144272.357873:0:86939:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ac7528000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144272.357912:0:86939:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b39f80 x1869759501270272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144272.357931:0:86939:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783144272.358080:0:86939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86939:1869759501270400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.358146:0:86939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.358176:0:86939:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.358289:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501270272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144272.358324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144272.358365:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270400 00000100:00100000:1.0:1783144272.358371:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270400 00000100:00100000:1.0:1783144272.358408:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783144272.358417:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86939:x1869759501270400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144272.358534:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86939:x1869759501270400:12345-0@lo:502:llog_process_th.0 Request processed in 118us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.358542:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783144272.358622:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270272 00000100:00100000:0.0:1783144272.358626:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270272 00000100:00100000:0.0:1783144272.358690:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1783144272.358695:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501270272:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783144272.358764:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501270272:12345-0@lo:38:llog_process_th.0 Request processed in 68us (439us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144272.358772:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1783144272.358867:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783144272.358874:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7528000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144272.358878:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783144272.358881:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501270272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783144272.358909:0:86939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86939:1869759501270400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.358950:0:86939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86939:1869759501270528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.358982:0:86939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144272.359003:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270528 00000100:00100000:0.0:1783144272.359007:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270528 00000100:00100000:0.0:1783144272.359030:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783144272.359037:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86939:x1869759501270528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144272.359099:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86939:x1869759501270528:12345-0@lo:502:llog_process_th.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.359105:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783144272.359139:0:86939:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144272.359148:0:86939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86939:1869759501270528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783144272.359164:0:86939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783144272.359456:0:86915:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783144272.359480:0:86915:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144272.359542:0:86915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.359554:0:86915:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783144272.359601:0:86915:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783144272.359604:0:86915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144272.359605:0:86915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144272.359607:0:86915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144272.359608:0:86915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144272.359610:0:86915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144272.359611:0:86915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144272.359613:0:86915:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144272.359615:0:86915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144272.359616:0:86915:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783144272.359620:0:86915:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783144272.359623:0:86915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783144272.359630:0:86915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144272.359631:0:86915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144272.359632:0:86915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144272.359633:0:86915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144272.359634:0:86915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144272.359634:0:86915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144272.359635:0:86915:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144272.359636:0:86915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144272.359637:0:86915:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783144272.359651:0:86915:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783144272.359661:0:86915:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501270656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783144272.359695:0:86915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144272.359718:0:86915:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1783144272.359799:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270656 00000100:00100000:0.0:1783144272.359804:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270656 00000100:00100000:0.0:1783144272.359828:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783144272.359834:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef6b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86915:x1869759501270656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783144272.359853:0:86926:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783144272.359866:0:86926:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783144272.363959:0:86926:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783144272.364000:0:86926:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783144272.364086:0:86924:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144272.364091:0:86924:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144272.364112:0:86924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.364127:0:86924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 11 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.364136:0:86924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.364171:0:86924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 11 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144272.364186:0:86924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 11 pid: 86923 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144272.364256:0:86924:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:86924:1869759501270784:0@lo:104: 00000100:00100000:2.0:1783144272.364312:0:86924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144272.364455:0:86924:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1783144272.364600:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270784 00000100:00100000:1.0:1783144272.364608:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270784 00000100:00100000:0.0:1783144272.364645:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef6b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:86915:x1869759501270656:12345-0@lo:253:mount.lustre.0 Request processed in 4808us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144272.364654:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1783144272.364657:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783144272.364666:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:86924:x1869759501270784:12345-0@lo:104: 00010000:00010000:1.0:1783144272.364679:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.364753:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783144272.364761:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:86924:x1869759501270784:12345-0@lo:104: Request processed in 98us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144272.364776:0:86915:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:86915:1869759501270656:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783144272.364789:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 10000000:01000000:2.0:1783144272.364790:0:86915:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783144272.364795:0:86915:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783144272.364797:0:86915:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144272.364798:0:86915:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144272.364800:0:86915:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144272.364801:0:86915:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144272.364803:0:86915:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144272.364805:0:86915:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144272.364806:0:86915:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144272.364808:0:86915:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144272.364810:0:86915:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783144272.364825:0:86915:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783144272.364831:0:86924:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:86924:1869759501270784:0@lo:104: 00010000:00010000:1.0:1783144272.364849:0:86924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.365420:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144272.365427:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.365447:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9400 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144272.365451:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.365460:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144272.365467:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144272.365473:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144272.365520:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.365527:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144272.365554:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.365561:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9400/0xad8e53a4230475b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230475bb expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144272.365575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144272.365577:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144272.365579:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144272.365776:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144272.365796:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501270912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144272.365837:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.365883:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501270912 00000100:00100000:3.0:1783144272.365888:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501270912 00010000:00010000:3.0:1783144272.365911:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 11 pid: 86923 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144272.365935:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1783144272.365943:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3648:x1869759501270912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144272.365954:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144272.365959:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 11 pid: 86923 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.365970:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 11 pid: 86923 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.365984:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47de00/0xad8e53a4230475bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230475b4 expref: 11 pid: 86923 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.365998:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366006:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783144272.366019:0:10343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001928809s 00010000:00010000:3.0:1783144272.366023:0:10343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366030:0:10343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366047:0:10343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366054:0:10343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366059:0:10343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144272.366063:0:10343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366070:0:10343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366085:0:10343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144272.366094:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144272.366128:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:3648:x1869759501270912:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.366135:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1783144272.366186:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501270912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144272.366321:0:86924:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.366330:0:86924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144272.366337:0:86924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516200/0xad8e53a4230475ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783144272.371946:0:86915:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:2.0:1783144272.372551:0:86915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783144272.372865:0:86945:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:0.0:1783144272.372870:0:86945:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:2.0:1783144272.377034:0:86946:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783144272.377062:0:86915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783144272.377425:0:86946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783144272.377879:0:86947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86947:1869759501271040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144272.377945:0:86947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.377983:0:86947:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad4c6ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144272.378056:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271040 00000100:00100000:0.0:1783144272.378069:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271040 00000100:00100000:0.0:1783144272.378154:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:0.0:1783144272.378167:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86947:x1869759501271040:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783144272.378232:0:86915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:0.0:1783144272.378252:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86947:x1869759501271040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144272.378261:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000040:00080000:1.0:1783144272.378266:0:86915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783144272.378324:0:86947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86947:1869759501271040:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783144272.378350:0:86947:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783144272.378374:0:86947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86947:1869759501271168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144272.378408:0:86947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.378429:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271168 00000100:00100000:3.0:1783144272.378433:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271168 00000100:00100000:3.0:1783144272.378471:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:3.0:1783144272.378477:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86947:x1869759501271168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144272.378584:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86947:x1869759501271168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.378593:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:3.0:1783144272.378613:0:86947:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad4c6ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144272.378625:0:86947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86947:1869759501271168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144272.378666:0:86947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86947:1869759501271296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144272.378686:0:86947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144272.378704:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271296 00000100:00100000:3.0:1783144272.378708:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271296 00000100:00100000:3.0:1783144272.378755:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:3.0:1783144272.378763:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86947:x1869759501271296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144272.378803:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86947:x1869759501271296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144272.378810:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:3.0:1783144272.378827:0:86947:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad4c6ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144272.378839:0:86947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86947:1869759501271296:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783144272.378870:0:86947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783144272.381513:0:86915:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783144272.381701:0:86915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783144272.381828:0:86915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783144272.387515:0:86946:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783144272.387596:0:86946:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1783144272.388131:0:86915:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783144272.389218:0:86915:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783144272.389257:0:86915:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783144272.389357:0:86915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783144272.389955:0:86915:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00000040:00080000:3.0:1783144272.390042:0:86947:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783144272.390100:0:86947:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783144272.390105:0:86947:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1783144272.391756:0:86915:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247812 00010000:00080000:0.0:1783144272.392429:0:86948:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 86948 00010000:02000000:0.0:1783144272.392446:0:86948:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1783144272.392449:0:86948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783144272.392453:0:86948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783144272.392573:0:86915:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783144272.392588:0:86915:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783144272.392606:0:86915:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783144272.392626:0:86915:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783144272.393647:0:86915:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144272.393950:0:86915:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783144272.846854:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783144273.806105:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783144273.806112:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2aee192000 from 108 10000000:01000000:1.0:1783144273.806116:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783144273.806170:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.806243:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.806260:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144273.806292:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.806399:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.806560:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271424 00000100:00100000:0.0:1783144273.806576:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271424 00000100:00100000:1.0:1783144273.806590:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.806655:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783144273.806670:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef6b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:6518:x1869759501271424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.806687:0:86922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.806707:0:86922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8400/0xad8e53a4230475fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230475f3 expref: -99 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.806839:0:86922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8400/0xad8e53a4230475fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230475f3 expref: 11 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.806861:0:86922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8400/0xad8e53a4230475fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230475f3 expref: 11 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.806870:0:86922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8400, rc 0) 00000100:00100000:0.0:1783144273.806942:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef6b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501271424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.806949:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783144273.807334:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144273.807366:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.807376:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144273.807435:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.807478:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144273.807517:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.807548:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271552 00000100:00100000:0.0:1783144273.807555:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271552 00000100:00100000:0.0:1783144273.807596:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783144273.807604:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef6b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501271552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783144273.807619:0:86921:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783144273.807635:0:86921:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783144273.807638:0:86921:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 108 00000100:00100000:0.0:1783144273.807942:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef6b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501271552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 338us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.807951:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783144273.808971:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783144273.809030:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783144273.809039:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.809049:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144273.809058:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144273.809066:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 52 10000000:01000000:2.0:1783144273.809069:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144273.809098:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.809107:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.809116:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.809136:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.809172:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.809212:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6fb8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.809309:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271680 00000100:00100000:0.0:1783144273.809316:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271680 00000100:00100000:0.0:1783144273.809359:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783144273.809367:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501271680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.809377:0:86923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.809389:0:86923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9a00/0xad8e53a423047608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047601 expref: -99 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.809408:0:86923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9a00/0xad8e53a423047608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047601 expref: 12 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.809440:0:86923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9a00/0xad8e53a423047608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047601 expref: 12 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.809448:0:86923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9a00, rc 0) 00000100:00100000:0.0:1783144273.809502:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501271680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.809510:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783144273.809530:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144273.809544:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.809554:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.809603:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.809627:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.809647:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6fb8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783144273.809685:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271808 00000100:00100000:1.0:1783144273.809689:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271808 00000100:00100000:1.0:1783144273.809818:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783144273.809827:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501271808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.810001:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501271808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144273.810009:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783144273.810039:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.810077:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.810119:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.810145:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501271936 00000100:00100000:0.0:1783144273.810147:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144273.810150:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501271936 00000100:00100000:2.0:1783144273.810178:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783144273.810184:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501271936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.810254:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501271936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144273.810267:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783144273.810340:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501271936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144273.811840:0:87113:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783144273.811929:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783144273.811953:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144273.811963:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.811974:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.811983:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783144273.811985:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2ac91e0000 from 105 10000000:01000000:3.0:1783144273.811988:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144273.812011:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.812019:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.812028:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.812044:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.812087:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.812119:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.812134:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272064 00000100:00100000:0.0:1783144273.812141:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272064 00000100:00100000:0.0:1783144273.812189:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783144273.812206:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501272064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.812216:0:86922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.812229:0:86922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423047616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304760f expref: -99 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.812249:0:86922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423047616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304760f expref: 13 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.812259:0:86922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423047616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304760f expref: 13 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.812274:0:86922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8800, rc 0) 00000100:00100000:0.0:1783144273.812321:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501272064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.812329:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783144273.812445:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144273.812459:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047616 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.812468:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047616 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.812528:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.812563:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.813261:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6fb89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.813612:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272192 00000100:00100000:3.0:1783144273.813618:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272192 00000100:00100000:3.0:1783144273.813652:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783144273.813661:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501272192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144273.813675:0:86923:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783144273.813690:0:86923:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144273.813698:0:86923:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783144273.813701:0:86923:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783144273.813705:0:86923:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783144273.813707:0:86923:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:3.0:1783144273.813873:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501272192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 212us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.813881:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783144273.813897:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783144273.813991:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783144273.813999:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047616 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.814009:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047616 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144273.814017:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783144273.814019:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783144273.814022:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783144273.814042:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.814049:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.814068:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.814082:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.814111:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.814140:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6fb89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.814152:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272320 00000100:00100000:0.0:1783144273.814167:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272320 00000100:00100000:0.0:1783144273.814203:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783144273.814211:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501272320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.814218:0:86921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.814231:0:86921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9200/0xad8e53a423047624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304761d expref: -99 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.814249:0:86921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9200/0xad8e53a423047624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304761d expref: 14 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.814258:0:86921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9200/0xad8e53a423047624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304761d expref: 14 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.814265:0:86921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9200, rc 0) 00000100:00100000:0.0:1783144273.814301:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501272320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.814308:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783144273.814329:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144273.814342:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.814451:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.814526:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.814557:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.814580:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6fb89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.814600:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272448 00000100:00100000:0.0:1783144273.814605:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272448 00000100:00100000:0.0:1783144273.814638:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783144273.814645:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501272448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.814798:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501272448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.814813:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783144273.814846:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.814876:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.814927:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.814955:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.815034:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272576 00000100:00100000:3.0:1783144273.815039:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272576 00000100:00100000:3.0:1783144273.815069:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783144273.815077:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501272576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.816913:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501272576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1832us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144273.816924:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783144273.817021:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144273.819220:0:87118:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1783144273.819441:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1783144273.819475:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783144273.819497:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.819509:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144273.819519:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1783144273.819522:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2ac91e0000 from 1 10000000:01000000:0.0:1783144273.819525:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783144273.819558:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.819566:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.819841:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144273.819866:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.819928:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.819982:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799000 going to sleep for 11 seconds 00000100:00100000:1.0:1783144273.820582:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272704 00000100:00100000:1.0:1783144273.820590:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272704 00000100:00100000:1.0:1783144273.820649:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783144273.820660:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501272704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144273.820674:0:86926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144273.820688:0:86926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c400/0xad8e53a423047632 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304762b expref: -99 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.820745:0:86926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c400/0xad8e53a423047632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304762b expref: 15 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.820773:0:86926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c400/0xad8e53a423047632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304762b expref: 15 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.820783:0:86926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c400, rc 0) 00000100:00100000:1.0:1783144273.820844:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501272704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144273.820852:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783144273.820860:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.820878:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047632 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.820888:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047632 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.820902:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783144273.820907:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047632 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.820914:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047632 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.820920:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144273.820923:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2ac91e0000 from 7 10000000:01000000:3.0:1783144273.820925:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144273.820948:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.820959:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.820967:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.820981:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.821015:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.821031:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.821046:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272832 00000100:00100000:3.0:1783144273.821049:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272832 00000100:00100000:3.0:1783144273.821074:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783144273.821080:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501272832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.821087:0:86921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144273.821096:0:86921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043f800/0xad8e53a423047640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047639 expref: -99 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.821109:0:86921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043f800/0xad8e53a423047640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047639 expref: 16 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.821118:0:86921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043f800/0xad8e53a423047640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047639 expref: 16 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.821124:0:86921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043f800, rc 0) 00000100:00100000:3.0:1783144273.821151:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501272832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.821157:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783144273.821194:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.821204:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047640 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.821212:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047640 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.821267:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.821291:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.821309:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.821322:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501272960 00000100:00100000:3.0:1783144273.821325:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501272960 00000100:00100000:3.0:1783144273.821345:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783144273.821351:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef848c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501272960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.821465:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef848c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501272960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.821471:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783144273.821511:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501272960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.821537:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.821576:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.821592:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.821608:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273088 00000100:00100000:3.0:1783144273.821611:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273088 00000100:00100000:3.0:1783144273.821637:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783144273.821645:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef849050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501273088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.821744:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef849050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501273088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.821756:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783144273.821796:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144273.822662:0:87121:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783144273.822860:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783144273.822881:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783144273.822890:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047640 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.822900:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047640 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.822909:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144273.822911:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 52 10000000:01000000:3.0:1783144273.822914:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144273.822938:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.822945:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.822953:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.822967:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.823003:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.823025:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6bdccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.823040:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273216 00000100:00100000:3.0:1783144273.823044:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273216 00000100:00100000:3.0:1783144273.823106:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783144273.823114:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501273216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.823130:0:86922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144273.823140:0:86922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043fc00/0xad8e53a42304764e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047647 expref: -99 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.823157:0:86922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043fc00/0xad8e53a42304764e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047647 expref: 17 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.823166:0:86922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043fc00/0xad8e53a42304764e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047647 expref: 17 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.823174:0:86922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043fc00, rc 0) 00000100:00100000:3.0:1783144273.823205:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501273216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.823211:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783144273.823332:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.823345:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304764e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.823354:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304764e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.823400:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.823499:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.823514:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6bdccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.823525:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273344 00000100:00100000:3.0:1783144273.823528:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273344 00000100:00100000:3.0:1783144273.823551:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783144273.823557:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef848450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501273344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.823668:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef848450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501273344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.823675:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783144273.823710:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.823826:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.823863:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.823924:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6bdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144273.823960:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273472 00000100:00100000:1.0:1783144273.823965:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273472 00000100:00100000:1.0:1783144273.824024:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783144273.824032:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef849850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501273472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.824107:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef849850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501273472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144273.824114:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783144273.824195:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144273.824887:0:87122:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783144273.824956:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783144273.824980:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144273.824988:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304764e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.824996:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304764e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144273.825013:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783144273.825015:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783144273.825018:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783144273.825036:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.825043:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.825051:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144273.825064:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.825093:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144273.825120:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144273.825328:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273600 00000100:00100000:2.0:1783144273.825332:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273600 00000100:00100000:2.0:1783144273.825362:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783144273.825370:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef848050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501273600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144273.825379:0:86921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144273.825390:0:86921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517800/0xad8e53a42304765c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047655 expref: -99 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.825415:0:86921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517800/0xad8e53a42304765c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047655 expref: 18 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.825421:0:86921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517800/0xad8e53a42304765c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047655 expref: 18 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.825427:0:86921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517800, rc 0) 00000100:00100000:2.0:1783144273.825468:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef848050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501273600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144273.825475:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783144273.825514:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144273.825527:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304765c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144273.825536:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304765c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144273.825575:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.825597:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144273.825612:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.825628:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273728 00000100:00100000:3.0:1783144273.825632:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273728 00000100:00100000:3.0:1783144273.825656:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783144273.825663:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501273728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.825892:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501273728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.825900:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783144273.825960:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.825980:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.826008:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144273.826027:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.826055:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273856 00000100:00100000:3.0:1783144273.826058:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273856 00000100:00100000:3.0:1783144273.826080:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783144273.826087:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501273856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.828286:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501273856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2193us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144273.828299:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783144273.828873:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c6158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144273.830248:0:87123:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783144273.830386:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783144273.830411:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783144273.830422:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304765c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.830434:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304765c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.830456:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144273.830459:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2b017f2000 from 7 10000000:01000000:3.0:1783144273.830462:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144273.830507:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.830516:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.830526:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.830548:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.830599:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.830641:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6bdc300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.830643:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501273984 00000100:00100000:0.0:1783144273.830650:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501273984 00000100:00100000:0.0:1783144273.830695:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783144273.830705:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501273984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.830718:0:86926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.831237:0:86926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9600/0xad8e53a42304766a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047663 expref: -99 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.831263:0:86926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9600/0xad8e53a42304766a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047663 expref: 19 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.831274:0:86926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9600/0xad8e53a42304766a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047663 expref: 19 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.831287:0:86926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9600, rc 0) 00000100:00100000:0.0:1783144273.831336:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501273984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 632us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.831344:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783144273.831454:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501273984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144273.831469:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304766a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.831478:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304766a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.831552:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.831588:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144273.831614:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501274112 00000100:00100000:2.0:1783144273.831619:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4891180 going to sleep for 11 seconds 00000100:00100000:1.0:1783144273.831619:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501274112 00000100:00100000:1.0:1783144273.831649:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783144273.831655:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501274112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144273.831951:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501274112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144273.831956:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783144273.832362:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.832392:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.832433:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.832466:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4891180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.832471:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501274240 00000100:00100000:0.0:1783144273.832477:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501274240 00000100:00100000:0.0:1783144273.832543:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783144273.832553:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501274240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.832644:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501274240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.832652:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783144273.832658:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144273.833555:0:87125:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783144273.833620:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783144273.833695:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783144273.833708:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304766a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.833717:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304766a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144273.833751:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144273.833754:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 52 10000000:01000000:2.0:1783144273.833756:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144273.833777:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.833785:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.833793:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.833807:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.833838:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.833865:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4891180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.833919:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501274368 00000100:00100000:0.0:1783144273.833924:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501274368 00000100:00100000:0.0:1783144273.833967:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783144273.833975:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501274368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.833984:0:86923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.833995:0:86923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8600/0xad8e53a423047678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047671 expref: -99 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.834012:0:86923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8600/0xad8e53a423047678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047671 expref: 20 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.834021:0:86923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8600/0xad8e53a423047678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047671 expref: 20 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.834028:0:86923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8600, rc 0) 00000100:00100000:0.0:1783144273.834058:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501274368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.834065:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783144273.834129:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144273.834142:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047678 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.834160:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047678 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.834216:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.834246:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.834299:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4891180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.834329:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501274496 00000100:00100000:0.0:1783144273.834333:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501274496 00000100:00100000:0.0:1783144273.834358:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783144273.834365:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501274496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.834447:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501274496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.834454:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783144273.836757:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.836808:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.836860:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.836888:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144273.836980:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501274624 00000100:00100000:2.0:1783144273.836985:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501274624 00000100:00100000:2.0:1783144273.837073:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783144273.837082:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501274624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.837176:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501274624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144273.837183:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783144273.837251:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144273.837858:0:87128:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783144273.837906:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783144273.837924:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144273.837934:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047678 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.837944:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047678 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144273.837951:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783144273.837953:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783144273.837956:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783144273.837977:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.837985:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.837994:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144273.838012:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.838042:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.838074:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.838087:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501274752 00000100:00100000:3.0:1783144273.838099:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501274752 00000100:00100000:3.0:1783144273.838166:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783144273.838180:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501274752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.838196:0:86921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144273.838215:0:86921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043f000/0xad8e53a423047686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304767f expref: -99 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.838271:0:86921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043f000/0xad8e53a423047686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304767f expref: 21 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.838284:0:86921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043f000/0xad8e53a423047686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304767f expref: 21 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.838312:0:86921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043f000, rc 0) 00000100:00100000:3.0:1783144273.838377:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501274752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144273.838390:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783144273.838411:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.838431:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.838453:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144273.838509:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.838537:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.838561:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144273.838604:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501274880 00000100:00100000:2.0:1783144273.838608:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501274880 00000100:00100000:2.0:1783144273.838696:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783144273.838705:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c2374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501274880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.838855:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c2374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501274880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144273.838862:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783144273.838991:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501274880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.839019:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.839052:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.839076:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144273.839118:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275008 00000100:00100000:2.0:1783144273.839123:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275008 00000100:00100000:2.0:1783144273.839185:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783144273.839193:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501275008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.840111:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501275008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 918us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144273.840124:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783144273.840177:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144273.841047:0:87129:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783144273.841184:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783144273.841204:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783144273.841213:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.841223:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.841230:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144273.841233:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2afaac8800 from 7 10000000:01000000:3.0:1783144273.841235:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144273.841257:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.841265:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.841285:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.841301:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.841334:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.841389:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144273.841419:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275136 00000100:00100000:2.0:1783144273.841423:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275136 00000100:00100000:2.0:1783144273.841483:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783144273.841501:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501275136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144273.841512:0:86926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144273.841524:0:86926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423047694 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304768d expref: -99 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.841545:0:86926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423047694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304768d expref: 22 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.841555:0:86926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423047694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304768d expref: 22 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.841564:0:86926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516a00, rc 0) 00000100:00100000:2.0:1783144273.841600:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501275136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144273.841606:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783144273.841663:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.841675:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047694 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.841684:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047694 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.841748:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.841772:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.841882:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.841925:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275264 00000100:00100000:0.0:1783144273.841929:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275264 00000100:00100000:0.0:1783144273.841955:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783144273.841961:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af79cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501275264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.842046:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af79cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501275264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.842053:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783144273.842084:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.842109:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.842140:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.842151:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.842161:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275392 00000100:00100000:0.0:1783144273.842164:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275392 00000100:00100000:0.0:1783144273.842181:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783144273.842186:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501275392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.842249:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501275392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.842255:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783144273.842295:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144273.843096:0:87130:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783144273.843232:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783144273.843249:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783144273.843256:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047694 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.843265:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047694 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144273.843282:0:6518:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1783144273.843284:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9c2ac6dd99c0 from 1 10000000:01000000:2.0:1783144273.843286:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783144273.843306:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.843313:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.843320:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144273.843333:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144273.843362:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144273.843416:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4891300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144273.843444:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275520 00000100:00100000:0.0:1783144273.843448:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275520 00000100:00100000:0.0:1783144273.843512:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783144273.843520:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501275520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.843528:0:86922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.843539:0:86922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8e00/0xad8e53a4230476a2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304769b expref: -99 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.843554:0:86922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8e00/0xad8e53a4230476a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304769b expref: 23 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.843563:0:86922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8e00/0xad8e53a4230476a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304769b expref: 23 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.843569:0:86922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8e00, rc 0) 00000100:00100000:0.0:1783144273.843610:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501275520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.843616:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783144273.843679:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144273.843691:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230476a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.843699:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230476a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.843712:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783144273.843716:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230476a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.843747:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230476a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144273.843753:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783144273.843755:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:3.0:1783144273.843757:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783144273.843771:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.843778:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144273.843784:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144273.843794:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.843818:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144273.843953:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144273.843983:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275648 00000100:00100000:2.0:1783144273.843987:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275648 00000100:00100000:0.0:1783144273.844046:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783144273.844054:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501275648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.844061:0:86922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144273.844068:0:86922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8200/0xad8e53a4230476b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230476a9 expref: -99 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.844080:0:86922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8200/0xad8e53a4230476b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230476a9 expref: 24 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.844099:0:86922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8200/0xad8e53a4230476b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230476a9 expref: 24 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.844105:0:86922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8200, rc 0) 00000100:00100000:0.0:1783144273.844133:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501275648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144273.844139:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783144273.844245:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144273.844255:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230476b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.844262:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230476b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144273.844301:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144273.844324:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144273.844346:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144273.844391:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275776 00000100:00100000:3.0:1783144273.844395:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275776 00000100:00100000:3.0:1783144273.844424:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783144273.844432:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501275776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144273.844506:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa1f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501275776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (180us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144273.844514:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783144273.844579:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501275776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783144273.844604:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783144273.844609:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230476b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144273.844616:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230476b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144273.869866:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144274.327383:0:87198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783144274.450603:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501275904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144274.450682:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144274.450803:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501275904 00000100:00100000:2.0:1783144274.450810:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501275904 00000100:00100000:2.0:1783144274.450889:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1783144274.450937:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501275904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144274.450967:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144274.451033:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501275904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144274.451041:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00080000:2.0:1783144274.451072:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144274.451110:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501275904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144274.452496:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501276032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144274.452587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144274.452622:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276032 00000100:00100000:0.0:1783144274.452628:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276032 00000100:00080000:2.0:1783144274.452651:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144274.452665:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1783144274.452673:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501276032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144274.452692:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144274.452772:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501276032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144274.452782:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1783144274.452827:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501276032:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1783144274.791594:0:87250:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783144274.791975:0:87250:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783144274.894864:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783144275.212899:0:87300:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144275.213111:0:87300:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783144275.917900:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144276.942032:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144277.093700:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144277.093756:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481651712 00000100:00100000:3.0:1783144277.093833:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481651712 00000100:00100000:1.0:1783144277.093911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:2.0:1783144277.093954:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144277.094133:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481651584 00000100:00100000:3.0:1783144277.094137:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481651584 00000100:00100000:0.0:1783144277.094145:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 741 00000100:00100000:0.0:1783144277.094160:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481651712:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144277.094174:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1042 00000100:00100000:3.0:1783144277.094182:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481651584:12345-192.168.203.4@tcp:38:kworker.0 00010000:00080000:3.0:1783144277.094204:0:66112:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'cace81e7-a6f2-4d37-b197-caf34583781c' at ffff9c2aefa7b000, cookie 0xad8e53a42304753d 00010000:00080000:3.0:1783144277.094210:0:66112:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp recovering/t98784247813 exp ffff9c2aefa7b000 cur 2811 last 1783144272 00010000:02000400:3.0:1783144277.094224:0:66112:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:0.0:1783144277.094240:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481651712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 83us (547us total) trans 0 rc 0/0 00010000:00080000:3.0:1783144277.094245:0:66112:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00100000:0.0:1783144277.094252:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 741 00000004:00100000:3.0:1783144277.094271:0:66112:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783144277.094397:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c2afab20000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144277.094445:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481651584:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 262us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144277.094451:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1042 00000100:00100000:1.0:1783144277.097841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144277.098239:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481646848 00000100:00100000:0.0:1783144277.098248:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481646848 00000100:00100000:0.0:1783144277.098307:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1043 00000100:00100000:0.0:1783144277.098317:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481646848:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00080000:0.0:1783144277.098335:0:66114:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:0.0:1783144277.099208:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481646848:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 889us (1370us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144277.099217:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1043 00010000:00080000:3.0:1783144277.099255:0:86948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1783144277.517966:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501276160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144277.518045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144277.518107:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276160 00000100:00100000:3.0:1783144277.518114:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276160 00000100:00100000:3.0:1783144277.518169:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:3.0:1783144277.518179:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501276160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783144277.518213:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144277.518281:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501276160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144277.518288:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:0.0:1783144277.518535:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501276160:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783144277.518675:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144277.518680:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144277.518684:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783144277.518691:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501276288:0@lo:400:kworker.0 00000100:00080000:1.0:1783144277.518694:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144277.518757:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144277.518777:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af9ef4e00 x1869759501276416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144277.518804:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276288 00000100:00100000:3.0:1783144277.518810:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276288 00000100:00100000:0.0:1783144277.518821:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501276416:0@lo:38:kworker.0 00000100:00080000:1.0:1783144277.518824:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144277.518829:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144277.518839:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783144277.518844:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1783144277.518848:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144277.518855:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa1f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501276288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144277.518866:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af9ef7b80 x1869759501276672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144277.518871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144277.518894:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144277.518899:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144277.518901:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783144277.518905:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501276672:0@lo:38:kworker.0 00000100:00080000:1.0:1783144277.518909:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144277.518926:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af9ef7480 x1869759501276928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144277.518931:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa1f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501276288:12345-0@lo:400:kworker.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144277.518943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144277.518950:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1783144277.518977:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144277.518982:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144277.518984:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783144277.518988:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501277184:0@lo:400:kworker.0 00000100:00080000:1.0:1783144277.518993:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144277.519009:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af9ef5c00 x1869759501277312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144277.519022:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144277.519038:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783144277.519042:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144277.519044:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7528000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144277.519051:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ac7528000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144277.519052:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501276288:0@lo:400:kworker.0 00000100:00100000:0.0:1783144277.519053:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501276928:0@lo:38:kworker.0 00000100:00100000:1.0:1783144277.519066:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af9ef7800 x1869759501277696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144277.519075:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144277.519085:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501277056:0@lo:400:kworker.0 00000100:00100000:0.0:1783144277.519092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144277.519117:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144277.519117:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501277312:0@lo:38:kworker.0 00000100:00100000:0.0:1783144277.519151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144277.519154:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277184 00000100:00100000:3.0:1783144277.519158:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277184 00000100:00100000:0.0:1783144277.519178:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501277696:0@lo:38:kworker.0 00000100:00100000:3.0:1783144277.519196:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277056 00000100:00100000:3.0:1783144277.519200:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277056 00000100:00100000:1.0:1783144277.519205:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276416 00000100:00100000:0.0:1783144277.519207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144277.519212:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276416 00000100:00100000:3.0:1783144277.519242:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:0.0:1783144277.519246:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276672 00000100:00100000:1.0:1783144277.519248:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277312 00000100:00100000:0.0:1783144277.519252:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276672 00000100:00100000:3.0:1783144277.519253:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501277184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144277.519254:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277312 00000100:00100000:0.0:1783144277.519280:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277696 00000100:00100000:0.0:1783144277.519285:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277696 00000100:00100000:3.0:1783144277.519300:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501277184:12345-0@lo:400:kworker.0 Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144277.519319:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1783144277.519323:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501276544:0@lo:400:kworker.0 00000100:00100000:3.0:1783144277.519337:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1783144277.519364:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144277.519439:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501277440:0@lo:400:kworker.0 00000100:00100000:2.0:1783144277.519483:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144277.519505:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783144277.519511:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501276800:0@lo:400:kworker.0 00000100:00100000:2.0:1783144277.519534:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144277.519830:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276544 00000100:00100000:1.0:1783144277.519835:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276544 00000100:00100000:0.0:1783144277.519842:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1783144277.519849:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501276416:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144277.519866:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00010000:00080000:0.0:1783144277.519875:0:66113:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2811 last 0 00000100:00100000:1.0:1783144277.519877:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501276544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144277.519923:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501276544:12345-0@lo:400:kworker.0 Request processed in 49us (560us total) trans 0 rc 0/0 00000020:00000080:0.0:1783144277.519924:0:66113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad8e53a4230476b7 00000100:00100000:1.0:1783144277.519934:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000004:00100000:0.0:1783144277.519944:0:66113:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783144277.519953:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1783144277.519958:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501276672:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783144277.519974:0:66143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2811 last 0 00000020:00000080:1.0:1783144277.520011:0:66143:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad8e53a4230476be 00000004:00100000:1.0:1783144277.520020:0:66143:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783144277.520050:0:66143:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d52800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144277.520099:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869759501276672:12345-0@lo:38:kworker.0 Request processed in 139us (1159us total) trans 0 rc 0/0 00000100:00080000:0.0:1783144277.520108:0:66113:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3dad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144277.520109:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1783144277.520133:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1783144277.520139:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501277312:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144277.520148:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501276416:12345-0@lo:38:kworker.0 Request processed in 297us (1279us total) trans 0 rc 0/0 00010000:00080000:1.0:1783144277.520155:0:66143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2811 last 0 00000100:00100000:0.0:1783144277.520159:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1783144277.520171:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501277056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144277.520181:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1783144277.520187:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501277696:12345-0@lo:38:kworker.0 00000020:00000080:1.0:1783144277.520189:0:66143:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad8e53a4230476c5 00000004:00100000:1.0:1783144277.520199:0:66143:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1783144277.520205:0:66113:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2811 last 0 00000100:00100000:3.0:1783144277.520215:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501277056:12345-0@lo:400:kworker.0 Request processed in 869us (1097us total) trans 0 rc 0/0 00000100:00080000:1.0:1783144277.520218:0:66143:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d55000 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1783144277.520240:0:66113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad8e53a4230476cc 00000004:00100000:0.0:1783144277.520250:0:66113:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783144277.520258:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869759501277312:12345-0@lo:38:kworker.0 Request processed in 118us (1108us total) trans 0 rc 0/0 00000100:00080000:0.0:1783144277.520269:0:66113:0:(import.c:65:import_set_state_nolock()) ffff9c2af9e45800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144277.520277:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1783144277.520304:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1783144277.520310:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501277696:12345-0@lo:38:kworker.0 Request processed in 120us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144277.520319:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00010000:00080000:1.0:1783144277.520340:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2af9ef7800 x1869759501277696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.520354:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:1.0:1783144277.520363:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783144277.520369:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:3.0:1783144277.520372:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277440 00000100:00080000:1.0:1783144277.520372:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7528000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783144277.520378:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277440 00000100:00100000:1.0:1783144277.520382:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501277696:0@lo:38:kworker.0 00010000:00080000:1.0:1783144277.520401:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2af9ef5c00 x1869759501277312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.520411:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00100000:3.0:1783144277.520412:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1783144277.520421:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501277440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144277.520449:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501277440:12345-0@lo:400:kworker.0 Request processed in 29us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144277.520455:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1783144277.520487:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276928 00000100:00100000:3.0:1783144277.520491:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276928 00000100:00100000:2.0:1783144277.520514:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501277568:0@lo:400:kworker.0 00000100:00100000:2.0:1783144277.520542:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144277.520564:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1783144277.520570:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501276544:0@lo:400:kworker.0 00000100:00100000:3.0:1783144277.520572:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501276928:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144277.520588:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501277440:0@lo:400:kworker.0 00010000:00080000:3.0:1783144277.520592:0:8447:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2aefa7d000, cookie 0xad8e53a423047544 00010000:00080000:3.0:1783144277.520599:0:8447:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c2aefa7d000 cur 2811 last 1783144272 00000004:00100000:3.0:1783144277.520610:0:8447:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783144277.520618:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277568 00000100:00100000:2.0:1783144277.520622:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277568 00000100:00080000:3.0:1783144277.520629:0:8447:0:(import.c:65:import_set_state_nolock()) ffff9c2afab25000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144277.520654:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:2.0:1783144277.520664:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501277568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144277.520673:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501276928:12345-0@lo:38:kworker.0 Request processed in 100us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144277.520682:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1783144277.520709:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501277568:12345-0@lo:400:kworker.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000001:00100000:0.0:1783144277.520715:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1783144277.520740:0:86948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1783144277.520746:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00010000:00080000:3.0:1783144277.520748:0:86948:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 98784247813 00000020:00080000:3.0:1783144277.520754:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.520758:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:3.0:1783144277.520762:0:86948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:3.0:1783144277.520765:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.520774:0:86948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481646848 t98784247813 from 192.168.203.4@tcp req@ffff9c29ceadb800 x1869759481646848/t0(98784247813) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:388/0 lens 528/0 e 0 to 0 dl 1783144288 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144277.520781:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501276800 00000100:00100000:2.0:1783144277.520788:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501276800 00000001:00100000:0.0:1783144277.520796:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:0.0:1783144277.520801:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2af5ddb000/cace81e7-a6f2-4d37-b197-caf34583781c 00000100:00100000:2.0:1783144277.520826:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1783144277.520838:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501276800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144277.520874:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501276800:12345-0@lo:400:kworker.0 Request processed in 40us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144277.520881:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00080000:2.0:1783144277.520899:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144277.520904:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144277.520906:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144277.520945:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501276800:0@lo:400:kworker.0 00000100:00100000:3.0:1783144277.520959:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501277056:0@lo:400:kworker.0 00000100:00100000:2.0:1783144277.520964:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501277568:0@lo:400:kworker.0 00000100:00100000:3.0:1783144277.520979:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501277184:0@lo:400:kworker.0 00000020:00000080:3.0:1783144277.521064:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5ddb000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0001 00000020:00000080:3.0:1783144277.521117:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c6cdb000 for lustre-OST0001 00000001:00100000:0.0:1783144277.521168:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:3.0:1783144277.521666:0:86948:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 835us 00000100:00080000:1.0:1783144277.522212:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2af9ef5c00 x1869759501277312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144302 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.522223:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783144277.522227:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144277.522231:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783144277.522235:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501277312:0@lo:38:kworker.0 00010000:00080000:1.0:1783144277.522267:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2af9ef7b80 x1869759501276672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.522279:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000001:00100000:0.0:1783144277.522552:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783144277.522561:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:0.0:1783144277.522564:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c29c4cb6000/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:3.0:1783144277.522637:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c4cb6000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0000 00000100:00080000:1.0:1783144277.523128:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2af9ef7b80 x1869759501276672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144302 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.523136:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783144277.523146:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144277.523150:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783144277.523154:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501276672:0@lo:38:kworker.0 00010000:00080000:1.0:1783144277.523173:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2af9ef4e00 x1869759501276416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.523184:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00080000:1.0:1783144277.523980:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2af9ef4e00 x1869759501276416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144302 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.523989:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783144277.523992:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144277.523995:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783144277.523999:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501276416:0@lo:38:kworker.0 00000100:00080000:1.0:1783144277.524035:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:1.0:1783144277.524042:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783144277.524047:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1783144277.524049:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00080000:1.0:1783144277.524053:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2af7208000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:1.0:1783144277.524057:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1783144277.524153:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501276928:0@lo:38:kworker.0 00010000:00080000:1.0:1783144277.524175:0:87313:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783144277.524178:0:87313:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783144277.524184:0:87313:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783144277.525664:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c4cb5000 for lustre-OST0000 00000100:00080000:1.0:1783144277.526081:0:87313:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1783144277.526562:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501277824:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783144277.526649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144277.526863:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277824 00000100:00100000:3.0:1783144277.526870:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277824 00000100:00100000:3.0:1783144277.526920:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1783144277.526930:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501277824:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1783144277.526950:0:8446:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2aee572300 x1869759501277824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1783144288 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144277.526963:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501277824:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 35us (314us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144277.526971:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00010000:00010000:0.0:1783144277.532113:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.532136:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.532154:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.532167:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.532175:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.532190:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.532711:0:86948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.532751:0:86948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.533538:0:86948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.533545:0:86948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144277.533549:0:86948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.533558:0:86948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.533575:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e600) 00010000:00010000:0.0:1783144277.533578:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144277.533583:0:86948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.533590:0:86948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a4230476d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144277.533609:0:86948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003352ef67 reply state 00000000af070706 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.533621:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.533640:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58e200) 00010000:00010000:0.0:1783144277.533642:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144277.533645:0:86948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783144277.534454:0:86948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1783144277.534483:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144277.534487:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:0.0:1783144277.534491:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144277.534493:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000001:00080000:1.0:1783144277.536325:0:86916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247813 is committed 00010000:00010000:3.0:1783144277.536562:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.536576:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.536583:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.536598:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144277.536603:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.536611:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.536627:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee58e200) 00010000:00010000:3.0:1783144277.536630:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144277.536634:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.536641:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a4230476da lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144277.537157:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144277.537302:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481647360 00000100:00100000:2.0:1783144277.537313:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481647360 00000100:00100000:2.0:1783144277.537398:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1048 00000100:00100000:2.0:1783144277.537410:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481647360:12345-192.168.203.4@tcp:36:rm.0 00010000:00080000:2.0:1783144277.537429:0:66114:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:2.0:1783144277.537489:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481647360:12345-192.168.203.4@tcp:36:rm.0 Request processed in 81us (335us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144277.537497:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1048 00000020:00080000:3.0:1783144277.537529:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.537533:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:3.0:1783144277.537538:0:86948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:3.0:1783144277.537542:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.537551:0:86948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481647360 t98784247814 from 192.168.203.4@tcp req@ffff9c2aee573800 x1869759481647360/t0(98784247814) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:388/0 lens 512/0 e 0 to 0 dl 1783144288 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783144277.537633:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.537647:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.537657:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.537681:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.537689:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.537696:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.537812:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538075:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538083:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538373:0:86948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538381:0:86948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538388:0:86948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538394:0:86948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ee00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144277.538398:0:86948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538405:0:86948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538422:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2af565c300) 00010000:00010000:3.0:1783144277.538425:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783144277.538430:0:86948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538436:0:86948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ee00/0xad8e53a4230476ef lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538455:0:86948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538472:0:86948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538478:0:86948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538483:0:86948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144277.538486:0:86948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538493:0:86948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538501:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af565c400) 00010000:00010000:3.0:1783144277.538504:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144277.538506:0:86948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538513:0:86948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f400/0xad8e53a4230476e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144277.538535:0:86948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003b2615a reply state 000000007b78126e transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538547:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.538553:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af565ca00) 00010000:00010000:3.0:1783144277.538555:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144277.538558:0:86948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783144277.538671:0:86948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783144277.538688:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.538691:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:3.0:1783144277.538694:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.538696:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:3.0:1783144277.541354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144277.541423:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481647872 00000100:00100000:2.0:1783144277.541432:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481647872 00000100:00100000:2.0:1783144277.541532:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1049 00000100:00100000:2.0:1783144277.541543:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481647872:12345-192.168.203.4@tcp:101:touch.0 00010000:00080000:2.0:1783144277.541576:0:66947:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:2.0:1783144277.541595:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481647872:12345-192.168.203.4@tcp:101:touch.0 Request processed in 53us (249us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144277.541602:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1049 00000020:00080000:3.0:1783144277.541639:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.541643:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:3.0:1783144277.541646:0:86948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:3.0:1783144277.541650:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.541659:0:86948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481647872 t98784247815 from 192.168.203.4@tcp req@ffff9c2ae4ea5c00 x1869759481647872/t0(98784247815) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:388/0 lens 752/0 e 0 to 0 dl 1783144288 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783144277.541679:0:86948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144277.541699:0:86948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230476f6 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419f5 expref: -99 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.541961:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.541998:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.542010:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.542025:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.542032:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.542039:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144277.543496:0:86948:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x5:0x0], cookie = 0xad8e53a4230474aa 00000004:00080000:3.0:1783144277.543503:0:86948:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xad8e53a4230474aa in new mfd 00010000:00010000:3.0:1783144277.543514:0:86948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543523:0:86948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543531:0:86948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543537:0:86948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144277.543542:0:86948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543550:0:86948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543570:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af565cc00) 00010000:00010000:3.0:1783144277.543573:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144277.543578:0:86948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543584:0:86948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a4230476fd lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144277.543598:0:86948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0d8c3f5 reply state 00000000aadb70f6 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543608:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543615:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c2af565cb00) 00010000:00010000:3.0:1783144277.543617:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144277.543619:0:86948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144277.543648:0:86948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230476f6 lrc: 1/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 10 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543659:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2af565cc00) 00010000:00010000:3.0:1783144277.543661:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144277.543665:0:86948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a4230476f6 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419f5 expref: 10 pid: 86948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.543692:0:86948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043ec00, rc 0) 00010000:00080000:3.0:1783144277.543778:0:86948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783144277.543800:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.543803:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:3.0:1783144277.543812:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.543815:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:1.0:1783144277.565451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144277.565615:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481648128 00000100:00100000:2.0:1783144277.565624:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481648128 00000100:00100000:2.0:1783144277.565689:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1050 00000100:00100000:2.0:1783144277.565699:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481648128:12345-192.168.203.4@tcp:36:touch.0 00010000:00080000:2.0:1783144277.565770:0:66113:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247816, current: 98784247816, replaying 00000100:00100000:2.0:1783144277.565791:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481648128:12345-192.168.203.4@tcp:36:touch.0 Request processed in 94us (349us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144277.565798:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1050 00000020:00080000:3.0:1783144277.565833:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.565838:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247816, next_transno: 98784247816 00010000:00080000:3.0:1783144277.565842:0:86948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247816) 00000020:00080000:3.0:1783144277.565845:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.565854:0:86948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481648128 t98784247816 from 192.168.203.4@tcp req@ffff9c2af9ef4e00 x1869759481648128/t0(98784247816) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:388/0 lens 488/0 e 0 to 0 dl 1783144288 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783144277.565972:0:86948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.565995:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.566006:0:86948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144277.566099:0:86948:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000497a1e79 reply state 000000009e947c61 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.566110:0:86948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.566116:0:86948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c2af565cc00) 00010000:00010000:3.0:1783144277.566119:0:86948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144277.566122:0:86948:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783144277.566202:0:86948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783144277.566217:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.566219:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000020:00080000:3.0:1783144277.566222:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.566237:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000100:00100000:0.0:1783144277.567656:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144277.567844:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481648512 00000100:00100000:1.0:1783144277.567850:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481648512 00000100:00100000:1.0:1783144277.567919:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 215 00000100:00100000:1.0:1783144277.567928:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:2402:x1869759481648512:12345-192.168.203.4@tcp:35:touch.0 00010000:00080000:1.0:1783144277.567943:0:66116:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247817, current: 98784247817, replaying 00000100:00100000:1.0:1783144277.567961:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:2402:x1869759481648512:12345-192.168.203.4@tcp:35:touch.0 Request processed in 34us (309us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144277.567968:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 215 00000020:00080000:3.0:1783144277.568013:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.568017:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247817, next_transno: 98784247817 00010000:00080000:3.0:1783144277.568021:0:86948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247817) 00000020:00080000:3.0:1783144277.568023:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.568031:0:86948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481648512 t98784247817 from 192.168.203.4@tcp req@ffff9c2aee571880 x1869759481648512/t0(98784247817) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:388/0 lens 392/0 e 0 to 0 dl 1783144288 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144277.568212:0:86948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783144277.568225:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.568227:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000020:00080000:3.0:1783144277.568230:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.568232:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000100:00100000:0.0:1783144277.571224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144277.571326:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481651840 00000100:00100000:2.0:1783144277.571337:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481651840 00000100:00100000:2.0:1783144277.571442:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 744 00000100:00100000:2.0:1783144277.571453:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+13:2402:x1869759481651840:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783144277.571484:0:81077:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2aefa55180 x1869759481651840/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:388/0 lens 224/0 e 0 to 0 dl 1783144288 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144277.571507:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+13:2402:x1869759481651840:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 Request processed in 57us (292us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144277.571514:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 744 00000020:00080000:3.0:1783144277.571558:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.571562:0:86948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247818 00010000:00080000:3.0:1783144277.571565:0:86948:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1783144277.571568:0:86948:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144277.571575:0:86948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783144277.571577:0:86948:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1783144277.571701:0:86948:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:2.0:1783144277.574004:0:86916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:2.0:1783144277.574013:0:86916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783144277.574076:0:86916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00000001:00080000:3.0:1783144277.574226:0:86948:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783144277.574283:0:86948:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783144277.574297:0:86948:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2aee572300 x1869759501277824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1783144288 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783144277.574407:0:86948:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.203.4@tcp: req@ffff9c2aefa55180 x1869759481651840/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:388/0 lens 224/0 e 0 to 0 dl 1783144288 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144277.574485:0:86948:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1783144277.574552:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783144277.574558:0:3647:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2af9ef7480 x1869759501277824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144293 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.574564:0:3647:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2af9ef7480 x1869759501277824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144293 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144277.574569:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144277.574577:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1783144277.574581:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000068849654): req@ffff9c2ae4ea5f80 x1869759501260928/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144274 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144277.574590:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501277824:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783144277.574794:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144277.574827:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501277952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144277.574854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144277.574943:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501260928 00000100:00100000:2.0:1783144277.574949:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501260928 00000100:00100000:2.0:1783144277.574988:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501277952 00000100:00100000:2.0:1783144277.574991:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501277952 00000100:00100000:1.0:1783144277.575003:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:1.0:1783144277.575014:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501260928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144277.575038:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:1.0:1783144277.575083:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501260928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1783144277.575967:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.575980:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.575988:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.575995:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144277.576000:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576008:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576023:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af565ca00) 00010000:00010000:0.0:1783144277.576027:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144277.576040:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576046:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e600/0xad8e53a4230476e8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576071:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576078:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576085:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576090:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144277.576093:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576099:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576107:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c2af565cb00) 00010000:00010000:0.0:1783144277.576109:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144277.576113:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576119:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423047704 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576134:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576151:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576158:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576163:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144277.576167:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576174:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144277.576179:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00010000:00010000:0.0:1783144277.576188:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c2af565cc00) 00010000:00010000:0.0:1783144277.576193:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144277.576196:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.576202:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423047712 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144277.576363:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1783144277.576375:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501277952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783144277.576402:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:2.0:1783144277.576471:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501277952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144277.576479:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:1.0:1783144277.576505:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501260928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144277.576519:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501277952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144277.578018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144277.578076:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481651456 00000100:00100000:1.0:1783144277.578084:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481651456 00000100:00100000:1.0:1783144277.578133:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1051 00000100:00100000:1.0:1783144277.578141:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481651456:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144277.578159:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:1.0:1783144277.578223:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481651456:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144277.578231:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1051 00000100:00100000:2.0:1783144277.580079:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144277.580177:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481651968 00000100:00100000:0.0:1783144277.580186:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481651968 00000100:00100000:0.0:1783144277.580273:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1052 00000100:00100000:0.0:1783144277.580284:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481651968:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:0.0:1783144277.580313:0:66112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:0.0:1783144277.580375:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481651968:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144277.580383:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1052 00000100:00100000:0.0:1783144277.587127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144277.587243:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652096 00000100:00100000:2.0:1783144277.587253:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652096 00000100:00100000:2.0:1783144277.587321:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4929 00000100:00100000:2.0:1783144277.587329:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2402:x1869759481652096:12345-192.168.203.4@tcp:8:lfs.0 00010000:00080000:2.0:1783144277.587367:0:26150:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t0 exp 0000000000000000 cur 2811 last 0 00000020:00000080:2.0:1783144277.587445:0:26150:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a423047719 00002000:00100000:2.0:1783144277.587468:0:26150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cace81e7-a6f2-4d37-b197-caf34583781c/ffff9c29c340e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783144277.587485:0:26150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783144277.587560:0:26150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783144277.587587:0:26150:0:(import.c:65:import_set_state_nolock()) ffff9c29c340a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144277.587654:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481652096:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 324us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144277.587662:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4929 00000100:00100000:1.0:1783144277.589953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144277.590118:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652224 00000100:00100000:2.0:1783144277.590125:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652224 00000100:00100000:2.0:1783144277.590220:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1560 00000100:00100000:2.0:1783144277.590231:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481652224:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144277.590261:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144277.590318:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481652224:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144277.590326:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1560 00000100:00100000:1.0:1783144277.592080:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:0.0:1783144277.592115:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144277.592216:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652352 00000100:00100000:2.0:1783144277.592223:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652352 00000100:00100000:2.0:1783144277.592259:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4930 00000100:00100000:2.0:1783144277.592267:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2402:x1869759481652352:12345-192.168.203.4@tcp:8:lfs.0 00010000:00080000:2.0:1783144277.592299:0:16470:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t0 exp 0000000000000000 cur 2811 last 0 00000020:00000080:2.0:1783144277.592350:0:16470:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a423047720 00002000:00100000:2.0:1783144277.592362:0:16470:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cace81e7-a6f2-4d37-b197-caf34583781c/ffff9c29c340c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783144277.592379:0:16470:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783144277.592448:0:16470:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783144277.592485:0:16470:0:(import.c:65:import_set_state_nolock()) ffff9c29c340c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144277.592534:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481652352:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 267us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144277.592542:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4930 00000004:00000080:0.0:1783144277.593200:0:86948:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc16287a4be10 00100000:10000000:0.0:1783144277.593209:0:86948:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1783144277.593892:0:86934:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:2.0:1783144277.593929:0:86934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86934:1869759501278080:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783144277.593973:0:86934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144277.593996:0:86934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad48e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144277.594022:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278080 00000100:00100000:2.0:1783144277.594027:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278080 00000100:00100000:2.0:1783144277.594061:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931 00000100:00100000:2.0:1783144277.594068:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:86934:x1869759501278080:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783144277.594092:0:26141:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -645 00002000:02000040:2.0:1783144277.594097:0:26141:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1761) 00000004:00080000:1.0:1783144277.594440:0:86936:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:1.0:1783144277.594470:0:86936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86936:1869759501278208:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783144277.594497:0:86936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144277.594552:0:86936:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144277.594592:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278208 00000100:00100000:3.0:1783144277.594597:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278208 00000100:00100000:3.0:1783144277.594652:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932 00000100:00100000:3.0:1783144277.594660:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:86936:x1869759501278208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783144277.594674:0:26144:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -95 00002000:02000040:3.0:1783144277.594677:0:26144:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1761) 00002000:00010000:2.0:1783144277.598532:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.598548:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.598565:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.598569:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.598576:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.598593:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.598602:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.598609:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.598686:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144277.599051:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.599057:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599078:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.599082:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.599086:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599096:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599104:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599112:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599257:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144277.599264:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599273:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.599277:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599287:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599304:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599312:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a423047727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599331:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144277.599335:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599341:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.599344:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599364:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599375:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599383:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.599385:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.599387:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.599476:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144277.599481:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292fb10a/0xad8e53a42304772e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.599534:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.599540:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599548:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.599551:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.599556:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599571:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599580:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599588:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599611:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144277.599617:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599624:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.599627:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599635:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599646:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599654:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.599656:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.599663:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.599719:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144277.599739:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a423047735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.599843:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.599849:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599857:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.599860:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.599864:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599873:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599892:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.599899:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599942:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144277.599948:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599956:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.599959:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599967:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599988:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.599997:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.599998:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.600000:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.600097:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144277.600102:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a42304773c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.600153:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.600158:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600165:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.600168:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.600171:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600178:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144277.600180:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1783144277.600186:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600203:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144277.600213:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652480 00000100:00100000:1.0:1783144277.600221:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652480 00010000:00010000:0.0:1783144277.600231:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144277.600236:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600244:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.600247:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600255:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600277:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600285:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.600286:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.600288:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783144277.600306:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144277.600323:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1561 00000100:00100000:1.0:1783144277.600333:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481652480:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144277.600357:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00010000:00010000:2.0:1783144277.600381:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144277.600385:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423047743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144277.600415:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:66589:x1869759481652480:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144277.600431:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1561 00002000:00010000:2.0:1783144277.600432:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.600437:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600444:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.600447:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.600451:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600470:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600477:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600484:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600525:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144277.600529:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600536:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.600539:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600547:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600558:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.600566:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.600568:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.600570:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.600631:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144277.600635:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304774a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.600686:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.600691:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600699:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.600702:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.600706:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600715:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600739:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.600747:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.602844:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144277.602854:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.602875:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.602879:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.602889:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.602904:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.602964:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.602967:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.602969:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.603659:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144277.603683:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423047751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.603832:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.603840:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.603864:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.603869:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.603874:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.603884:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.603905:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.603914:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.603963:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.603977:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.603984:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.603992:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.603996:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604005:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.604018:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.604019:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604030:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604032:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a423047758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604052:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.604057:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144277.604061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.604063:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.604066:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.604070:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604082:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604091:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604097:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604117:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144277.604211:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.604217:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604225:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.604227:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144277.604303:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.604309:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604329:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.604332:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604339:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604350:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604357:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a42304775f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604369:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.604370:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.604372:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.604519:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604541:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604550:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604581:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604612:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.604614:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.604619:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604627:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.604630:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.604636:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.604639:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.604655:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.604657:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604665:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604669:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a423047766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604683:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.604688:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.604692:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.604693:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.604697:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.604699:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.604707:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604716:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604739:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604751:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144277.604805:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.604810:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604824:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.604827:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.604831:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604840:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604849:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604856:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604882:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783144277.604948:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.604975:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.604982:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.604985:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.605000:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605011:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605052:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605058:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605081:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783144277.605091:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783144277.605103:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144277.605108:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605110:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605132:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.605136:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605144:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605155:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605156:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144277.605176:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605179:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a423047774 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605198:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144277.605199:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605203:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605216:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.605219:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605227:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605228:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605247:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605255:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a42304777b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.605266:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.605268:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.605270:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.605302:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783144277.605710:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.605717:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.605829:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.605833:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.605837:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605853:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a42304776d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.605859:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.605870:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605872:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.605878:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605884:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.605888:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.605932:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144277.605935:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.605941:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605950:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.605953:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.605957:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605967:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605976:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.605983:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144277.605996:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.606003:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606017:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.606020:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.606024:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606039:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606047:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606055:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606142:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144277.606146:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606153:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.606156:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606164:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606175:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606182:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cce5051c/0xad8e53a423047782 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606207:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144277.606211:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606217:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.606221:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.606225:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.606230:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.606324:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.606328:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606336:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ebf124c/0xad8e53a423047789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606348:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.606351:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606358:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.606361:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606378:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606393:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.606394:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.606413:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.606415:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:1.0:1783144277.606416:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.606420:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.606421:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.606427:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.606444:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.606452:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.606468:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606481:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144277.606487:0:26144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000028d8ad0/0xad8e53a423047790 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144277.606536:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.606541:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606547:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.606550:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.606553:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606565:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606572:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.606577:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607203:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144277.607208:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607216:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.607219:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607225:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607290:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607300:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.607303:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607316:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.607319:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607327:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607336:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607344:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.607345:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.607347:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.607518:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144277.607524:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f02dad2/0xad8e53a423047797 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.607579:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.607584:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607593:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.607596:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.607600:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607609:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607628:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607635:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607651:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.607663:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.607669:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607677:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.607681:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607689:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.607693:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.607701:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607702:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607710:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.607718:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.607739:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607748:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607755:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607763:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607788:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.607795:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230477a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607814:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.607817:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607824:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.607827:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.607831:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.607835:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607838:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607852:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607853:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.607861:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.607870:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607871:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230477ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607893:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607895:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.607899:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.607902:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.607905:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607908:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.607912:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.607916:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607934:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.607940:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.607945:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607952:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.607956:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607963:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.607973:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.607974:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607984:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.607988:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230477b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.607997:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.608007:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144277.608007:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.608010:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.608013:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608013:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.608026:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608034:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608041:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608057:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.608073:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.608078:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608085:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.608088:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.608095:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.608102:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608116:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608118:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.608125:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144277.608134:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608141:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071d58b1a/0xad8e53a4230477ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608153:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.608154:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.608156:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.608228:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608238:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608301:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608315:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608386:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.608388:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.608394:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608402:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.608406:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608415:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608427:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.608430:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.608439:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608471:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92498fb/0xad8e53a4230477c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608474:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.608483:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.608488:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608492:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.608496:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.608500:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.608501:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608511:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608518:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608534:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.608542:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.608548:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608556:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.608560:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608568:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.608572:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.608579:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608580:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608589:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070ce28cd/0xad8e53a4230477c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608604:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.608609:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144277.608611:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.608614:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.608623:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.608628:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608638:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608646:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608660:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.608669:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.608675:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608683:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.608687:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608695:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.608699:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.608708:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608711:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608738:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.608741:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.608745:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608754:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608772:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608779:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608793:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.608802:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd70636/0xad8e53a4230477cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608818:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.608822:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608829:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.608833:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.608836:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.608849:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608850:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608862:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.608869:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.608874:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608876:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608892:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608902:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608908:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608921:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da2a500a/0xad8e53a4230477d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608944:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144277.608947:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783144277.608949:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608958:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.608961:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608970:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.608982:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.608987:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.608990:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d53103b/0xad8e53a4230477dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.608994:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609010:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.609012:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144277.609014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.609017:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609017:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.609026:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.609027:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609032:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.609037:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.609039:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609048:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609062:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.609070:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.609075:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609083:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.609087:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609095:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.609099:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.609108:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609110:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609127:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:1.0:1783144277.609128:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf57889/0xad8e53a4230477e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.609143:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.609145:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.609378:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.609384:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609394:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609403:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609410:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609425:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.609448:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.609455:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609477:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:2.0:1783144277.609481:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.609488:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609489:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609511:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:1.0:1783144277.609513:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609514:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.609524:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609531:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609536:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609544:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230477eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609550:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609562:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.609565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.609567:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609568:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.609585:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.609594:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.609600:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609607:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.609611:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609618:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.609626:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.609630:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609633:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609654:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:1.0:1783144277.609657:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a4230477f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609658:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.609668:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609680:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609680:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.609683:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.609687:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.609695:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609702:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609715:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144277.609766:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.609771:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609785:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.609788:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.609792:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609802:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609802:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.609809:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609816:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609820:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.609826:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609829:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609842:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609850:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.609856:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609864:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230477f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609881:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.609885:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.609894:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144277.609905:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609907:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.609914:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609918:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.609927:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144277.609930:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609933:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609948:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609950:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.609980:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a423047800 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609983:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.609997:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610002:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610006:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.610010:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610011:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783144277.610021:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.610025:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610034:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.610050:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.610058:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610059:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610079:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423047807 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610081:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.610090:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.610097:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610107:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610115:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610124:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610124:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610127:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610130:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610136:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610139:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.610297:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.610359:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.610365:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610372:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.610375:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144277.610383:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144277.610385:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610392:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610401:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610402:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:2.0:1783144277.610408:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144277.610417:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610418:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a42304780e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610428:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144277.610443:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610447:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610450:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.610453:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610453:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144277.610477:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144277.610486:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.610492:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610499:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.610503:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610512:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610525:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610533:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423047815 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.610550:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610552:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.610554:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.610651:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144277.610658:0:26144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6a52fc5/0xad8e53a42304779e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144277.610773:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.610780:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610790:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.610794:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.610799:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610811:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610834:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610844:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610859:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144277.610911:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.610917:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610927:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.610931:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.610935:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610947:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610957:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610966:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.610995:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783144277.611064:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611071:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611081:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611084:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611089:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611100:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611109:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611118:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611130:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783144277.611171:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611176:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611184:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611193:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611197:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611206:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611215:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611222:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611251:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783144277.611286:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611291:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611298:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611301:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611306:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611314:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611324:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611337:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611347:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783144277.611382:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611388:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611396:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611400:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611404:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611415:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611425:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611432:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611442:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1783144277.611497:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611503:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611518:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611521:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611526:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611537:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611545:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611554:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611565:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1783144277.611614:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611620:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611630:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611633:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611638:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611649:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611670:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611679:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611690:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1783144277.611763:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611769:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611779:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611782:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611788:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611799:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611807:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611816:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611839:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1783144277.611887:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.611893:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611903:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.611906:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.611911:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611922:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611932:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611941:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.611951:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1783144277.611997:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612004:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612012:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612021:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612026:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612037:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612047:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612056:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612066:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1783144277.612116:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612122:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612131:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612134:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612138:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612147:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612154:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612168:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612176:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1783144277.612214:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612219:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612227:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612229:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612234:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612244:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612253:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612261:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612269:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1783144277.612305:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612311:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612326:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612329:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612333:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612342:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612351:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612358:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612367:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1783144277.612411:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612417:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612426:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612429:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612434:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612445:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612477:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612487:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612499:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1783144277.612553:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612560:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612569:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612574:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612578:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612589:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612598:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612608:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612629:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1783144277.612671:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612676:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612685:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612689:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612694:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612704:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612714:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612744:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612755:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1783144277.612789:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612794:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612802:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612809:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612814:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612823:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612831:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612838:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612847:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1783144277.612895:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.612901:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612909:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.612913:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.612918:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612929:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612938:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612952:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.612963:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1783144277.613006:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.613013:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613022:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.613025:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.613031:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613041:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613049:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613057:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613067:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1783144277.613113:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.613118:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613132:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.613134:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.613138:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613146:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613153:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613160:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613167:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:3.0:1783144277.613199:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.613204:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613210:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.613213:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.613216:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613224:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613241:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613248:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613257:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:3.0:1783144277.613290:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.613295:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613303:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.613305:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.613309:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613318:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613326:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613334:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613353:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:3.0:1783144277.613391:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.613397:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613405:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.613408:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.613413:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613423:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613431:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613440:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.613450:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00010000:00010000:1.0:1783144277.613682:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:1.0:1783144277.613689:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613709:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.613715:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613753:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613768:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613775:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e20d2f/0xad8e53a42304781c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613794:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:1.0:1783144277.613798:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613805:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.613810:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613819:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613831:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613846:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a49cfcc8/0xad8e53a423047823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613863:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:1.0:1783144277.613868:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613876:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.613881:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613890:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613902:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613912:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc3dad64/0xad8e53a42304782a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613929:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:1.0:1783144277.613933:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613941:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.613951:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613960:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613973:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.613982:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abd64708/0xad8e53a423047831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614000:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:1.0:1783144277.614005:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614012:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614016:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614026:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614038:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614047:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d6925d2/0xad8e53a423047838 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614070:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:1.0:1783144277.614074:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614083:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614087:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614097:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614107:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614115:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ebfff44/0xad8e53a42304783f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614128:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1783144277.614133:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614139:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614142:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614163:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614174:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614182:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005518a12/0xad8e53a423047846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614195:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1783144277.614199:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614205:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614208:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614215:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614243:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614251:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a42304784d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614276:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1783144277.614280:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614286:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614290:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614298:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614309:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614316:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a423047854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614328:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1783144277.614332:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614338:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614342:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614363:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614374:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614383:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a42304785b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614398:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1783144277.614402:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614410:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614414:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614423:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614435:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614444:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a423047862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614482:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1783144277.614486:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614493:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614496:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614506:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614518:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614525:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a423047869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614540:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1783144277.614544:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614551:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614554:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614574:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614587:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614594:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423047870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614610:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1783144277.614614:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614621:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614625:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614634:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614645:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614654:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423047877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614678:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1783144277.614683:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614691:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614695:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614704:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614715:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614745:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a42304787e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614764:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1783144277.614768:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614774:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614777:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614795:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614808:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614816:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423047885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614835:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1783144277.614839:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614847:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614851:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614861:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614873:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614881:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a42304788c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614910:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783144277.614914:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614922:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614926:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614935:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614949:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614958:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423047893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614973:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783144277.614977:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.614985:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.614988:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615009:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615024:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615033:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a42304789a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615053:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783144277.615058:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615067:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.615070:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615078:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615087:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615094:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a4230478a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615114:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783144277.615117:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615124:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.615126:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615133:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615141:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615148:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230478a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615157:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144277.615160:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615166:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.615170:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615185:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615194:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615202:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a4230478af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615215:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144277.615219:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615225:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.615228:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615236:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615245:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615253:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230478b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615275:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144277.615278:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615285:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144277.615288:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615295:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615306:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615314:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a4230478bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144277.615326:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.615329:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.615331:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.615341:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144277.615348:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.615587:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783144277.615700:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.615707:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.615716:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.615853:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.615859:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.615870:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.615879:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.615887:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.615938:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144277.615978:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.615984:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.615992:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.615995:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.615999:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616007:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616015:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616028:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616097:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144277.616107:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616114:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.616117:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616125:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616135:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616142:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a4230478c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616155:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144277.616158:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616164:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144277.616166:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616173:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616195:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144277.616202:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.616203:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.616205:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.616348:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144277.616353:0:26144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230478cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144277.616401:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.616406:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616414:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.616417:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.616421:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616430:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616438:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616444:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616478:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144277.616511:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.616515:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616522:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.616524:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.616527:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616535:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616541:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616547:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616560:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783144277.616567:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144277.616571:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616577:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144277.616584:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616591:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616601:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616607:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a4230478d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616619:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144277.616622:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616627:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144277.616631:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616638:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616647:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616654:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a4230478d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616673:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.616675:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.616677:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783144277.616717:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144277.616814:0:26144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616822:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=2811s v=(0 0) 00010000:00010000:3.0:1783144277.616825:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144277.616829:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616839:0:26144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616847:0:26144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616854:0:26144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616880:0:26144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144277.616887:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144277.616891:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616908:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144277.616911:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616918:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616929:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616936:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bed82f4e/0xad8e53a4230478e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144277.616950:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.616951:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144277.616953:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.617360:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144277.617374:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783144277.617603:0:26144:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:3.0:1783144277.617761:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:86936:x1869759501278208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23060us (23220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144277.617773:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932 00010000:00010000:1.0:1783144277.617892:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144277.617951:0:86936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86936:1869759501278208:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783144277.617964:0:86936:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:3.0:1783144277.618034:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501278336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144277.618073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144277.618157:0:86936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea42d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86936:1869759501278464:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783144277.618182:0:86936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144277.618204:0:86936:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af71ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144277.618344:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278464 00000100:00100000:3.0:1783144277.618350:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278464 00000100:00100000:3.0:1783144277.618389:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4933 00000100:00100000:3.0:1783144277.618397:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:86936:x1869759501278464:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783144277.618434:0:26140:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00002000:00080000:2.0:1783144277.618851:0:26141:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:2.0:1783144277.618901:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:86934:x1869759501278080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24832us (24925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144277.618908:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931 00000100:00100000:2.0:1783144277.618941:0:86934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86934:1869759501278080:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783144277.618959:0:86934:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:2.0:1783144277.619007:0:86934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86934:1869759501278720:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783144277.619037:0:86934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144277.619057:0:86934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad48e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144277.619076:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501278592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144277.619105:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144277.619154:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278720 00000100:00100000:0.0:1783144277.619158:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278720 00000100:00100000:0.0:1783144277.619184:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:0.0:1783144277.619190:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:86934:x1869759501278720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783144277.619209:0:26143:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00000100:00100000:0.0:1783144277.622384:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:86934:x1869759501278720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3188us (3342us total) trans 4294968824 rc 0/0 00000100:00100000:0.0:1783144277.622437:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00100000:3.0:1783144277.622445:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:86936:x1869759501278464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4046us (4259us total) trans 4294968824 rc 0/0 00000100:00100000:3.0:1783144277.622465:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4933 00000100:00100000:0.0:1783144277.622508:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278336 00000100:00100000:0.0:1783144277.622515:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278336 00000100:00100000:3.0:1783144277.622533:0:86936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea42d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86936:1869759501278464:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783144277.622544:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278592 00000004:00080000:3.0:1783144277.622548:0:86936:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00000100:00100000:0.0:1783144277.622549:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278592 00000100:00100000:2.0:1783144277.622648:0:86934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86934:1869759501278720:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783144277.622653:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000004:00080000:2.0:1783144277.622661:0:86934:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00000100:00100000:0.0:1783144277.622666:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501278336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783144277.622686:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144277.622750:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501278336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144277.622756:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:0.0:1783144277.622769:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1783144277.622775:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501278592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783144277.622784:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144277.622821:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501278592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (3716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144277.622826:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:2.0:1783144277.622840:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aefa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501278336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144277.622877:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501278592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783144277.966040:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144278.990842:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144279.565990:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501278976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144279.566019:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501278848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144279.566079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144279.566130:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278976 00000100:00100000:1.0:1783144279.566161:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278976 00000100:00100000:3.0:1783144279.566170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144279.566287:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501278848 00000100:00100000:1.0:1783144279.566292:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501278848 00000100:00100000:1.0:1783144279.566320:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:1.0:1783144279.566330:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501278976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144279.566363:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144279.566413:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501278976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144279.566418:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:1.0:1783144279.566433:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1783144279.566437:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501278848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783144279.566460:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144279.566482:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501278848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144279.566486:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00080000:0.0:1783144279.566638:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144279.566644:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144279.567594:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501278848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144279.567644:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501278976:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783144280.014057:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144280.212141:0:87496:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000001:02000400:2.0:1783144280.954474:0:87544:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1783144281.037955:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144282.062487:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144282.216335:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144282.216380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.216433:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652608 00000100:00100000:2.0:1783144282.216442:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.216443:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652608 00000100:00100000:2.0:1783144282.216491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.216506:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652736 00000100:00100000:0.0:1783144282.216510:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652736 00000100:00080000:2.0:1783144282.216537:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144282.216542:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 745 00000100:00080000:2.0:1783144282.216544:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144282.216555:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144282.216563:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 746 00000100:00100000:2.0:1783144282.216575:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144282.216634:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.216642:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 745 00000100:00100000:3.0:1783144282.216651:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652864 00000100:00100000:3.0:1783144282.216657:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652864 00000100:00100000:0.0:1783144282.216687:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481652992 00000100:00100000:0.0:1783144282.216692:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481652992 00000100:00100000:3.0:1783144282.216699:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1975 00000100:00100000:3.0:1783144282.216712:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144282.216761:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1976 00000100:00100000:0.0:1783144282.216771:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144282.217371:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 798us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144282.217378:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 746 00000100:00080000:2.0:1783144282.217397:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144282.217406:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144282.220778:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 4057us (4384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144282.220898:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1975 00000100:00100000:0.0:1783144282.224062:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481652992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 7282us (7560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.224077:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1976 00000100:00100000:2.0:1783144282.377813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.378294:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481653120 00000100:00100000:0.0:1783144282.378304:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481653120 00000100:00100000:0.0:1783144282.378369:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1053 00000100:00100000:0.0:1783144282.378381:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:67057:x1869759481653120:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144282.378476:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144282.378499:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a4230478e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c419fc expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.378559:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a4230478ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.378574:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a4230478ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.378599:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a4230478ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144282.378650:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783144282.378654:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144282.378677:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a4230478ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.378701:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a4230478e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419fc expref: 8 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.378769:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a4230478ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419fc expref: 7 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.378778:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e400) 00010000:00010000:0.0:1783144282.378782:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783144282.378785:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6600, rc 0) 00000100:00100000:0.0:1783144282.378847:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+7:67057:x1869759481653120:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 468us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.378855:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1053 00000100:00100000:1.0:1783144282.383081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144282.383177:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481653248 00000100:00100000:2.0:1783144282.383185:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481653248 00000100:00100000:2.0:1783144282.383336:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1054 00000100:00100000:2.0:1783144282.383347:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:67057:x1869759481653248:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144282.383381:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:2.0:1783144282.383464:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:67057:x1869759481653248:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 119us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144282.383472:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1054 00000100:00100000:1.0:1783144282.384799:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144282.384919:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481653376 00000100:00100000:2.0:1783144282.384925:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481653376 00000100:00100000:2.0:1783144282.384965:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1055 00000100:00100000:2.0:1783144282.384973:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:67057:x1869759481653376:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144282.384999:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144282.385083:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:67057:x1869759481653376:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144282.385090:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1055 00000100:00100000:1.0:1783144282.387568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144282.390764:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481653504 00000100:00100000:2.0:1783144282.390828:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481653504 00000100:00100000:2.0:1783144282.390969:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1566 00000100:00100000:2.0:1783144282.390980:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:67057:x1869759481653504:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144282.391012:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144282.391086:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:67057:x1869759481653504:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 107us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144282.391093:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1566 00000100:00100000:1.0:1783144282.396086:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.396179:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481653632 00000100:00100000:0.0:1783144282.396188:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481653632 00000100:00100000:0.0:1783144282.396242:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1567 00000100:00100000:0.0:1783144282.396251:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:67057:x1869759481653632:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:0.0:1783144282.396282:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144282.396363:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:67057:x1869759481653632:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 112us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.396370:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1567 00000100:00100000:1.0:1783144282.424147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.424332:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481653760 00000100:00100000:0.0:1783144282.424342:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481653760 00000100:00100000:0.0:1783144282.424500:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1056 00000100:00100000:0.0:1783144282.424512:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+7:67074:x1869759481653760:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144282.424531:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144282.424549:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a4230478f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a03 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424610:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424620:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424628:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424636:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424640:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424644:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424866:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a42304790a lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424874:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a42304790a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424881:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a42304790a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144282.424919:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783144282.424922:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144282.424939:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a42304790a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424957:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424961:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424965:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424970:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424975:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144282.424979:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.424986:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425005:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e400) 00010000:00010000:0.0:1783144282.425018:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144282.425022:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425029:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a4230478fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425039:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425043:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425052:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425055:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144282.425057:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425060:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425065:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2aee58e800) 00010000:00010000:0.0:1783144282.425067:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144282.425069:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425072:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047903 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425093:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7400/0xad8e53a4230478f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a03 expref: 9 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425100:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a42304790a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a03 expref: 8 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.425105:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2aee58e000) 00010000:00010000:0.0:1783144282.425106:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783144282.425108:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7c00, rc 0) 00000100:00100000:0.0:1783144282.425164:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+8:67074:x1869759481653760:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 655us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.425180:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1056 00000100:00100000:1.0:1783144282.430129:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.430224:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481654016 00000100:00100000:0.0:1783144282.430233:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481654016 00000100:00100000:0.0:1783144282.430292:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1057 00000100:00100000:0.0:1783144282.430301:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:67074:x1869759481654016:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144282.430322:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144282.430341:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047911 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a0a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430543:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430557:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430569:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430584:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430590:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430596:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430664:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430686:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 2/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430777:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430785:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144282.430789:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430797:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430809:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2aee58e000) 00010000:00010000:0.0:1783144282.430812:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144282.430817:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430824:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7000/0xad8e53a423047918 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430836:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430842:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430848:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430852:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144282.430862:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430868:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430875:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c2aee58ec00) 00010000:00010000:0.0:1783144282.430877:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144282.430880:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430885:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7a00/0xad8e53a42304791f lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430913:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047911 lrc: 1/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a0a expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430922:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2aee58e000) 00010000:00010000:0.0:1783144282.430924:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144282.430928:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6a00/0xad8e53a423047911 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a0a expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144282.430935:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6a00, rc 0) 00000100:00100000:0.0:1783144282.430992:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:67074:x1869759481654016:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 688us (868us total) trans 0 rc 301/301 00000100:00100000:0.0:1783144282.430998:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1057 00000100:00100000:1.0:1783144282.434124:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144282.434315:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481654272 00000100:00100000:2.0:1783144282.434322:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481654272 00000100:00100000:2.0:1783144282.434373:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1058 00000100:00100000:2.0:1783144282.434382:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+8:67074:x1869759481654272:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144282.434399:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144282.434434:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a11 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144282.434521:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783144282.434626:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047926 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a11 expref: 10 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144282.434638:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e400) 00010000:00010000:2.0:1783144282.434640:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783144282.434644:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a11 expref: 10 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144282.434656:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00a00, rc 0) 00000100:00100000:2.0:1783144282.434715:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+9:67074:x1869759481654272:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 334us (599us total) trans 103079215105 rc 301/301 00000100:00100000:2.0:1783144282.434752:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1058 00000100:00100000:1.0:1783144282.436697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144282.436858:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481654400 00000100:00100000:3.0:1783144282.436865:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481654400 00000100:00100000:3.0:1783144282.436913:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1059 00000100:00100000:3.0:1783144282.436924:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:67074:x1869759481654400:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1783144282.436990:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437019:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437031:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437045:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437052:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437058:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437122:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437129:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437136:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144282.437167:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144282.437180:0:66112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437192:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437198:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437209:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437215:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437220:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144282.437224:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437231:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437241:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2aee58e000) 00010000:00010000:3.0:1783144282.437244:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144282.437248:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437254:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047934 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437265:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437270:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437276:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437281:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144282.437288:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437294:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437301:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c2ad059eb00) 00010000:00010000:3.0:1783144282.437304:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144282.437307:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437312:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a42304793b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437324:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437329:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437335:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437340:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144282.437343:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437348:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437355:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c2ad059ed00) 00010000:00010000:3.0:1783144282.437358:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144282.437365:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144282.437371:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423047942 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144282.437440:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:67074:x1869759481654400:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 518us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144282.437448:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1059 00000100:00100000:1.0:1783144282.441950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144282.442032:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481654656 00000100:00100000:0.0:1783144282.442042:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481654656 00000100:00100000:0.0:1783144282.442097:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:0.0:1783144282.442107:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:67074:x1869759481654656:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1783144282.442320:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:67074:x1869759481654656:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 214us (385us total) trans 103079215106 rc 0/0 00000100:00100000:0.0:1783144282.442328:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:1.0:1783144282.637915:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144282.637951:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501279104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144282.638039:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783144282.638051:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501279232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144282.638080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.638093:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144282.638129:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501279104 00000100:00100000:1.0:1783144282.638136:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501279104 00000100:00100000:1.0:1783144282.638187:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:1.0:1783144282.638197:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afcbb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501279104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144282.638222:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:1.0:1783144282.638267:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afcbb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501279104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144282.638275:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:0.0:1783144282.638318:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144282.638331:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501279360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144282.638415:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144282.638464:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501279232 00000100:00100000:0.0:1783144282.638468:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501279232 00000100:00100000:0.0:1783144282.638512:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:0.0:1783144282.638521:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501279232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783144282.638536:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144282.638572:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501279360 00000100:00100000:1.0:1783144282.638577:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501279360 00000100:00100000:0.0:1783144282.638578:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501279232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.638589:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1783144282.638609:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1783144282.638617:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501279616:0@lo:400:kworker.0 00000100:00100000:1.0:1783144282.638621:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501279360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783144282.638636:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:0.0:1783144282.638657:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144282.638693:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501280128:0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.638743:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144282.638761:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501280640:0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.638790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.638807:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aca302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501279872:0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.638815:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783144282.638824:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501279488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144282.638845:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144282.638858:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.638873:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501280384:0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.638883:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aca302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501280000:0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.638920:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.638930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144282.638957:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501280512:0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.638982:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.638989:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501279232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144282.639011:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783144282.639018:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501279744:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.639046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.639069:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501280256:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.639094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.639110:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501280768:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.639138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144282.639177:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501279616 00000100:00100000:2.0:1783144282.639181:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501279616 00000100:00100000:0.0:1783144282.639202:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280128 00000100:00100000:0.0:1783144282.639207:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280128 00000100:00100000:2.0:1783144282.639216:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783144282.639225:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa1f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501279616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.639234:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501279872 00000100:00100000:0.0:1783144282.639238:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501279872 00000100:00100000:0.0:1783144282.639256:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280000 00000100:00100000:0.0:1783144282.639259:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280000 00000100:00100000:2.0:1783144282.639269:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa1f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501279616:12345-0@lo:400:kworker.0 Request processed in 45us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.639276:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1783144282.639280:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783144282.639286:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501280128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.639310:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280640 00000100:00100000:2.0:1783144282.639314:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280640 00000100:00100000:0.0:1783144282.639325:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501280128:12345-0@lo:400:kworker.0 Request processed in 40us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.639333:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1783144282.639342:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280384 00000100:00100000:2.0:1783144282.639346:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280384 00000100:00100000:0.0:1783144282.639348:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280512 00000100:00100000:0.0:1783144282.639352:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280512 00000100:00100000:2.0:1783144282.639369:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280256 00000100:00100000:0.0:1783144282.639372:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501279744 00000100:00100000:2.0:1783144282.639374:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280256 00000100:00100000:0.0:1783144282.639377:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501279744 00000100:00100000:0.0:1783144282.639403:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280768 00000100:00100000:2.0:1783144282.639405:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1783144282.639407:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280768 00000100:00100000:0.0:1783144282.639419:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1783144282.639439:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501280640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.639443:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501279872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.639535:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501279872:12345-0@lo:400:kworker.0 Request processed in 96us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.639541:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1783144282.639553:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1783144282.639559:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501280000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.639582:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501280000:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.639597:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1783144282.639613:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1783144282.639620:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501280512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.639653:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501280512:12345-0@lo:400:kworker.0 Request processed in 35us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.639661:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1783144282.639674:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1783144282.639681:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501279744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.639704:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501279744:12345-0@lo:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.639710:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1783144282.639738:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1783144282.639745:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501280768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144282.639783:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501280768:12345-0@lo:400:kworker.0 Request processed in 38us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.639789:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1783144282.639810:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:0.0:1783144282.639817:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501280384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.639850:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501280640:12345-0@lo:400:kworker.0 Request processed in 414us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144282.639866:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:2.0:1783144282.639881:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1783144282.639888:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501280256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.639919:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501280256:12345-0@lo:400:kworker.0 Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144282.639924:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00080000:2.0:1783144282.639953:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144282.639957:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783144282.639958:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144282.639960:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144282.640028:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501279488 00000100:00100000:2.0:1783144282.640032:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501279488 00000100:00100000:2.0:1783144282.640058:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1783144282.640065:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501279488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783144282.640075:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144282.640103:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501279488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144282.640110:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1783144282.640136:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501279744:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.640150:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501280256:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.640163:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501280768:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.640174:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aca302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501279872:0@lo:400:kworker.0 00000100:00100000:3.0:1783144282.640216:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501279360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144282.640264:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501279488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144282.640275:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501279104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144282.640284:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aca302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501280000:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.640307:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501280512:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.640318:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ac7da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501279616:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.640328:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501280128:0@lo:400:kworker.0 00000100:00100000:2.0:1783144282.640337:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501280640:0@lo:400:kworker.0 00000100:00100000:1.0:1783144282.640662:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501279360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2044us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144282.640679:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1783144282.641758:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501280384:12345-0@lo:400:kworker.0 Request processed in 1938us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144282.641769:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:2.0:1783144282.641855:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501280384:0@lo:400:kworker.0 00000100:00100000:1.0:1783144282.724179:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144282.724334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144282.724363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144282.724394:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144282.724490:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144282.724524:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655168 00000100:00100000:1.0:1783144282.724533:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655168 00000100:00100000:1.0:1783144282.724571:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655296 00000100:00100000:1.0:1783144282.724575:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655296 00000100:00100000:1.0:1783144282.724598:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1980 00000100:00100000:1.0:1783144282.724620:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481655168:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144282.724695:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481655168:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144282.724702:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1980 00000100:00100000:1.0:1783144282.724718:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1981 00000100:00100000:1.0:1783144282.724750:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481655296:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144282.724774:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481655296:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144282.724780:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1981 00000100:00100000:1.0:1783144282.724798:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481654912 00000100:00100000:1.0:1783144282.724801:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481654912 00000100:00100000:1.0:1783144282.724824:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655040 00000100:00100000:1.0:1783144282.724827:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655040 00000100:00100000:1.0:1783144282.724845:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 753 00000100:00100000:1.0:1783144282.724851:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:2403:x1869759481654912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144282.724878:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:2403:x1869759481654912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144282.724884:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 753 00000100:00100000:1.0:1783144282.724895:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 754 00000100:00100000:1.0:1783144282.724900:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481655040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144282.724920:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481655040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144282.724925:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 754 00000100:00100000:3.0:1783144282.725143:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481654784 00000100:00100000:3.0:1783144282.725149:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481654784 00000100:00100000:3.0:1783144282.725281:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1783144282.725297:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa1f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2402:x1869759481654784:12345-192.168.203.4@tcp:250:kworker.0 00010000:00080000:3.0:1783144282.725321:0:86921:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12@192.168.203.4@tcp t0 exp 0000000000000000 cur 2817 last 0 00000020:00000080:3.0:1783144282.725349:0:86921:0:(genops.c:1406:class_connect()) connect: client 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12, cookie 0xad8e53a423047949 00000100:00080000:3.0:1783144282.725487:0:86921:0:(import.c:65:import_set_state_nolock()) ffff9c2ac752d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144282.725532:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa1f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:2402:x1869759481654784:12345-192.168.203.4@tcp:250:kworker.0 Request processed in 234us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144282.725540:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00010000:00010000:0.0:1783144283.085881:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783144283.664679:0:86916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215106 is committed 00000001:00080000:1.0:1783144283.666280:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968824 is committed 00000001:00100000:1.0:1783144283.666339:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00080000:2.0:1783144283.669985:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968824 is committed 00000001:00100000:2.0:1783144283.670027:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00010000:00010000:1.0:1783144284.109958:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144284.647259:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144284.647307:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655424 00000100:00100000:3.0:1783144284.647318:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655424 00000100:00100000:3.0:1783144284.647369:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1783144284.647388:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa1f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:42333:x1869759481655424:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144284.647405:0:86923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144284.647431:0:86923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423047950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a18 expref: -99 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.647466:0:86923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423047950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a18 expref: 6 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.647478:0:86923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423047950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a18 expref: 6 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.647488:0:86923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0200, rc 0) 00000100:00100000:3.0:1783144284.647556:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa1f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481655424:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 170us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144284.647563:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1783144284.652847:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144284.652917:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655552 00000100:00100000:3.0:1783144284.652927:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655552 00000100:00100000:3.0:1783144284.652982:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:3.0:1783144284.652992:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481655552:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144284.653019:0:86922:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783144284.653042:0:86922:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144284.653047:0:86922:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783144284.653050:0:86922:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783144284.653052:0:86922:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783144284.653055:0:86922:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:3.0:1783144284.660212:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481655552:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 Request processed in 7211us (7364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144284.660225:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1783144284.664496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144284.664546:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655680 00000100:00100000:3.0:1783144284.664563:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655680 00000100:00100000:3.0:1783144284.664619:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1783144284.664629:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481655680:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144284.664653:0:86923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144284.664669:0:86923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a1f expref: -99 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.664695:0:86923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a1f expref: 7 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.664706:0:86923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a1f expref: 7 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.664713:0:86923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0800, rc 0) 00000100:00100000:3.0:1783144284.664783:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481655680:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 155us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144284.664791:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:0.0:1783144284.666536:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144284.666609:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655808 00000100:00100000:1.0:1783144284.666616:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655808 00000100:00100000:1.0:1783144284.666658:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1783144284.666668:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c374f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481655808:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144284.666908:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c374f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481655808:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 239us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144284.666916:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1783144284.669142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144284.669452:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481655936 00000100:00100000:0.0:1783144284.669459:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481655936 00000100:00100000:0.0:1783144284.669506:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1783144284.669515:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481655936:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144284.669622:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481655936:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 107us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144284.669629:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1783144284.674791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144284.674847:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481656064 00000100:00100000:3.0:1783144284.674856:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481656064 00000100:00100000:3.0:1783144284.674910:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:3.0:1783144284.674920:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481656064:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144284.674935:0:86922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144284.674951:0:86922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1400/0xad8e53a42304795e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a26 expref: -99 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.674990:0:86922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1400/0xad8e53a42304795e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a26 expref: 9 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.675002:0:86922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1400/0xad8e53a42304795e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a26 expref: 9 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144284.675020:0:86922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1400, rc 0) 00000100:00100000:3.0:1783144284.675077:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481656064:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 158us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144284.675092:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1783144284.676211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144284.676341:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481656192 00000100:00100000:0.0:1783144284.676347:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481656192 00000100:00100000:0.0:1783144284.676419:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1783144284.676428:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481656192:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144284.676887:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481656192:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 459us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144284.676895:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:1.0:1783144284.678709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144284.678941:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481656320 00000100:00100000:2.0:1783144284.678957:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481656320 00000100:00100000:2.0:1783144284.679005:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:2.0:1783144284.679015:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481656320:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144284.679119:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481656320:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 102us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144284.679124:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1783144284.685467:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144284.685518:0:86926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481656448 00000100:00100000:2.0:1783144284.685527:0:86926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481656448 00000100:00100000:2.0:1783144284.685585:0:86926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1783144284.685596:0:86926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481656448:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144284.685712:0:86926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144284.685748:0:86926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a2d expref: -99 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144284.685787:0:86926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a2d expref: 10 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144284.685799:0:86926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a2d expref: 10 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144284.685809:0:86926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00400, rc 0) 00000100:00100000:2.0:1783144284.686000:0:86926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481656448:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 406us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144284.686009:0:86926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1783144284.687072:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144284.687498:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501280896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144284.687546:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144284.687589:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501280896 00000100:00100000:0.0:1783144284.687595:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501280896 00000100:00100000:2.0:1783144284.687602:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501281024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144284.687643:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:2.0:1783144284.687649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144284.687656:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501280896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144284.687682:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783144284.687696:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144284.687710:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501281024 00000100:00100000:2.0:1783144284.687714:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501281024 00000100:00100000:0.0:1783144284.687756:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501280896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144284.687765:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:1.0:1783144284.687850:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501280896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144284.687956:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1783144284.687965:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501281024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144284.687981:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144284.688022:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501281024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144284.688029:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00080000:2.0:1783144284.688050:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144284.688441:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501281024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144284.690287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144284.690368:0:86921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481656576 00000100:00100000:3.0:1783144284.690374:0:86921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481656576 00000100:00100000:3.0:1783144284.690472:0:86921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:3.0:1783144284.690480:0:86921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481656576:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144284.690679:0:86921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481656576:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 199us (395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144284.690688:0:86921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00010000:00010000:1.0:1783144285.135027:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783144285.529266:0:87739:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 01:51:24 (1783144284) 00000100:00100000:0.0:1783144285.592373:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144285.592496:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481656704 00000100:00100000:1.0:1783144285.592505:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481656704 00000100:00100000:1.0:1783144285.592570:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1060 00000100:00100000:1.0:1783144285.592580:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:67664:x1869759481656704:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144285.592597:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144285.592616:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a42304796c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a34 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592679:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592692:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592703:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592718:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592758:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592765:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592802:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592809:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592815:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592820:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144285.592824:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592839:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592851:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e400) 00010000:00010000:1.0:1783144285.592854:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144285.592858:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592864:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a423047973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592874:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592879:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592884:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592889:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144285.592892:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592898:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592904:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c29c728a000) 00010000:00010000:1.0:1783144285.592906:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144285.592909:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592923:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c600/0xad8e53a42304797a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592954:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a42304796c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a34 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592963:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e400) 00010000:00010000:1.0:1783144285.592965:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144285.592968:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c800/0xad8e53a42304796c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a34 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144285.592977:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c800, rc 0) 00000100:00100000:1.0:1783144285.593025:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:67664:x1869759481656704:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 443us (653us total) trans 0 rc 301/301 00000100:00100000:1.0:1783144285.593032:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1060 00000100:00080000:0.0:1783144285.593301:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144285.595842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144285.595928:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481656960 00000100:00100000:3.0:1783144285.595936:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481656960 00000100:00100000:3.0:1783144285.596015:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1061 00000100:00100000:3.0:1783144285.596026:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+8:67664:x1869759481656960:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144285.596043:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144285.596046:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783144285.596068:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6600/0xad8e53a4230478ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c419fc expref: 8 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596085:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee58e400) 00010000:00010000:3.0:1783144285.596095:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144285.596111:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047981 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a3b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596206:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596216:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596223:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596234:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596240:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596248:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596620:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596629:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596636:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144285.596646:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:3.0:1783144285.596667:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596674:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596687:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596693:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596699:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144285.596785:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596793:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596803:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:3.0:1783144285.596806:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144285.596809:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596816:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047988 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144285.596826:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2a325a0 reply state 000000004dc0f33c transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596837:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596844:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c2ae0bf0e00) 00010000:00010000:3.0:1783144285.596846:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144285.596848:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144285.596870:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047981 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596899:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 9 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.596907:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0100) 00010000:00010000:3.0:1783144285.596909:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144285.596911:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1a00, rc 0) 00000100:00100000:3.0:1783144285.596969:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:67664:x1869759481656960:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 946us (1133us total) trans 103079215107 rc 0/0 00000100:00100000:3.0:1783144285.596977:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1061 00000100:00100000:1.0:1783144285.598893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144285.598928:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481657216 00000100:00100000:3.0:1783144285.598935:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481657216 00000100:00100000:3.0:1783144285.599019:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1062 00000100:00100000:3.0:1783144285.599038:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:67664:x1869759481657216:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144285.599056:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144285.599069:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a4230479a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a42 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.599141:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.599153:0:66143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 11 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.599162:0:66143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.599189:0:66143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 11 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.599208:0:66143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 11 pid: 66112 timeout: 2919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144285.599224:0:66143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66143:1869759501281152:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144285.599284:0:66143:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144285.601396:0:66143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66143:1869759501281152:192.168.203.4@tcp:104: 00000100:00100000:1.0:1783144285.601413:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144285.601476:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481657344 00000100:00100000:0.0:1783144285.601488:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481657344 00010000:00010000:0.0:1783144285.601519:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 12 pid: 66112 timeout: 2919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144285.601556:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2539 00000100:00100000:0.0:1783144285.601565:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cace81e7-a6f2-4d37-b197-caf34583781c+12:2403:x1869759481657344:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144285.601579:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144285.601588:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 12 pid: 66112 timeout: 2919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.601590:0:66143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144285.601610:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 12 pid: 66112 timeout: 2919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144285.601630:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a423047996 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a3b expref: 12 pid: 66112 timeout: 2919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144285.601644:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0100) 00010000:00010000:0.0:1783144285.601648:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144285.601658:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144285.601665:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144285.601691:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144285.601755:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cace81e7-a6f2-4d37-b197-caf34583781c+11:2403:x1869759481657344:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 191us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144285.601773:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2539 00010000:00010000:3.0:1783144285.601970:0:66143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.601979:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144285.601995:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:3.0:1783144285.602871:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.602880:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.602887:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.602893:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144285.602898:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.602914:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.602973:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0100) 00010000:00010000:3.0:1783144285.602976:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144285.602980:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.602986:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230479ab lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.603081:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a4230479a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a42 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.603091:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae0bf0400) 00010000:00010000:3.0:1783144285.603093:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144285.603097:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a4230479a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a42 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144285.603110:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0a00, rc 0) 00000100:00100000:3.0:1783144285.603236:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:67664:x1869759481657216:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 4207us (4341us total) trans 103079215108 rc 301/301 00000100:00100000:3.0:1783144285.603243:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1062 00000100:00100000:1.0:1783144285.605222:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144285.606044:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481657600 00000100:00100000:0.0:1783144285.606052:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481657600 00000100:00100000:0.0:1783144285.606103:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:0.0:1783144285.606116:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:67664:x1869759481657600:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1783144285.606321:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:67664:x1869759481657600:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 207us (1098us total) trans 103079215109 rc 0/0 00000100:00100000:0.0:1783144285.606330:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 217 00000100:00100000:1.0:1783144285.608102:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144285.608399:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481657856 00000100:00100000:2.0:1783144285.608418:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481657856 00000100:00100000:2.0:1783144285.608476:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:2.0:1783144285.608486:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+11:67664:x1869759481657856:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1783144285.608653:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+12:67664:x1869759481657856:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 169us (555us total) trans 103079215110 rc 0/0 00000100:00100000:2.0:1783144285.608662:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 218 00000001:00080000:1.0:1783144286.017804:0:86916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:3.0:1783144286.017838:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.017851:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.017874:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.017881:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144286.017886:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.017895:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.017919:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c2ae0bf0e00) 00010000:00010000:3.0:1783144286.017923:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144286.017928:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.017934:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304798f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144286.047022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144286.047133:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481657984 00000100:00100000:2.0:1783144286.047141:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481657984 00000100:00100000:2.0:1783144286.047196:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1063 00000100:00100000:2.0:1783144286.047205:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:67674:x1869759481657984:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144286.047226:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144286.047247:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230479b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a49 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.047304:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.047317:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.047330:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144286.047381:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144286.047385:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144286.047412:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.047445:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230479b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a49 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.047471:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a49 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.047479:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2b01242900) 00010000:00010000:2.0:1783144286.047482:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144286.047485:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01800, rc 0) 00000100:00100000:2.0:1783144286.047544:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:67674:x1869759481657984:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 340us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144286.047551:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1063 00000100:00100000:3.0:1783144286.050223:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144286.050391:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481658112 00000100:00100000:2.0:1783144286.050409:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481658112 00000100:00100000:2.0:1783144286.050462:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1064 00000100:00100000:2.0:1783144286.050473:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:67674:x1869759481658112:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144286.050508:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:2.0:1783144286.050566:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:67674:x1869759481658112:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144286.050573:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1064 00000100:00100000:0.0:1783144286.052344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144286.053369:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481658240 00000100:00100000:1.0:1783144286.053378:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481658240 00000100:00100000:1.0:1783144286.053494:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1065 00000100:00100000:1.0:1783144286.053506:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:67674:x1869759481658240:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144286.053537:0:66947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:1.0:1783144286.053607:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:67674:x1869759481658240:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 104us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144286.053615:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1065 00000100:00080000:0.0:1783144286.053662:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144286.058083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144286.058222:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481658368 00000100:00100000:2.0:1783144286.058231:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481658368 00000100:00100000:2.0:1783144286.058328:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1572 00000100:00100000:2.0:1783144286.058339:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:67674:x1869759481658368:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144286.058362:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783144286.058483:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144286.058490:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:67674:x1869759481658368:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 151us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144286.058499:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1572 00000100:00100000:0.0:1783144286.060386:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144286.060448:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481658496 00000100:00100000:3.0:1783144286.060454:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481658496 00000100:00100000:3.0:1783144286.060498:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1573 00000100:00100000:3.0:1783144286.060507:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:67674:x1869759481658496:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1783144286.060523:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144286.060564:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:67674:x1869759481658496:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144286.060571:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1573 00000100:00080000:0.0:1783144286.060670:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144286.096221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144286.096384:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481658752 00000100:00100000:2.0:1783144286.096393:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481658752 00000100:00100000:2.0:1783144286.096483:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1066 00000100:00100000:2.0:1783144286.096493:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:67681:x1869759481658752:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00010000:2.0:1783144286.096553:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144286.096580:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a49 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.096596:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2b01242900) 00010000:00010000:2.0:1783144286.096607:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144286.096660:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.096671:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.096679:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.096688:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.096694:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.096699:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100101:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100129:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100137:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100143:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144286.100148:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100157:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100172:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2b01242500) 00010000:00010000:2.0:1783144286.100175:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144286.100179:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100185:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144286.100202:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000ba0cee reply state 000000001b7a8b77 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100213:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.100220:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2b01242400) 00010000:00010000:2.0:1783144286.100223:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144286.100225:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144286.100320:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+9:67681:x1869759481658752:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 3825us (4103us total) trans 103079215111 rc 0/0 00000100:00100000:2.0:1783144286.100335:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1066 00000100:00100000:3.0:1783144286.114478:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144286.114777:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481658880 00000100:00100000:1.0:1783144286.114786:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481658880 00000100:00100000:1.0:1783144286.115008:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1067 00000100:00100000:1.0:1783144286.115019:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:67684:x1869759481658880:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1783144286.115041:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144286.115060:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47cc00/0xad8e53a4230479d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a50 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.115119:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47ca00/0xad8e53a4230479dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.115131:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47ca00/0xad8e53a4230479dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.115141:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47ca00/0xad8e53a4230479dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144286.115184:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144286.115187:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144286.115205:0:66112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47ca00/0xad8e53a4230479dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.115226:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47cc00/0xad8e53a4230479d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a50 expref: 11 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.115244:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47ca00/0xad8e53a4230479dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a50 expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.115259:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089600) 00010000:00010000:1.0:1783144286.115261:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144286.115265:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47ca00, rc 0) 00000100:00100000:1.0:1783144286.115319:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:67684:x1869759481658880:12345-192.168.203.4@tcp:101:rm.0 Request processed in 301us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144286.115325:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1067 00000100:00100000:0.0:1783144286.117685:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144286.117782:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659008 00000100:00100000:2.0:1783144286.117791:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659008 00000100:00100000:2.0:1783144286.117837:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1068 00000100:00100000:2.0:1783144286.117846:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:67684:x1869759481659008:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1783144286.117864:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144286.117881:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a57 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.117933:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.117946:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.117957:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.117967:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.117973:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.117980:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118045:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a4230479f8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118068:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a4230479f8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118075:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a4230479f8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144286.118110:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783144286.118114:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144286.118133:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a4230479f8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118144:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a4230479f8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118163:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118170:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118176:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118181:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144286.118185:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118191:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118201:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089600) 00010000:00010000:2.0:1783144286.118209:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144286.118213:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118219:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a4230479ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118229:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118235:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118240:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118246:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144286.118249:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118255:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118266:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2b01242400) 00010000:00010000:2.0:1783144286.118269:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144286.118271:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118277:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230479f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118297:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a4230479e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a57 expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118320:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a4230479f8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a57 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144286.118328:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c2b01242500) 00010000:00010000:2.0:1783144286.118330:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144286.118332:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00a00, rc 0) 00000100:00100000:2.0:1783144286.118391:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:67684:x1869759481659008:12345-192.168.203.4@tcp:101:rm.0 Request processed in 546us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144286.118408:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1068 00000100:00100000:0.0:1783144286.120315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144286.120403:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659264 00000100:00100000:3.0:1783144286.120411:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659264 00000100:00100000:3.0:1783144286.120457:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1069 00000100:00100000:3.0:1783144286.120466:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:67684:x1869759481659264:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1783144286.120510:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783144286.120530:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a4230479f8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a57 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120547:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c2b01242500) 00010000:00010000:3.0:1783144286.120561:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47ca00/0xad8e53a4230479dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a50 expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120570:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089600) 00010000:00010000:3.0:1783144286.120575:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144286.120595:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120605:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120614:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120624:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120632:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120638:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120711:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120795:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.120804:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121031:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121040:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121048:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121055:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121061:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121066:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121088:0:66113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144286.121102:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121108:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121120:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121125:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144286.121129:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121137:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121145:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c2ad059eb00) 00010000:00010000:3.0:1783144286.121148:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783144286.121151:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121157:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a0d lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121172:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121178:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121183:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121189:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121193:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144286.121200:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121206:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121213:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ad059ed00) 00010000:00010000:3.0:1783144286.121215:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144286.121218:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.121223:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144286.121224:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a4230479ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.121233:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144286.121242:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d14ad103 reply state 00000000ebb18ecd transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.121243:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144286.121248:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121262:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.121264:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144286.121279:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2b01242400) 00010000:00010000:3.0:1783144286.121283:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144286.121285:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c2ad059eb00) 00000100:00100000:3.0:1783144286.121286:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144286.121292:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783144286.121296:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.121302:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423047a14 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144286.121319:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144286.121320:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144286.121323:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144286.121379:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:67684:x1869759481659264:12345-192.168.203.4@tcp:36:rm.0 Request processed in 913us (1070us total) trans 103079215112 rc 0/0 00000100:00100000:3.0:1783144286.121387:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1069 00010000:00010000:0.0:1783144286.157938:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144287.181875:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144287.757874:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501281280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144287.757945:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144287.758009:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501281280 00000100:00100000:0.0:1783144287.758017:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501281280 00000100:00100000:0.0:1783144287.758082:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:0.0:1783144287.758091:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501281280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783144287.758116:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144287.758162:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501281280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.758169:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:0.0:1783144287.758218:0:3649:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968824 gen 2 00000100:00100000:0.0:1783144287.758254:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501281280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144287.758491:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501281408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144287.758522:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144287.758541:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501281920:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.758567:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144287.758596:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501282432:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.758621:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144287.758644:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501282944:0@lo:400:kworker.0 00000100:00100000:0.0:1783144287.758654:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282432 00000100:00100000:3.0:1783144287.758666:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144287.758683:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1783144287.758689:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501281536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144287.758710:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282432 00000100:00100000:3.0:1783144287.758715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144287.758755:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501282048:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.758779:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144287.758799:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501282560:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.758824:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144287.758844:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501283072:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.758868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144287.758884:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282944 00000100:00100000:0.0:1783144287.758895:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282944 00000100:00100000:3.0:1783144287.758899:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501281408 00000100:00100000:3.0:1783144287.758905:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501281408 00000100:00100000:0.0:1783144287.758923:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282560 00000100:00100000:0.0:1783144287.758927:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282560 00000100:00100000:3.0:1783144287.758942:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:3.0:1783144287.758953:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501281408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783144287.758966:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00002000:00000024:3.0:1783144287.758974:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144287.758976:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501282432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.759028:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501281408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.759029:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501282432:12345-0@lo:400:kworker.0 Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.759046:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:3.0:1783144287.759048:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:0.0:1783144287.759064:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1783144287.759071:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501282944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.759076:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501281920 00000100:00100000:3.0:1783144287.759081:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501281920 00000100:00100000:0.0:1783144287.759101:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501282944:12345-0@lo:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.759107:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:3.0:1783144287.759116:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282048 00000100:00100000:3.0:1783144287.759121:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282048 00000100:00100000:0.0:1783144287.759123:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:0.0:1783144287.759131:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501282560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.759149:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501283072 00000100:00100000:3.0:1783144287.759154:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501283072 00000100:00100000:0.0:1783144287.759159:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501282560:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.759167:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1783144287.759195:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1783144287.759204:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501281920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783144287.760330:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783144287.760336:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144287.760339:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144287.760341:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144287.760436:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501281920:12345-0@lo:400:kworker.0 Request processed in 1231us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.760444:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1783144287.760461:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1783144287.760468:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501282048:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783144287.760485:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afa947800 x1869759501282048/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1783144298 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144287.760520:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501282048:12345-0@lo:400:kworker.0 Request processed in 53us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.760526:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1783144287.760536:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1783144287.760542:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501283072:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783144287.760552:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c3dff480 x1869759501283072/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1783144298 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144287.760575:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501283072:12345-0@lo:400:kworker.0 Request processed in 34us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.760581:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1783144287.760600:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501281536 00000100:00100000:3.0:1783144287.760604:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501281536 00000100:00100000:3.0:1783144287.761284:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:3.0:1783144287.761293:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501281536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783144287.761318:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144287.761354:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501281536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.761367:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1783144287.761833:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501281664:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.761875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144287.761951:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501282176:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.761975:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144287.761994:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501282688:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762015:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144287.762030:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501283200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144287.762054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144287.762077:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783144287.762093:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501281792:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762120:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144287.762142:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501282304:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144287.762185:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501282816:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144287.762338:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282176 00000100:00100000:2.0:1783144287.762343:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282176 00000100:00100000:2.0:1783144287.762381:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282688 00000100:00100000:2.0:1783144287.762384:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282688 00000100:00100000:2.0:1783144287.762413:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501281792 00000100:00100000:2.0:1783144287.762416:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501281792 00000100:00100000:2.0:1783144287.762436:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1783144287.762443:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501282176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762485:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501282176:12345-0@lo:400:kworker.0 Request processed in 41us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144287.762491:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1783144287.762507:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1783144287.762514:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501282688:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783144287.762533:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afa81a300 x1869759501282688/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1783144298 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144287.762535:0:86923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501281664 00000100:00100000:0.0:1783144287.762542:0:86923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501281664 00000100:00100000:2.0:1783144287.762571:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501282688:12345-0@lo:400:kworker.0 Request processed in 57us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.762573:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501283200 00000100:00100000:3.0:1783144287.762580:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501283200 00000100:00100000:2.0:1783144287.762585:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1783144287.762589:0:86923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783144287.762600:0:86923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501281664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762606:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1783144287.762609:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282304 00000100:00100000:3.0:1783144287.762615:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282304 00000100:00100000:2.0:1783144287.762620:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501281792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.762633:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501282816 00000100:00100000:3.0:1783144287.762638:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501282816 00010000:00000080:2.0:1783144287.762646:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afa819880 x1869759501281792/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1783144298 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144287.762653:0:86923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501281664:12345-0@lo:400:kworker.0 Request processed in 54us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.762657:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:0.0:1783144287.762668:0:86923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783144287.762673:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501283200:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144287.762691:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501281792:12345-0@lo:400:kworker.0 Request processed in 75us (570us total) trans 0 rc 0/0 00000004:00000024:3.0:1783144287.762699:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445007360 avail 1298767872 00000100:00100000:2.0:1783144287.762700:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00010000:00000080:3.0:1783144287.762715:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afa81b100 x1869759501283200/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:398/0 lens 224/368 e 0 to 0 dl 1783144298 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144287.762746:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1783144287.762756:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501282304:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783144287.762770:0:78024:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afa81a680 x1869759501282304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1783144298 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144287.762779:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501283200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.762788:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:2.0:1783144287.762808:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501282304:12345-0@lo:400:kworker.0 Request processed in 52us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.762809:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1783144287.762821:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:3.0:1783144287.762825:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501282816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783144287.762848:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783144287.762853:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144287.762865:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501282816:12345-0@lo:400:kworker.0 Request processed in 44us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.762873:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1783144287.762888:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501281792:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762901:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501282304:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762911:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501282816:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762918:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501281664:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762929:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501282176:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762942:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501282688:0@lo:400:kworker.0 00000100:00100000:2.0:1783144287.762954:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501283200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144287.762996:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501281536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144287.763012:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501282048:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.763025:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501282560:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.763034:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501283072:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.763056:0:3650:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968824 gen 2 00000100:00100000:3.0:1783144287.763072:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501281408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144287.763084:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501281920:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.763095:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501282432:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.763104:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501282944:0@lo:400:kworker.0 00000100:00100000:3.0:1783144287.845251:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144287.845283:0:86922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659392 00000100:00100000:0.0:1783144287.845293:0:86922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659392 00000100:00100000:3.0:1783144287.845294:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144287.845322:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659520 00000100:00100000:3.0:1783144287.845327:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659520 00000100:00100000:0.0:1783144287.845349:0:86922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:0.0:1783144287.845363:0:86922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2406:x1869759481659392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144287.845376:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 761 00000100:00100000:3.0:1783144287.845403:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+11:2406:x1869759481659520:12345-192.168.203.4@tcp:400:kworker.0 00010000:00000080:3.0:1783144287.845426:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c3dfe680 x1869759481659520/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:398/0 lens 224/224 e 0 to 0 dl 1783144298 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144287.845437:0:86922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaa2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2406:x1869759481659392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.845446:0:86922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1783144287.845459:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+11:2406:x1869759481659520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144287.845467:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 761 00000100:00080000:3.0:1783144287.845824:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144287.848376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144287.848432:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144287.848446:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659648 00000100:00100000:0.0:1783144287.848455:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659648 00000100:00100000:0.0:1783144287.848503:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 762 00000100:00100000:0.0:1783144287.848514:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481659648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144287.848568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144287.848577:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481659648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.848585:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 762 00000100:00100000:1.0:1783144287.849120:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659904 00000100:00100000:1.0:1783144287.849125:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659904 00000100:00100000:1.0:1783144287.849149:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659776 00000100:00100000:1.0:1783144287.849152:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659776 00000100:00100000:1.0:1783144287.849176:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1985 00000100:00100000:0.0:1783144287.849185:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1986 00000100:00100000:1.0:1783144287.849186:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481659904:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144287.849198:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481659776:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144287.849221:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481659904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144287.849229:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1985 00000100:00100000:0.0:1783144287.849238:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481659776:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144287.849246:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1986 00010000:00010000:2.0:1783144288.206912:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144289.231023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783144289.331958:0:88134:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1783144289.375127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144289.375189:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660032 00000100:00100000:3.0:1783144289.375198:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660032 00000100:00100000:3.0:1783144289.375270:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1070 00000100:00100000:3.0:1783144289.375281:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:67751:x1869759481660032:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144289.375307:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144289.375335:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423047a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a5e expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.375413:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.375427:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.375437:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144289.375481:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144289.375485:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144289.375518:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.375542:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423047a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a5e expref: 13 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.375556:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a5e expref: 12 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.375565:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ad059e500) 00010000:00010000:3.0:1783144289.375568:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144289.375571:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0a00, rc 0) 00010000:00000080:3.0:1783144289.375578:0:66113:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c60b5c00 x1869759481660032/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:400/0 lens 576/688 e 0 to 0 dl 1783144300 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144289.375638:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:67751:x1869759481660032:12345-192.168.203.4@tcp:101:dd.0 Request processed in 359us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144289.375646:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1070 00000100:00080000:2.0:1783144289.375702:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144289.377927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144289.377970:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660288 00000100:00100000:2.0:1783144289.377978:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660288 00000100:00100000:2.0:1783144289.378028:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1071 00000100:00100000:2.0:1783144289.378040:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+12:67751:x1869759481660288:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144289.378056:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144289.378059:0:66947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783144289.378082:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a5e expref: 12 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378096:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ad059e500) 00010000:00010000:2.0:1783144289.378106:0:66947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144289.378118:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01a00/0xad8e53a423047a29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a65 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378220:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378229:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378235:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378244:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378260:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378266:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378324:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378330:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378334:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144289.378420:0:66947:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1783144289.378424:0:66947:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1783144285 00000004:00010000:2.0:1783144289.378426:0:66947:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1783144285 00000004:00010000:2.0:1783144289.378428:0:66947:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1783144285 00000004:00010000:2.0:1783144289.378430:0:66947:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1783144289.378434:0:66947:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1783144289.378440:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378447:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378454:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378461:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378474:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144289.378478:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378487:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378496:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2b01242900) 00010000:00010000:2.0:1783144289.378499:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144289.378503:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378509:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423047a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378519:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378524:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378529:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378533:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144289.378535:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378541:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378560:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c2b01242d00) 00010000:00010000:2.0:1783144289.378562:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144289.378566:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378572:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423047a37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378615:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01a00/0xad8e53a423047a29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 14 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378633:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 13 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.378640:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2b01242b00) 00010000:00010000:2.0:1783144289.378643:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783144289.378645:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01e00, rc 0) 00010000:00000080:2.0:1783144289.378652:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c3dfe300 x1869759481660288/t103079215113(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:400/0 lens 752/824 e 0 to 0 dl 1783144300 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144289.378711:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+13:67751:x1869759481660288:12345-192.168.203.4@tcp:101:dd.0 Request processed in 674us (790us total) trans 103079215113 rc 0/0 00000100:00100000:2.0:1783144289.378719:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1071 00000100:00100000:1.0:1783144289.381892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144289.381991:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660416 00000100:00100000:3.0:1783144289.382000:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660416 00000100:00100000:3.0:1783144289.382057:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1072 00000100:00100000:3.0:1783144289.382067:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+13:67751:x1869759481660416:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144289.382087:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144289.382103:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423047a4c lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a6c expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.382130:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047a53 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.382141:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047a53 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.382150:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047a53 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.382247:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423047a4c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a6c expref: 15 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.382261:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047a53 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a6c expref: 14 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144289.382269:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2b01242b00) 00010000:00010000:3.0:1783144289.382271:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144289.382274:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1c00, rc 0) 00010000:00000080:3.0:1783144289.382281:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef92ce00 x1869759481660416/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:400/0 lens 568/1272 e 0 to 0 dl 1783144300 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144289.382342:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+14:67751:x1869759481660416:12345-192.168.203.4@tcp:101:dd.0 Request processed in 276us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144289.382349:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1072 00000100:00100000:0.0:1783144289.385310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144289.385385:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660672 00000100:00100000:1.0:1783144289.385393:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660672 00000100:00100000:1.0:1783144289.385513:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1073 00000100:00100000:1.0:1783144289.385523:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+14:67751:x1869759481660672:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:1.0:1783144289.385622:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.385638:0:81077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 14 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.385646:0:81077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.385674:0:81077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 14 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.385687:0:81077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 14 pid: 66947 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144289.385708:0:81077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:81077:1869759501283328:192.168.203.4@tcp:104: 00000100:00100000:1.0:1783144289.385799:0:81077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144289.388417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144289.388492:0:81077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:81077:1869759501283328:192.168.203.4@tcp:104: 00010000:00010000:1.0:1783144289.388513:0:81077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144289.388528:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660800 00000100:00100000:2.0:1783144289.388535:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660800 00010000:00010000:2.0:1783144289.388565:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 15 pid: 66947 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144289.388611:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2540 00000100:00100000:2.0:1783144289.388621:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cace81e7-a6f2-4d37-b197-caf34583781c+15:2404:x1869759481660800:12345-192.168.203.4@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1783144289.388635:0:6507:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 15 pid: 66947 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.388647:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 15 pid: 66947 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.388668:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 15 pid: 66947 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.388676:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2b01242b00) 00010000:00010000:2.0:1783144289.388680:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783144289.388683:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.388691:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.388698:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144289.388746:0:6507:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 15 pid: 66947 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.388767:0:81077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.388776:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144289.388842:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cace81e7-a6f2-4d37-b197-caf34583781c+15:2404:x1869759481660800:12345-192.168.203.4@tcp:102:ldlm_bl.0 Request processed in 174us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144289.388860:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2540 00000004:00010000:1.0:1783144289.388900:0:81077:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1783144289.388904:0:81077:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1783144285 -> 1783144289 00000004:00010000:1.0:1783144289.388907:0:81077:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1783144285 -> 1783144285 00000004:00010000:1.0:1783144289.388909:0:81077:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1783144285 -> 1783144289 00000004:00010000:1.0:1783144289.388912:0:81077:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1783144289.388918:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aab0036a reply state 00000000384d42d8 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.388931:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144289.388938:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2b01242b00) 00010000:00010000:1.0:1783144289.388940:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144289.388943:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1783144289.388992:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aeea40a80 x1869759481660672/t103079215114(0) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:400/0 lens 488/456 e 0 to 0 dl 1783144300 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144289.389029:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+16:67751:x1869759481660672:12345-192.168.203.4@tcp:36:dd.0 Request processed in 3508us (3727us total) trans 103079215114 rc 0/0 00000100:00100000:1.0:1783144289.389036:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1073 00000100:00100000:0.0:1783144289.391869:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144289.391964:0:66125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660928 00000100:00100000:2.0:1783144289.391972:0:66125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660928 00002000:00010000:2.0:1783144289.392002:0:66125:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:2.0:1783144289.392006:0:66125:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2aeea41180 with x1869759481660928 00000100:00100000:2.0:1783144289.392041:0:66125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1783144289.392050:0:66125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+16:2403:x1869759481660928:12345-192.168.203.4@tcp:10:dd.0 00000004:00010000:2.0:1783144289.392195:0:66125:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1783144289.392198:0:66125:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1783144289 -> 1783144289 00000004:00010000:2.0:1783144289.392201:0:66125:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1783144285 -> 1783144285 00000004:00010000:2.0:1783144289.392203:0:66125:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1783144289 -> 1783144289 00000004:00010000:2.0:1783144289.392206:0:66125:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783144289.392220:0:66125:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aeea41180 x1869759481660928/t103079215115(0) o10->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:400/0 lens 440/432 e 0 to 0 dl 1783144300 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144289.392278:0:66125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+17:2403:x1869759481660928:12345-192.168.203.4@tcp:10:dd.0 Request processed in 229us (416us total) trans 103079215115 rc 0/0 00000100:00100000:2.0:1783144289.392285:0:66125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00010000:2.0:1783144289.392288:0:66125:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:2.0:1783144289.392291:0:66125:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2aeea41180 with x1869759481660928 00000100:00100000:2.0:1783144289.395104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144289.395177:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481661184 00000100:00100000:3.0:1783144289.395193:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481661184 00000100:00100000:3.0:1783144289.395238:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:3.0:1783144289.395246:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+17:67751:x1869759481661184:12345-192.168.203.4@tcp:35:dd.0 00010000:00000080:3.0:1783144289.395438:0:66115:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef5c0850 x1869759481661184/t103079215116(0) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:400/0 lens 392/456 e 0 to 0 dl 1783144300 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144289.395506:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+18:67751:x1869759481661184:12345-192.168.203.4@tcp:35:dd.0 Request processed in 259us (406us total) trans 103079215116 rc 0/0 00000100:00100000:3.0:1783144289.395517:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 219 00000100:00100000:2.0:1783144289.806911:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501283456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144289.806953:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144289.806969:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501283584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144289.806981:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144289.807012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144289.807024:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501283456 00000100:00100000:0.0:1783144289.807033:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501283456 00000100:00100000:1.0:1783144289.807071:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501283584 00000100:00100000:1.0:1783144289.807076:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501283584 00000100:00100000:0.0:1783144289.807096:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:0.0:1783144289.807108:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501283456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144289.807137:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144289.807186:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501283456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144289.807191:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:0.0:1783144289.807200:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:1.0:1783144289.807206:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501283584:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783144289.807226:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144289.807231:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144289.807306:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501283456:0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783144289.807351:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144289.807401:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501283584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144289.807408:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:3.0:1783144289.807468:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501283584:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1783144290.234021:0:88231:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783144290.234071:0:88231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.234096:0:88231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.234103:0:88231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.234110:0:88231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.234135:0:88231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783144290.234140:0:88231:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783144290.234166:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783144290.234171:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783144290.234180:0:88231:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783144290.234202:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7528000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783144290.234257:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144290.234264:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.234270:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e400 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144290.234274:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.234283:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144290.234290:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144290.234296:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783144290.234299:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783144290.234301:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783144290.234323:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.234338:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144290.234364:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.234386:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043e400/0xad8e53a4230475d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475d7 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.234396:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144290.234398:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144290.234400:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144290.234407:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144290.234424:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501283840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144290.234484:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144290.234536:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501283712:0@lo:39:umount.0 00000100:00100000:0.0:1783144290.234563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144290.234760:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501283840 00000100:00100000:3.0:1783144290.234768:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501283840 00000100:00100000:3.0:1783144290.234826:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1783144290.234838:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501283840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144290.234851:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144290.234866:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47da00/0xad8e53a4230475d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230475d0 expref: 24 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144290.234879:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144290.234919:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3650:x1869759501283840:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144290.234935:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1783144290.234958:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501283840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144290.234967:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501283712 00000100:00100000:3.0:1783144290.234972:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501283712 00000100:00100000:3.0:1783144290.235008:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1783144290.235017:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501283712:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783144290.235037:0:66112:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230476cc 00000100:00080000:3.0:1783144290.235048:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c2af9e45800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1783144290.235071:0:66112:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c354ed80 x1869759501283712/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:401/0 lens 224/224 e 0 to 0 dl 1783144301 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144290.235147:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1869759501283712:12345-0@lo:39:umount.0 Request processed in 131us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144290.235154:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000020:00000080:3.0:1783144290.235162:0:66112:0:(genops.c:906:class_export_put()) final put ffff9c2ad3daf800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1783144290.235164:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144290.235239:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad3daf800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1783144290.235244:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7528000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783144290.235266:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501283712:0@lo:39:umount.0 00000020:00000080:2.0:1783144290.235286:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af9e45800 for lustre-MDT0000 00000100:00080000:1.0:1783144290.235344:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144290.235347:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783144290.235351:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783144290.236668:0:88231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236681:0:88231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236688:0:88231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236707:0:88231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236738:0:88231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144290.236745:0:88231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236752:0:88231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236759:0:88231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236766:0:88231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.236767:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144290.236777:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236785:0:88231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144290.236787:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144290.236792:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.236802:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236804:0:88231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144290.236808:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144290.236817:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236820:0:88231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144290.236838:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47dc00 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:1.0:1783144290.236842:0:88231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144290.236844:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144290.236847:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236862:0:88231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144290.236867:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144290.236868:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144290.236875:0:9525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:00010000:3.0:1783144290.236884:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236898:0:88231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144290.236899:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.236907:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144290.236907:0:88231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.236913:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144290.236919:0:88231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.236922:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.236931:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236933:0:88231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.236939:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8c00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144290.236946:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.236954:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a4230474f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230474fe expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.236955:0:88231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144290.236972:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144290.236982:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1783144290.236984:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1783144290.236987:0:88231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144290.236988:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.236988:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144290.236989:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:1.0:1783144290.236995:0:88231:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783144290.237001:0:88231:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1783144290.237010:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fe00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144290.237010:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144290.237012:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144290.237015:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.237031:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144290.237033:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1783144290.237033:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783144290.237036:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144290.237039:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783144290.237044:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783144290.237045:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144290.237047:0:88231:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 10000000:00010000:2.0:1783144290.237048:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1783144290.237054:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1783144290.237061:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1783144290.237064:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47dc00/0xad8e53a4230475f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144290.237066:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144290.237066:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:1.0:1783144290.237068:0:88231:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 10000000:01000000:2.0:1783144290.237078:0:9525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783144290.237083:0:9525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783144290.237085:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144290.237091:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144290.237091:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144290.237094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144290.237103:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144290.237111:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501284096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144290.237112:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144290.237114:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.237123:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.237137:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8c00/0xad8e53a4230475c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230475c9 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.237149:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144290.237150:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043fe00/0xad8e53a4230474e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230474f0 expref: -99 pid: 86915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.237153:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144290.237157:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144290.237162:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144290.237168:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144290.237172:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144290.237172:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501284352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144290.237176:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144290.237191:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501283968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144290.237218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144290.237244:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501284096 00000100:00100000:0.0:1783144290.237247:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783144290.237251:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501284096 00000100:00100000:0.0:1783144290.237257:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501284224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144290.237260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144290.237291:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501284352 00000100:00100000:3.0:1783144290.237296:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501284352 00000100:00100000:0.0:1783144290.237296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144290.237324:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501283968 00000100:00100000:2.0:1783144290.237325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501284224 00000100:00100000:3.0:1783144290.237328:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501283968 00000100:00100000:2.0:1783144290.237331:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501284224 00000100:00100000:0.0:1783144290.237340:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1783144290.237354:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3649:x1869759501284096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144290.237362:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1783144290.237381:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00010000:00010000:0.0:1783144290.237384:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783144290.237386:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3651:x1869759501284352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144290.237394:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3648:x1869759501283968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144290.237401:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144290.237404:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144290.237410:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8400/0xad8e53a4230475fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230475f3 expref: 26 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144290.237415:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230474f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230474e2 expref: 26 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.237418:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe9c00/0xad8e53a4230474fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230474f7 expref: 26 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.237426:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144290.237437:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144290.237441:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144290.237476:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3649:x1869759501284096:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144290.237488:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1783144290.237493:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3651:x1869759501284352:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144290.237495:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3648:x1869759501283968:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144290.237507:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1783144290.237517:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1783144290.237527:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1783144290.237532:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3651:x1869759501284224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144290.237543:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144290.237544:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501283968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144290.237555:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af043fa00/0xad8e53a4230475c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230475c2 expref: 20 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144290.237567:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144290.237571:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501284096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144290.237597:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3651:x1869759501284224:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144290.237602:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501284224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144290.237608:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1783144290.237615:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501284352:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1783144290.240531:0:88231:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1783144290.241068:0:86916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215116 is committed 00000020:00000080:3.0:1783144290.241163:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1783144290.241172:0:88231:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2ac5d53800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144290.241178:0:88231:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2ac5d56800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144290.241183:0:88231:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aef581800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144290.241187:0:88231:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aefa7d000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144290.241193:0:88231:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aefa7b000 cace81e7-a6f2-4d37-b197-caf34583781c 192.168.203.4@tcp 11 (0 0 3) 0 0 0 3: ffff9c29ca2db000 103079215116 stale:0 00000020:00080000:3.0:1783144290.241198:0:88231:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c2ad08dcd40) has exports, disconnecting them 00000020:00080000:3.0:1783144290.241203:0:88231:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2ac5d53800), last request at 1783144277 00000020:00000080:3.0:1783144290.241209:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230476c5 00000100:00080000:3.0:1783144290.241216:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d55000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783144290.241273:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac5d53800): rc 0 00000020:00000080:3.0:1783144290.241276:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d53800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783144290.241286:0:88231:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2ac5d56800), last request at 1783144287 00000020:00000080:3.0:1783144290.241290:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230476be 00000100:00080000:3.0:1783144290.241294:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d52800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783144290.241319:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144290.241356:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241377:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241384:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241403:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144290.241407:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241414:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241429:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2b01242400) 00010000:00010000:1.0:1783144290.241432:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144290.241436:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241442:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00200/0xad8e53a4230479ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241456:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241461:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241467:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241484:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144290.241487:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241493:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241512:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2b01242400) 00010000:00010000:1.0:1783144290.241515:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144290.241518:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241524:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047a06 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144290.241540:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d53800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1783144290.241543:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241548:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241554:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241559:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144290.241562:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241567:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.241574:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2b01242b00) 00010000:00010000:1.0:1783144290.241576:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144290.241578:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144290.241584:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac5d55000 for lustre-MDT0000 00010000:00010000:1.0:1783144290.241584:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423047a5a lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783144290.241595:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac5d56800): rc 0 00000020:00000080:3.0:1783144290.241598:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d56800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783144290.241610:0:88231:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2aef581800), last request at 1783144287 00000020:00000080:3.0:1783144290.241613:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230476b7 00000100:00080000:3.0:1783144290.241618:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3dad000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783144290.241636:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144290.241652:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d56800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144290.241679:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac5d52800 for lustre-MDT0000 00010000:00010000:0.0:1783144290.241760:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783144290.241806:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aef581800): rc 0 00000020:00000080:3.0:1783144290.241809:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aef581800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783144290.241827:0:88231:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2aefa7d000), last request at 1783144272 00000020:00000080:3.0:1783144290.241836:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047544 00000100:00080000:3.0:1783144290.241845:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2afab25000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144290.241856:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aef581800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1783144290.241885:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144290.241899:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ad3dad000 for lustre-MDT0000 00000020:00080000:3.0:1783144290.241980:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aefa7d000): rc 0 00000020:00000080:3.0:1783144290.241983:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783144290.242212:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00080000:3.0:1783144290.242214:0:88231:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.4@tcp (ffff9c2aefa7b000), last request at 1783144289 00000020:00000080:1.0:1783144290.242247:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2afab25000 for lustre-MDT0000 00000020:00000080:3.0:1783144290.242275:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304753d 00000020:00010000:3.0:1783144290.242283:0:88231:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2aefa7b000: total 0 00000100:00080000:3.0:1783144290.242287:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2afab20000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783144290.242301:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2aefa7b000): rc 0 00000004:00000080:3.0:1783144290.242307:0:88231:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc16281dafae0 00000020:00010000:2.0:1783144290.242316:0:9527:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2aefa7b000: total 0 00000100:00080000:3.0:1783144290.242324:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783144290.242328:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1783144290.242353:0:9527:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2aefa7b000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1783144290.242388:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423047a3e lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 4 pid: 66947 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.242405:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a42304790a lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a03 expref: 3 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.242421:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423047a53 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a6c expref: 2 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144290.242434:0:9527:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2aefa7b000, canceled 3 locks, left on hash table 0. 00000100:00080000:3.0:1783144290.243843:0:88231:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783144290.243868:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e4800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783144290.244039:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501284480:0@lo:39:umount.0 00000100:00100000:0.0:1783144290.244098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144290.244147:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501284480 00000100:00100000:1.0:1783144290.244155:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501284480 00000100:00100000:1.0:1783144290.244211:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:1.0:1783144290.244220:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501284480:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783144290.244245:0:78024:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047583 00000100:00080000:1.0:1783144290.244251:0:78024:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783144290.244269:0:78024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378732 00000100:00080000:3.0:1783144290.244288:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144290.244292:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968824 gen 3 00000004:00080000:3.0:1783144290.244304:0:88231:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783144290.244426:0:88231:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783144290.244436:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb4800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783144290.244516:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501284608:0@lo:9:umount.0 00000100:00100000:0.0:1783144290.244543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144290.244690:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1869759501284480:12345-0@lo:39:umount.0 Request processed in 469us (589us total) trans 81604378733 rc 0/0 00000100:00100000:1.0:1783144290.244698:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00080000:0.0:1783144290.244700:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e4800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783144290.244708:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501284480:0@lo:39:umount.0 00000100:00100000:0.0:1783144290.244758:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501284608 00000100:00100000:0.0:1783144290.244762:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501284608 00000100:00100000:0.0:1783144290.244794:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935 00000100:00100000:0.0:1783144290.244800:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501284608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783144290.244814:0:26145:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304759f 00000100:00080000:0.0:1783144290.244819:0:26145:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c71800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783144290.244849:0:26145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968824 00000100:00080000:1.0:1783144290.244888:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783144290.244904:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144290.244959:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501284608:12345-0@lo:9:umount.0 Request processed in 159us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144290.244968:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935 00000100:00080000:1.0:1783144290.244985:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783144290.244991:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783144290.244993:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783144290.244996:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501284608:0@lo:9:umount.0 00000100:00080000:3.0:1783144290.245161:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144290.245163:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968824 gen 3 00000004:00080000:3.0:1783144290.245206:0:88231:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783144290.245322:0:88231:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783144290.245332:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2b017f6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783144290.245388:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c2ad08dcd40) has no exports 00010000:00010000:3.0:1783144290.245413:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144290.245501:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501284736:0@lo:9:umount.0 00000100:00100000:1.0:1783144290.245525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144290.246322:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501284736 00000100:00100000:3.0:1783144290.246328:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501284736 00000100:00100000:3.0:1783144290.246387:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4936 00000100:00100000:3.0:1783144290.246396:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501284736:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783144290.246412:0:26150:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230475ad 00000100:00080000:3.0:1783144290.246418:0:26150:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c76000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783144290.246447:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1783144290.246451:0:26150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968824 00000100:00080000:0.0:1783144290.246499:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144290.246596:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501284736:12345-0@lo:9:umount.0 Request processed in 200us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144290.246604:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4936 00000100:00080000:1.0:1783144290.246672:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2b017f6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783144290.246688:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783144290.246690:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783144290.246694:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501284736:0@lo:9:umount.0 00000020:00080000:3.0:1783144290.247049:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c2ad08dcd40) has no exports 00010000:00010000:1.0:1783144290.254321:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144290.281913:0:9527:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7b000/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:0.0:1783144290.281978:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7b000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-MDT0000 00000020:00000080:0.0:1783144290.282035:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2afab20000 for lustre-MDT0000 00010000:00010000:0.0:1783144290.282046:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144290.282049:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144290.282052:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783144290.300934:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047559 00000020:00000080:3.0:1783144290.300949:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c29c496e000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783144290.301012:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783144290.301070:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144290.301078:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783144290.301085:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783144290.301091:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c29cb138000) has no exports 00000020:00000080:2.0:1783144290.301310:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047552 00000020:00000080:2.0:1783144290.301315:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c29c496f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144290.301341:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783144290.301386:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144290.301395:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783144290.301398:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c29c4968800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783144290.301401:0:88231:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c4968800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783144290.301407:0:88231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783144290.301818:0:88231:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2ad08c3060 - data ffff9c2afa73c798/ffff9c29c619ac00 00000020:01000000:2.0:1783144290.301913:0:88231:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2aee3da540 - data ffff9c2afa7560d8/ffff9c29c4a8f000 00000100:00080000:3.0:1783144290.328108:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783144290.328116:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783144290.328131:0:88231:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c29c3dff800 x1869759501284480/t81604378733(81604378733) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144300 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144290.328153:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783144290.329263:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144290.329268:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968824 gen 4 00000004:00080000:3.0:1783144290.329296:0:88231:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144290.329298:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783144290.329501:0:86933:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783144290.329519:0:86933:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:1.0:1783144290.329529:0:86933:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:3.0:1783144290.330196:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144290.330199:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968824 gen 4 00000004:00080000:3.0:1783144290.330219:0:88231:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144290.330223:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783144290.330437:0:86935:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783144290.330440:0:86935:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1783144290.330448:0:86935:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:3.0:1783144290.332265:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047513 00000020:00000080:3.0:1783144290.332275:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa79000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144290.332810:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa79000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783144290.332934:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047528 00000020:00000080:3.0:1783144290.332940:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144290.332977:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783144290.332986:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144290.332995:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783144290.332998:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c2ad08d99c0) has no exports 00000020:00000080:0.0:1783144290.333140:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1783144290.333154:0:88231:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783144290.333162:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230475a6 00000020:00000080:3.0:1783144290.333167:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d65000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144290.333177:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783144290.333181:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144290.333189:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783144290.333192:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c29c3f119c0) has no exports 00000020:00000080:3.0:1783144290.333197:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047598 00000020:00000080:0.0:1783144290.333198:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d65000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783144290.333200:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2ac8863800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144290.333212:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac8863800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783144290.333530:0:88231:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783144290.333534:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144290.333538:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968824 gen 5 00000004:00080000:3.0:1783144290.333543:0:88231:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144290.333546:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783144290.333590:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144290.333598:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144290.333605:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304758a 00000020:00000080:3.0:1783144290.333609:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b20000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144290.333612:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783144290.333615:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144290.333620:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783144290.333622:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c29cb13b380) has no exports 00000020:00000080:3.0:1783144290.333637:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304757c 00000020:00000080:3.0:1783144290.333640:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144290.333809:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2b017f6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783144290.333820:0:52153:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b26000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144290.333821:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b26000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783144290.333825:0:52153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144290.333884:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b20000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783144290.333888:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783144290.334155:0:88231:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783144290.334158:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144290.334160:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968824 gen 5 00000004:00080000:3.0:1783144290.334163:0:88231:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144290.334164:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144290.334192:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac7fb4800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783144290.334327:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144290.334334:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144290.334337:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144290.334340:0:88231:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783144290.334349:0:88231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783144290.334440:0:88231:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783144290.334444:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304756e 00000020:00000080:3.0:1783144290.334447:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa78000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144290.334455:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783144290.334459:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144290.334465:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783144290.334468:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c29c356cd40) has no exports 00000020:00000080:3.0:1783144290.334472:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047567 00000020:00000080:0.0:1783144290.334472:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa78000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783144290.334476:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2ac91e6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144290.334489:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac91e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144290.336769:0:88231:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783144290.336776:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144290.336779:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783144290.336785:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144290.336833:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144290.336842:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144290.336867:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144290.336871:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144290.336876:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aef586000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144290.336880:0:88231:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aef586000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783144290.336885:0:88231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144290.337044:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac91e4800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783144290.337054:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144290.337057:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783144290.337068:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144290.337219:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304752f 00000020:00000080:0.0:1783144290.337224:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7e000/lustre-MDD0000_UUID 00000020:01000000:0.0:1783144290.337230:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783144290.337233:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144290.337238:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783144290.337242:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c29cb1399c0) has no exports 00000020:00000080:0.0:1783144290.337260:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144290.337264:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783144290.337267:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047536 00000020:00000080:0.0:1783144290.337270:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783144290.337285:0:88231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aee192000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783144290.337288:0:88231:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aee192000 3 00000020:01000004:0.0:1783144290.337291:0:88231:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2aee192000 from lustre-MDT0000 00000020:00000080:0.0:1783144290.337308:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144290.337312:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783144290.337315:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783144290.337317:0:88231:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783144290.337323:0:88231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783144290.337415:0:88231:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783144290.337419:0:88231:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783144290.337422:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783144290.337424:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144290.337427:0:88231:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783144290.337435:0:88231:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2ac752a000 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 192.168.203.4@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144290.337441:0:88231:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2aefdd8000 4e9e4714-8000-4c64-bed6-3cadd5fdfc80 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144290.337446:0:88231:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9c2aee594d40) has exports, disconnecting them 00000020:00080000:0.0:1783144290.337450:0:88231:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.4@tcp (ffff9c2ac752a000), last request at 1783144282 00000020:00000080:0.0:1783144290.337468:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047949 00000020:00010000:0.0:1783144290.337473:0:88231:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ac752a000: total 2 00000100:00080000:0.0:1783144290.337477:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2ac752d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144290.337489:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2ac752a000): rc 0 00000020:00080000:0.0:1783144290.337492:0:88231:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2aefdd8000), last request at 1783144272 00000020:00000080:0.0:1783144290.337531:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230474d4 00000020:00010000:0.0:1783144290.337534:0:88231:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2aefdd8000: total 2 00000100:00080000:0.0:1783144290.337536:0:88231:0:(import.c:65:import_set_state_nolock()) ffff9c2aefdd9000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144290.337541:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aefdd8000): rc 0 00000020:00080000:0.0:1783144290.337544:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9c2aee594d40) has no exports 00000100:00100000:0.0:1783144290.337582:0:86923:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2aca1d2e00:86923] 2 exiting: rc = 0 00000100:00100000:0.0:1783144290.337646:0:86922:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2aca1d2200:86922] 1 exiting: rc = 0 00000100:00100000:0.0:1783144290.337678:0:86921:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2aca3a4600:86921] 0 exiting: rc = 1 00000100:00100000:1.0:1783144290.337810:0:86926:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c2ac6dd4000:86926] 3 exiting: rc = 0 00000020:00000080:1.0:1783144290.337852:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783144290.337857:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2aefa79800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783144290.337859:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa79800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783144290.337865:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783144290.337909:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1783144290.337925:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ac752a000: total 0 00010000:00010000:1.0:1783144290.337958:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ac752a000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783144290.337990:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1400/0xad8e53a42304795e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a26 expref: 5 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338008:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a2d expref: 4 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338020:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a1f expref: 3 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338032:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423047950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a18 expref: 2 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338043:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ac752a000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783144290.338065:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c2ac752a000/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 00000020:00010000:1.0:1783144290.338072:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2aefdd8000: total 1 00010000:00010000:1.0:1783144290.338080:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144290.338095:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2aefdd8000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783144290.338107:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8200/0xad8e53a4230476b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230476a9 expref: 14 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338116:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af043f800/0xad8e53a423047640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047639 expref: 13 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338124:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8e00/0xad8e53a4230476a2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304769b expref: 12 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338133:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c400/0xad8e53a423047632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304762b expref: 11 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338142:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af043fc00/0xad8e53a42304764e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047647 expref: 10 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338150:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517800/0xad8e53a42304765c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047655 expref: 9 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338158:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe9600/0xad8e53a42304766a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047663 expref: 8 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338166:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8600/0xad8e53a423047678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047671 expref: 7 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338173:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe9a00/0xad8e53a423047608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047601 expref: 6 pid: 86923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338179:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423047616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304760f expref: 5 pid: 86922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338196:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423047694 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304768d expref: 4 pid: 86926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338208:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe9200/0xad8e53a423047624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304761d expref: 3 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338218:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af043f000/0xad8e53a423047686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304767f expref: 2 pid: 86921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144290.338227:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2aefdd8000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783144290.338239:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c2aefdd8000/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 00010000:00010000:1.0:1783144290.338243:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144290.338245:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144290.338246:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783144290.338253:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac752a000/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 for MGS 00000020:00000080:1.0:1783144290.338274:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefdd8000/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 for MGS 00000020:00000080:1.0:1783144290.338285:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac752d000 for MGS 00000020:00000080:1.0:1783144290.338290:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aefdd9000 for MGS 00000100:00100000:0.0:1783144290.338375:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338383:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338390:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338396:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338402:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338408:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338414:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338421:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338433:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338441:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338476:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338484:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338492:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338499:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338510:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338521:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338530:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338541:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338548:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338554:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338559:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338564:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338569:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338606:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338613:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338619:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338626:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338633:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338645:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338673:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338682:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338688:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338696:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338702:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338709:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783144290.338763:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144290.338813:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338818:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338823:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338828:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338833:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338839:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338844:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338850:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338855:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338860:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338866:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338871:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338878:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338884:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338889:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338894:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338900:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338904:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338908:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338913:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338918:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338923:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338929:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338934:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338939:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338943:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338949:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338954:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144290.338959:0:88231:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1783144290.340262:0:88231:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2aee3daa80 - data ffff9c2afa4b5288/ffff9c29c6f8a800 00000020:01000000:0.0:1783144290.340461:0:88231:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2aee3dae40 - data ffff9c2afa440e58/ffff9c29c374f400 00000020:00000080:0.0:1783144290.341027:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230474cd 00000020:00000080:0.0:1783144290.341034:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefdda800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783144290.341041:0:88231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aee192000 from MGS, refs=2 00000020:01000004:0.0:1783144290.341050:0:88231:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aee192000 2 00000020:01000004:0.0:1783144290.341052:0:88231:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2aee192000 from MGS 00000020:00000080:0.0:1783144290.341069:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144290.341074:0:88231:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783144290.341076:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefddf800/MGS 00000020:00000080:0.0:1783144290.341078:0:88231:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefddf800/MGS for MGS 00000020:01000000:0.0:1783144290.341083:0:88231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783144290.341136:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783144290.341139:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144290.341147:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783144290.341151:0:88231:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c29c5a40000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144290.341156:0:88231:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c29c3f10000) has exports, disconnecting them 00000020:00080000:0.0:1783144290.341160:0:88231:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c29c5a40000), last request at 1783144272 00000020:00000080:0.0:1783144290.341163:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230475e5 00000020:00080000:0.0:1783144290.341171:0:88231:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c5a40000): rc 0 00000020:00000080:0.0:1783144290.341174:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c29c5a40000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783144290.341397:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefdda800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144290.341405:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5a40000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783144290.342863:0:88231:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783144290.342869:0:88231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144290.342873:0:88231:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783144290.342879:0:88231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144290.343018:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144290.343025:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783144290.343030:0:88231:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aee192000 1 00000020:00000080:1.0:1783144290.343040:0:88231:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230474bf 00000020:00000080:1.0:1783144290.343045:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aefddf000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783144290.343049:0:88231:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783144290.343052:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144290.343055:0:88231:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783144290.343058:0:88231:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c2ad08db380) has no exports 00000020:00000080:3.0:1783144290.343607:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac7528000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783144290.343616:0:52153:0:(genops.c:906:class_export_put()) final put ffff9c2aefa78800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783144290.343620:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa78800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783144290.343635:0:52153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783144290.343772:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefddf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144290.373702:0:88231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144290.373714:0:88231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783144290.373719:0:88231:0:(genops.c:906:class_export_put()) final put ffff9c2aee193800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144290.373893:0:88231:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee193800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783144290.373902:0:88231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783144290.374010:0:88231:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9c2aee191000 00000020:02000400:1.0:1783144290.374065:0:88231:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783144291.277887:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144292.301853:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144292.877975:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501285248:0@lo:400:kworker.0 00000100:00100000:2.0:1783144292.877979:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501284864:0@lo:400:kworker.0 00000100:00100000:1.0:1783144292.878046:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501284992:0@lo:400:kworker.0 00000100:00100000:0.0:1783144292.878123:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501285120:0@lo:400:kworker.0 00000400:00000100:2.0:1783144292.879137:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501284864 offset 0 length 224: 4 00000100:00100000:3.0:1783144292.879157:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144292.879173:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501285376:0@lo:400:kworker.0 00000100:00100000:3.0:1783144292.879176:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501285760:0@lo:400:kworker.0 00000100:00100000:2.0:1783144292.879193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144292.879211:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501285888:0@lo:400:kworker.0 00000100:00100000:3.0:1783144292.879214:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144292.879230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144292.879245:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144292.879250:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501285248 00000100:00100000:2.0:1783144292.879251:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501286016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144292.879256:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501285248 00000100:00100000:2.0:1783144292.879272:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144292.879287:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501285376 00000100:00100000:3.0:1783144292.879290:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501285376 00000100:00100000:2.0:1783144292.879294:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501285888 00000100:00100000:2.0:1783144292.879297:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501285888 00000100:00100000:2.0:1783144292.879317:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1783144292.879322:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1783144292.879327:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759501285248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144292.879327:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501285376:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783144292.879334:0:66143:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783144292.879382:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759501285248:12345-0@lo:400:kworker.0 Request processed in 53us (224us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144292.879382:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501285376:12345-0@lo:400:kworker.0 Request processed in 57us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144292.879389:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1783144292.879789:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1783144292.879806:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1783144292.879811:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1869759501285888:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144292.879816:0:66114:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783144292.879841:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1869759501285888:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144292.879846:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1783144292.879868:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286016 00000100:00100000:2.0:1783144292.879871:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286016 00000100:00100000:2.0:1783144292.879891:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:2.0:1783144292.880078:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1869759501286016:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783144292.880089:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783144292.880115:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1869759501286016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 39us (842us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144292.880121:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00080000:3.0:1783144292.880125:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144292.880149:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:02020000:2.0:1783144292.880149:0:3648:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783144292.880152:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783144292.880154:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1783144292.880155:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783144292.880158:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:02000400:2.0:1783144292.880158:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144292.880163:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144292.880163:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144292.880167:0:3651:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2811 00000100:00080000:2.0:1783144292.880167:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2811 00000100:00080000:3.0:1783144292.880172:0:3651:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00080000:2.0:1783144292.880172:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144292.880193:0:3651:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af5d05c00 x1869759501286272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144292.880193:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60b7800 x1869759501286144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144292.880216:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501285376:0@lo:400:kworker.0 00000100:00080000:2.0:1783144292.880225:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783144292.880228:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783144292.880231:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783144292.880234:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144292.880236:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2811 00000100:00080000:2.0:1783144292.880240:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144292.880253:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aef761c00 x1869759501286400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144292.880264:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501285888:0@lo:400:kworker.0 00000100:00100000:3.0:1783144292.880272:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501285248:0@lo:400:kworker.0 00000100:00100000:2.0:1783144292.880306:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501286272:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783144292.880333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144292.880399:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501285760 00000100:00100000:1.0:1783144292.880404:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501285760 00000100:00100000:1.0:1783144292.880437:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:1.0:1783144292.880445:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501285760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144292.880482:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501285760:12345-0@lo:400:kworker.0 Request processed in 39us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144292.880488:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00080000:3.0:1783144292.880552:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144292.880571:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501285760:0@lo:400:kworker.0 00000100:00100000:2.0:1783144292.884087:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501286144:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783144292.884152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144292.884172:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501286400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783144292.884180:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286144 00000100:00100000:1.0:1783144292.884187:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286144 00000100:00100000:2.0:1783144292.884197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144292.884294:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1783144292.884359:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501286144:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783144292.884380:0:78024:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144292.884421:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501286144:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 118us (268us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144292.884429:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00080000:2.0:1783144292.885838:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144292.885846:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144292.885850:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501286144:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783144292.885948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144292.886709:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286272 00000100:00100000:3.0:1783144292.886717:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286272 00000100:00100000:3.0:1783144292.886770:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286400 00000100:00100000:3.0:1783144292.886783:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286400 00000100:00100000:2.0:1783144292.886814:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1783144292.886822:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501286272:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1783144292.886840:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144292.886895:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501286272:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 71us (6559us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144292.890382:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1869759501285504:0@lo:400:kworker.0 00000100:00100000:1.0:1783144292.890430:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501284992 00000100:00100000:1.0:1783144292.890437:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501284992 00000100:00100000:3.0:1783144292.890501:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1783144292.890510:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501286400:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783144292.890533:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144292.890588:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501286400:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 77us (6388us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144292.890595:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00080000:3.0:1783144292.890661:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144292.890667:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144292.890670:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501286272:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1783144292.890681:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144292.890684:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144292.890687:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501286400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783144292.890711:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144292.890748:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501285632:0@lo:400:kworker.0 00000100:00100000:3.0:1783144292.890782:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144292.890809:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501285120 00000100:00100000:3.0:1783144292.890812:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501285120 00000100:00100000:3.0:1783144292.890844:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1783144292.890850:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501285120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144292.890890:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501285120:12345-0@lo:400:kworker.0 Request processed in 39us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144292.890896:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00080000:3.0:1783144292.890911:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144292.890933:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501285120:0@lo:400:kworker.0 00000100:00100000:3.0:1783144292.891048:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501285632 00000100:00100000:3.0:1783144292.891052:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501285632 00000100:00100000:3.0:1783144292.891090:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:3.0:1783144292.891097:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501285632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144292.891132:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501285632:12345-0@lo:400:kworker.0 Request processed in 35us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144292.891138:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00080000:3.0:1783144292.891152:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144292.891168:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501285632:0@lo:400:kworker.0 00000100:00100000:2.0:1783144292.891494:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1783144292.894404:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1783144292.894414:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869759501284992:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783144292.894422:0:66947:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144292.894493:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1869759501284992:12345-0@lo:400:kworker.0 Request processed in 80us (8545us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144292.894500:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:0.0:1783144292.894586:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783144292.894592:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783144292.894596:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783144292.894601:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144292.894605:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2811 00000100:00080000:0.0:1783144292.894612:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144292.894638:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee571880 x1869759501286528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144292.894669:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501284992:0@lo:400:kworker.0 00000100:00100000:2.0:1783144292.895246:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501286528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783144292.895285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144292.899599:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286528 00000100:00100000:3.0:1783144292.899612:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286528 00000100:00100000:3.0:1783144292.899670:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:3.0:1783144292.899678:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501286528:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783144292.899700:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144292.899780:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501286528:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 102us (4494us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144292.899788:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00080000:2.0:1783144292.900359:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144292.900366:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144292.900370:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501286528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783144292.963078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144292.963162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000400:00000100:2.0:1783144292.963189:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481661312 offset 0 length 224: 4 00000100:00100000:2.0:1783144292.963235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144292.963278:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481661696 00000100:00100000:3.0:1783144292.963287:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481661696 00000100:00100000:3.0:1783144292.963365:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1989 00000100:00100000:3.0:1783144292.963375:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481661696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144292.963443:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481661696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144292.963451:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1989 00000100:00080000:1.0:1783144292.963606:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144292.964568:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144292.964677:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481661824 00000100:00100000:3.0:1783144292.964681:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481661824 00000100:00100000:3.0:1783144292.964745:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1990 00000100:00100000:3.0:1783144292.964752:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481661824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144292.964795:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481661824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144292.964803:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1990 00000100:00080000:2.0:1783144292.965066:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144292.966295:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481661440 00000100:00100000:0.0:1783144292.966302:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481661440 00000100:00100000:0.0:1783144292.966340:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481661568 00000100:00100000:0.0:1783144292.966343:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481661568 00000100:00100000:0.0:1783144292.966393:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 765 00000100:00100000:0.0:1783144292.966401:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481661568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144292.966449:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481661568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (3212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144292.966456:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 765 00000100:00100000:0.0:1783144292.966543:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1081 00000100:00100000:0.0:1783144292.966549:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1869759481661440:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:0.0:1783144292.966555:0:66113:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:0.0:1783144292.966582:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1869759481661440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (3514us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144292.966588:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1081 00000100:00080000:2.0:1783144292.966949:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144292.968718:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144292.968827:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481661952 00000100:00100000:2.0:1783144292.968833:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481661952 00000100:00100000:2.0:1783144292.968865:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1082 00000100:00100000:2.0:1783144292.968883:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481661952:12345-192.168.203.4@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1783144292.968905:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144292.968958:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481661952:12345-192.168.203.4@tcp:38:ptlrpcd_01_01.0 Request processed in 73us (244us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144292.968966:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1082 00010000:00010000:1.0:1783144293.327420:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144294.349909:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144294.929986:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501286656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144294.930052:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144294.930222:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286656 00000100:00100000:2.0:1783144294.930231:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286656 00000100:00100000:2.0:1783144294.930301:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1783144294.930311:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501286656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144294.930350:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783144294.930427:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144294.930444:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501286784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144294.930470:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144294.930501:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286784 00000100:00100000:0.0:1783144294.930505:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286784 00000100:00100000:0.0:1783144294.930533:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:0.0:1783144294.930540:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501286784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144294.930555:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144294.930584:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501286784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144294.930590:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00080000:0.0:1783144294.930626:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144294.930654:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501286784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144294.936869:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501286656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144294.936869:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501286656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6555us (6811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144294.936887:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00010000:00010000:0.0:1783144295.375991:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783144295.441373:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144295.441381:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2ac9c73800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144295.441591:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9c73800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783144295.441640:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9c71800 for lustre-OST0000 00000001:00100000:2.0:1783144295.444651:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783144295.444665:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378733 is committed 00000020:00000080:2.0:1783144295.444671:0:75517:0:(genops.c:906:class_export_put()) final put ffff9c29c3efd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144295.445285:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c3efd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783144295.445357:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac317c000 for lustre-MDT0001 00000001:00100000:1.0:1783144295.445963:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144295.445968:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2ac9c70000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783144295.446037:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9c70000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783144295.446077:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9c76000 for lustre-OST0001 00010000:00010000:0.0:1783144296.397923:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144297.422026:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144297.997876:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1783144297.998738:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144297.998743:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144297.998747:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144297.998754:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2827 00000100:00080000:3.0:1783144297.998759:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144297.998765:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144297.998787:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4ea4e00 x1869759501287040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144297.998841:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501287040:0@lo:38:kworker.0 00000100:00100000:2.0:1783144297.998923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144297.998973:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287040 00000100:00100000:1.0:1783144297.998980:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287040 00000100:00100000:1.0:1783144297.999024:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1783144297.999030:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501287040:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783144297.999046:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144297.999086:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501287040:12345-0@lo:38:kworker.0 Request processed in 55us (163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144297.999091:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00080000:2.0:1783144297.999105:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144297.999112:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144297.999116:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501287040:0@lo:38:kworker.0 00000100:00100000:2.0:1783144297.999212:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144297.999218:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501286912:0@lo:400:kworker.0 00000100:00080000:3.0:1783144297.999228:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144297.999231:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144297.999233:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144297.999236:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2827 00000100:00080000:3.0:1783144297.999238:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000400:00000100:0.0:1783144297.999243:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501286912 offset 0 length 224: 4 00000100:00080000:3.0:1783144297.999248:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144297.999260:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ceadad80 x1869759501287296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144297.999285:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501287296:0@lo:38:kworker.0 00000100:00080000:3.0:1783144297.999287:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144297.999290:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144297.999292:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144297.999295:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2827 00000100:00080000:3.0:1783144297.999297:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144297.999300:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144297.999308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144297.999311:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c50e6300 x1869759501287552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144297.999337:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501287552:0@lo:38:kworker.0 00000100:00100000:2.0:1783144297.999363:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501287808:0@lo:400:kworker.0 00000100:00100000:1.0:1783144297.999378:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501287424:0@lo:400:kworker.0 00000100:00100000:2.0:1783144297.999390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144297.999401:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144297.999407:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501287168:0@lo:400:kworker.0 00000100:00100000:1.0:1783144297.999425:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783144297.999426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144297.999430:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501287680:0@lo:400:kworker.0 00000100:00100000:2.0:1783144297.999451:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287808 00000100:00100000:1.0:1783144297.999451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144297.999454:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287808 00000100:00100000:1.0:1783144297.999488:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287296 00000100:00100000:2.0:1783144297.999490:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287680 00000100:00100000:2.0:1783144297.999492:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287680 00000100:00100000:1.0:1783144297.999492:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287296 00000100:00100000:1.0:1783144297.999508:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287424 00000100:00100000:2.0:1783144297.999511:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1783144297.999511:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287424 00000100:00100000:2.0:1783144297.999516:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501287808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144297.999527:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287168 00000100:00100000:1.0:1783144297.999529:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287168 00000100:00100000:1.0:1783144297.999547:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1783144297.999553:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501287424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144297.999554:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501287808:12345-0@lo:400:kworker.0 Request processed in 38us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144297.999560:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1783144297.999585:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501287424:12345-0@lo:400:kworker.0 Request processed in 32us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144297.999591:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1783144297.999601:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1783144297.999606:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501287168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144297.999627:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501287168:12345-0@lo:400:kworker.0 Request processed in 22us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144297.999632:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1783144297.999641:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1783144297.999645:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501287296:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783144297.999654:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144297.999672:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501287296:12345-0@lo:38:kworker.0 Request processed in 26us (363us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144297.999678:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1783144297.999694:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1783144297.999700:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501287680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144297.999752:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501287680:12345-0@lo:400:kworker.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144297.999758:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00080000:2.0:1783144297.999761:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144297.999766:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144297.999767:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144297.999783:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501287808:0@lo:400:kworker.0 00000100:00100000:1.0:1783144297.999783:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501287680:0@lo:400:kworker.0 00000100:00100000:2.0:1783144297.999792:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501287168:0@lo:400:kworker.0 00000100:00100000:1.0:1783144297.999792:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501287424:0@lo:400:kworker.0 00000100:00080000:3.0:1783144297.999916:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144297.999920:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144297.999922:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144297.999926:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2827 00000100:00080000:3.0:1783144297.999929:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783144297.999932:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144297.999946:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c50e4700 x1869759501287936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144298.000280:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783144298.000323:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144298.000327:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144298.000331:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501287296:0@lo:38:kworker.0 00000100:00100000:0.0:1783144298.000349:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501287936:0@lo:38:kworker.0 00000100:00100000:2.0:1783144298.000366:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287552 00000100:00100000:2.0:1783144298.000372:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287552 00000100:00100000:0.0:1783144298.000376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144298.000436:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:2.0:1783144298.000447:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501287552:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783144298.000457:0:8447:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144298.000493:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501287552:12345-0@lo:38:kworker.0 Request processed in 45us (213us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144298.000499:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00080000:0.0:1783144298.000549:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144298.000553:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144298.000556:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501287552:0@lo:38:kworker.0 00000100:00100000:1.0:1783144298.001357:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501287936 00000100:00100000:1.0:1783144298.001362:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501287936 00000100:00100000:1.0:1783144298.001386:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1783144298.001390:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501287936:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783144298.001399:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144298.001469:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501287936:12345-0@lo:38:kworker.0 Request processed in 77us (1093us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144298.001475:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00080000:0.0:1783144298.001546:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144298.001552:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144298.001554:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501287936:0@lo:38:kworker.0 00000400:00000100:2.0:1783144298.084540:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481662336 offset 0 length 224: 4 00000100:00100000:2.0:1783144298.084580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144298.084612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144298.084638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144298.084671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144298.084762:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481662720 00000100:00100000:1.0:1783144298.084771:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481662720 00000100:00100000:1.0:1783144298.084822:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1993 00000100:00100000:1.0:1783144298.084833:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481662720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144298.084894:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481662720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144298.084901:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1993 00000100:00100000:1.0:1783144298.084916:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481662848 00000100:00100000:1.0:1783144298.084918:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481662848 00000100:00100000:1.0:1783144298.084937:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1994 00000100:00100000:1.0:1783144298.084942:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481662848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144298.084965:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+5:2404:x1869759481662848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144298.084983:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1994 00000100:00080000:2.0:1783144298.085041:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144298.085045:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144298.085173:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481662464 00000100:00100000:3.0:1783144298.085177:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481662464 00000100:00100000:3.0:1783144298.085201:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481662592 00000100:00100000:3.0:1783144298.085204:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481662592 00000100:00100000:3.0:1783144298.085236:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 768 00000100:00100000:3.0:1783144298.085244:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481662592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144298.085332:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481662592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144298.085339:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 768 00000100:00100000:3.0:1783144298.085351:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1086 00000100:00100000:3.0:1783144298.085361:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481662464:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:3.0:1783144298.085378:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144298.085399:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481662464:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 36us (819us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144298.085405:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1086 00000100:00080000:1.0:1783144298.085504:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783144298.445988:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144299.469916:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144300.046072:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501288064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144300.046150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144300.046982:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501288064 00000100:00100000:2.0:1783144300.046991:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501288064 00000100:00100000:2.0:1783144300.047080:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1783144300.047091:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501288064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144300.047123:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144300.047189:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501288064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144300.047197:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1783144300.047247:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501288064:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783144300.047503:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144300.047714:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144300.047740:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501288192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144300.047768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144300.047819:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501288192 00000100:00100000:1.0:1783144300.047823:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501288192 00000100:00100000:1.0:1783144300.047856:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1581 00000100:00100000:1.0:1783144300.047863:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501288192:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783144300.047866:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1783144300.047877:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144300.047907:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501288192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144300.047911:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1581 00000100:00100000:3.0:1783144300.047944:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501288192:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783144300.493899:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144301.519085:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144302.541806:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144303.121479:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144303.121486:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144303.121490:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144303.121498:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2832 00000100:00080000:1.0:1783144303.121503:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144303.121509:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144303.121530:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee582a00 x1869759501288448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144303.121556:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144303.121560:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144303.121562:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144303.121565:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2832 00000100:00080000:1.0:1783144303.121576:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144303.121580:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144303.121591:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee583800 x1869759501288704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144303.121606:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144303.121609:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144303.121611:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144303.121614:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2832 00000100:00080000:1.0:1783144303.121616:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144303.121620:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144303.121631:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee582680 x1869759501288960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144303.121649:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144303.121652:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144303.121653:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144303.121656:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2832 00000100:00080000:1.0:1783144303.121658:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144303.121661:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144303.121670:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee581180 x1869759501289344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144303.121695:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501288320:0@lo:400:kworker.0 00000400:00000100:1.0:1783144303.121759:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501288320 offset 0 length 224: 4 00000100:00100000:1.0:1783144303.121798:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501289216:0@lo:400:kworker.0 00000100:00100000:1.0:1783144303.121833:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.121865:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144303.121871:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501289088:0@lo:400:kworker.0 00000100:00100000:1.0:1783144303.121896:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.121924:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501288448:0@lo:38:kworker.0 00000100:00100000:1.0:1783144303.121950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.121965:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501288704:0@lo:38:kworker.0 00000100:00100000:1.0:1783144303.121983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.121998:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501288960:0@lo:38:kworker.0 00000100:00100000:1.0:1783144303.122019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.122035:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501289344:0@lo:38:kworker.0 00000100:00100000:1.0:1783144303.122052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.122077:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501288832:0@lo:400:kworker.0 00000100:00100000:1.0:1783144303.122098:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.122113:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144303.122118:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501288576:0@lo:400:kworker.0 00000100:00100000:1.0:1783144303.122136:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144303.122161:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289216 00000100:00100000:1.0:1783144303.122167:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289216 00000100:00100000:1.0:1783144303.122213:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289088 00000100:00100000:1.0:1783144303.122216:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289088 00000100:00100000:1.0:1783144303.122238:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1783144303.122246:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501289216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144303.122306:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501289216:12345-0@lo:400:kworker.0 Request processed in 60us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144303.122400:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501288448 00000100:00100000:0.0:1783144303.122405:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501288448 00000100:00100000:0.0:1783144303.122434:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501288704 00000100:00100000:0.0:1783144303.122436:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501288704 00000100:00100000:0.0:1783144303.122444:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289344 00000100:00100000:0.0:1783144303.122446:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289344 00000100:00100000:0.0:1783144303.122451:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501288832 00000100:00100000:0.0:1783144303.122454:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501288832 00000100:00100000:0.0:1783144303.122469:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501288576 00000100:00100000:0.0:1783144303.122471:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501288576 00000100:00100000:0.0:1783144303.122485:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1783144303.122490:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501288832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144303.122532:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501288832:12345-0@lo:400:kworker.0 Request processed in 42us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144303.122539:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1783144303.122554:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1783144303.122560:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501288576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144303.122585:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501288576:12345-0@lo:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144303.122591:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1783144303.122603:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1783144303.122607:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501288448:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144303.122623:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144303.122666:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501288448:12345-0@lo:38:kworker.0 Request processed in 57us (714us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144303.122672:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1783144303.122684:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1783144303.122687:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501288704:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144303.122696:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144303.122716:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501288704:12345-0@lo:38:kworker.0 Request processed in 28us (732us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144303.122747:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1783144303.122757:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1783144303.122760:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501289344:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144303.122768:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144303.122796:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501289344:12345-0@lo:38:kworker.0 Request processed in 34us (743us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144303.122802:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1783144303.122824:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501288960 00000100:00100000:0.0:1783144303.122827:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501288960 00000100:00100000:0.0:1783144303.122861:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1783144303.122865:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aefa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501288960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144303.122875:0:23926:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144303.122905:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aefa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501288960:12345-0@lo:38:kworker.0 Request processed in 37us (883us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144303.122910:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1783144303.122934:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:0.0:1783144303.122941:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501289088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144303.122977:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501289088:12345-0@lo:400:kworker.0 Request processed in 36us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144303.122983:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00080000:0.0:1783144303.123025:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783144303.123030:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144303.123031:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144303.123065:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501288576:0@lo:400:kworker.0 00000100:00100000:0.0:1783144303.123074:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501288832:0@lo:400:kworker.0 00000100:00100000:0.0:1783144303.123100:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501289088:0@lo:400:kworker.0 00000100:00100000:0.0:1783144303.123108:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501289216:0@lo:400:kworker.0 00000100:00080000:0.0:1783144303.123132:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144303.123136:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144303.123139:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501288448:0@lo:38:kworker.0 00000100:00080000:0.0:1783144303.123146:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144303.123149:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144303.123151:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501288704:0@lo:38:kworker.0 00000100:00080000:0.0:1783144303.123158:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144303.123161:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144303.123163:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501288960:0@lo:38:kworker.0 00000100:00080000:0.0:1783144303.123169:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144303.123172:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144303.123175:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501289344:0@lo:38:kworker.0 00000100:00100000:1.0:1783144303.123265:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000400:00000100:2.0:1783144303.202873:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481662976 offset 0 length 224: 4 00000100:00100000:2.0:1783144303.202921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144303.202945:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144303.202977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144303.203016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144303.203115:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481663104 00000100:00100000:3.0:1783144303.203124:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481663104 00000100:00100000:1.0:1783144303.203142:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481663360 00000100:00100000:1.0:1783144303.203155:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481663360 00000100:00100000:3.0:1783144303.203207:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481663232 00000100:00100000:1.0:1783144303.203209:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481663488 00000100:00100000:3.0:1783144303.203211:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481663232 00000100:00100000:1.0:1783144303.203215:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481663488 00000100:00100000:1.0:1783144303.203246:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1997 00000100:00100000:1.0:1783144303.203256:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481663360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144303.203337:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481663360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144303.203345:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1997 00000100:00100000:1.0:1783144303.203374:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1998 00000100:00100000:1.0:1783144303.203382:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481663488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144303.203406:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+5:2406:x1869759481663488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144303.203413:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1998 00000100:00080000:1.0:1783144303.203429:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144303.203433:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144303.203436:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144303.203576:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 771 00000100:00100000:2.0:1783144303.203587:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481663232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144303.203654:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2406:x1869759481663232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144303.203662:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 771 00000100:00100000:1.0:1783144303.203683:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1090 00000100:00100000:1.0:1783144303.203688:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481663104:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:1.0:1783144303.203708:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144303.203755:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481663104:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 65us (834us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144303.203762:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1090 00010000:00010000:0.0:1783144303.566830:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144304.592463:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144305.165975:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501289472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144305.166045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144305.166130:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289472 00000100:00100000:3.0:1783144305.166138:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289472 00000100:00100000:3.0:1783144305.166226:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1783144305.166236:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501289472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144305.166273:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144305.166318:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501289472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144305.166325:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1783144305.166380:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501289472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144305.166572:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144305.166580:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501289600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144305.166604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144305.166627:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289600 00000100:00100000:3.0:1783144305.166631:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289600 00000100:00080000:0.0:1783144305.168313:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144305.168318:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144305.170383:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:3.0:1783144305.170397:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501289600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144305.170427:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144305.170498:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501289600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (3892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144305.170505:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:3.0:1783144305.170554:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501289600:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783144305.615789:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144306.637892:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783144307.312669:0:88849:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783144307.312676:0:88849:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783144307.312677:0:88849:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783144307.312805:0:88849:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c2af728f800 00000020:01000004:0.0:1783144307.312819:0:88849:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783144307.312837:0:88849:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783144307.312853:0:88849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c29c3f119c0) 00000020:00000080:0.0:1783144307.312871:0:88849:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783144307.392884:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.393988:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783144307.396206:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783144307.398764:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.399804:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.400057:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.400304:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.400501:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.400932:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.401122:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.401368:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.401577:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.402045:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.402268:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.402475:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.402759:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.403007:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.403214:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.403373:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.403556:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.403826:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.404073:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.404260:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.404432:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.404677:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.404914:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.405099:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.405297:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.405505:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.405937:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.406149:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.406373:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783144307.406523:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.406800:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.407054:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783144307.407538:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783144307.407990:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783144307.408202:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783144307.408448:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783144307.408683:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.409188:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.409453:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783144307.409830:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.410032:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.410281:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783144307.410653:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.410840:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783144307.412690:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.413158:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.413326:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.413984:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.414194:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783144307.414410:0:88849:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1783144307.414967:0:88849:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783144307.415161:0:88849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783144307.415169:0:88849:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783144307.415178:0:88849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047a68 00000020:01000004:2.0:1783144307.415184:0:88849:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783144307.415195:0:88849:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783144307.415200:0:88849:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2af728f800 from MGS 00000020:01000004:2.0:1783144307.415203:0:88849:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783144307.415212:0:88849:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c2af9c799c0) 00000020:00000080:2.0:1783144307.415224:0:88849:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783144307.415297:0:88849:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2af728f800 from MGS, refs=2 00080000:01000000:2.0:1783144307.415302:0:88849:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783144307.415308:0:88849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047a76 00010000:00010000:2.0:1783144307.415449:0:88849:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1783144307.419293:0:88849:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783144307.422041:0:88853:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783144307.423650:0:88849:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783144307.423699:0:88849:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783144307.425571:0:88849:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783144307.425857:0:88849:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783144307.426095:0:88849:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783144307.426099:0:88849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783144307.426887:0:88849:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783144307.426895:0:88849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783144307.427683:0:88849:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783144307.427690:0:88849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783144307.428632:0:88849:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783144307.428653:0:88849:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1783144307.428654:0:88849:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1783144307.428657:0:88849:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1783144307.428662:0:88849:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783144307.428666:0:88849:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783144307.428672:0:88849:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783144307.428673:0:88849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783144307.428680:0:88849:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c29c3dff800 x1869759501284864/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144308 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144307.428698:0:88849:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2ae4b3a680 x1869759501286912/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144313 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144307.428789:0:88849:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2af9f1d180 x1869759501288320/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144319 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783144307.428816:0:88849:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783144307.428819:0:88849:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783144307.428820:0:88849:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783144307.428823:0:88849:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1783144307.428877:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501288320:0@lo:400:kworker.0 00000100:00100000:0.0:1783144307.428959:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501284864:0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.429111:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501286912:0@lo:400:kworker.0 10000000:01000000:3.0:1783144307.429166:0:88849:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1783144307.429185:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230476a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429195:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230476a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429202:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1783144307.429242:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429259:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516600/0xad8e53a42304769b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230476a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429278:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429285:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429291:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429309:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429314:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423047601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047608 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429324:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429331:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429336:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429340:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429343:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304761d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429351:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304764e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429357:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304764e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429363:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429366:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429369:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a423047647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304764e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429378:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304765c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429384:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304765c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429399:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429413:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429418:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c200/0xad8e53a423047655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304765c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429429:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047678 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429434:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047678 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429439:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429442:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429445:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517000/0xad8e53a423047671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047678 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429453:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429458:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429462:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429465:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429468:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8000/0xad8e53a42304767f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047686 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429476:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230476b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429504:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230476b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429509:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429512:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429516:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043f600/0xad8e53a4230476a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230476b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429528:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047616 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429534:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047616 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429539:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429542:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429545:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043f200/0xad8e53a42304760f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047616 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429556:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047632 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429562:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047632 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429566:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144307.429569:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429573:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8a00/0xad8e53a42304762b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047632 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429595:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047640 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429602:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047640 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429607:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144307.429615:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429619:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043ea00/0xad8e53a423047639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047640 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429628:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304766a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429634:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304766a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429639:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144307.429651:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429655:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043e800/0xad8e53a423047663 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304766a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.429664:0:88849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047694 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144307.429670:0:88849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047694 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.429675:0:88849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144307.429685:0:88849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144307.429689:0:88849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043e000/0xad8e53a42304768d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047694 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783144307.429703:0:88849:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2ac6d92000 already not connected (conn 52, was 0): DISCONN 00000100:00080000:3.0:1783144307.429709:0:88849:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144307.429714:0:88849:0:(import.c:512:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 2806 00000100:00080000:3.0:1783144307.429737:0:88849:0:(import.c:626:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c2ac6d92000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144307.429763:0:88849:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c50e6300 x1869759501289728/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144307.429785:0:88849:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1783144307.429819:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501289728:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783144307.429876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.429944:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289728 00000100:00100000:1.0:1783144307.429952:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289728 00000100:00100000:1.0:1783144307.429985:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783144307.429993:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1869759501289728:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1783144307.430026:0:88855:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo t0 exp 0000000000000000 cur 2841 last 0 00000020:00000080:1.0:1783144307.430050:0:88855:0:(genops.c:1406:class_connect()) connect: client 4e9e4714-8000-4c64-bed6-3cadd5fdfc80, cookie 0xad8e53a423047a7d 00000100:00080000:1.0:1783144307.430165:0:88855:0:(import.c:65:import_set_state_nolock()) ffff9c29c5777800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144307.430223:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3647:x1869759501289728:12345-0@lo:250:mount.lustre.0 Request processed in 229us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.430231:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783144307.430314:0:3647:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 25 00000100:00080000:0.0:1783144307.430319:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1783144307.430324:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783144307.430326:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783144307.430328:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783144307.430330:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783144307.430384:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783144307.430401:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501289728:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1783144307.430417:0:35504:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.104@tcp 10000000:01000000:1.0:1783144307.430436:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783144307.430439:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144307.430441:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144307.430442:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144307.430443:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144307.430445:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144307.430446:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144307.430447:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00080000:3.0:1783144307.430448:0:88849:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1783144307.430449:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144307.430450:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:3.0:1783144307.430457:0:88849:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783144307.430483:0:88849:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783144307.430485:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783144307.430487:0:88849:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 10000000:01000000:1.0:1783144307.430491:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783144307.430493:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144307.430494:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783144307.430495:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144307.430496:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144307.430497:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144307.430498:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144307.430499:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144307.430501:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144307.430502:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783144307.430514:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783144307.430529:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783144307.430536:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144307.430537:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783144307.430539:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144307.430540:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144307.430541:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144307.430542:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144307.430543:0:35504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144307.430545:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144307.430545:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144307.430561:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501289984:0@lo:253:kworker.0 00000020:01000000:1.0:1783144307.430570:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1783144307.430592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.430593:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501290112:0@lo:253:kworker.0 00000100:00100000:0.0:1783144307.430609:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144307.430614:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501289856:0@lo:253:kworker.0 00000100:00100000:1.0:1783144307.430618:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144307.430635:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.430645:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289984 00000100:00100000:1.0:1783144307.430648:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289984 00000100:00100000:0.0:1783144307.430656:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501290112 00000100:00100000:0.0:1783144307.430659:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501290112 00000100:00100000:1.0:1783144307.430667:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501289856 00000100:00100000:1.0:1783144307.430669:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501289856 00000100:00100000:0.0:1783144307.430672:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783144307.430677:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3651:x1869759501289984:12345-0@lo:253:kworker.0 00000100:00100000:1.0:1783144307.430678:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783144307.430682:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3648:x1869759501290112:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783144307.430699:0:88855:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783144307.430699:0:88857:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000040:01000000:3.0:1783144307.430914:0:88849:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783144307.430936:0:88849:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783144307.430939:0:88849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783144307.430940:0:88849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783144307.430941:0:88849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144307.430943:0:88849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144307.430943:0:88849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144307.430945:0:88849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144307.430946:0:88849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144307.430947:0:88849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783144307.430948:0:88849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144307.430949:0:88849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783144307.430952:0:88849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783144307.430954:0:88849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783144307.430955:0:88849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783144307.430956:0:88849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144307.430957:0:88849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144307.430958:0:88849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144307.430964:0:88849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144307.430965:0:88849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144307.430966:0:88849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783144307.430967:0:88849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144307.430968:0:88849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783144307.430979:0:88849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783144307.430988:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290240:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783144307.431018:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.431046:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad48e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.431122:0:88856:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783144307.431129:0:88856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 10000000:01000000:0.0:1783144307.431173:0:88858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783144307.431272:0:88857:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 108 00000100:00100000:3.0:1783144307.431376:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501290240 00000100:00100000:3.0:1783144307.431379:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501290240 00000100:00100000:2.0:1783144307.431464:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783144307.431471:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3651:x1869759501289856:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783144307.431486:0:88859:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783144307.432590:0:88860:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783144307.432595:0:88860:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783144307.432598:0:88860:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783144307.432601:0:88860:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783144307.432987:0:88860:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1783144307.433118:0:88857:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783144307.433143:0:88857:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783144307.435147:0:88857:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783144307.435162:0:88857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783144307.435173:0:88855:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783144307.435275:0:88858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783144307.435280:0:88858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783144307.435302:0:88858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435318:0:88858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144307.435338:0:88858:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000058640s 00010000:00010000:0.0:1783144307.435353:0:88858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435360:0:88858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435366:0:88858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435372:0:88858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435377:0:88858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144307.435381:0:88858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435388:0:88858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435400:0:88858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435406:0:88858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.435412:0:88858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423047a84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144307.435793:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3651:x1869759501289984:12345-0@lo:253:kworker.0 Request processed in 5111us (5197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.435803:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:0.0:1783144307.435822:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783144307.435829:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783144307.435830:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144307.435831:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144307.435833:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144307.435834:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144307.435836:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783144307.435837:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:1.0:1783144307.435838:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1783144307.435839:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144307.435842:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501289984:0@lo:253:kworker.0 00000100:00100000:1.0:1783144307.435847:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:88849:x1869759501290240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144307.435881:0:88857:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783144307.435884:0:88857:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783144307.435886:0:88857:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1783144307.435897:0:88857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783144307.437994:0:88855:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783144307.438014:0:88855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783144307.438018:0:88859:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783144307.438049:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:88849:x1869759501290240:12345-0@lo:253:mount.lustre.0 Request processed in 2201us (7026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144307.438060:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:2.0:1783144307.438112:0:88858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144307.438117:0:88858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1783144307.438127:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290240:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1783144307.438138:0:88858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.438140:0:88849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783144307.438146:0:88849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783144307.438150:0:88849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783144307.438153:0:88849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144307.438154:0:88849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144307.438155:0:88849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:2.0:1783144307.438156:0:88858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783144307.438157:0:88849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144307.438160:0:88849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144307.438162:0:88849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783144307.438165:0:88849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144307.438168:0:88849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 20000000:01000000:2.0:1783144307.438181:0:88858:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000058640s 00000020:01000004:3.0:1783144307.438187:0:88849:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2af728f800 from lustre-MDT0000 00010000:00010000:2.0:1783144307.438187:0:88858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.438196:0:88858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.438203:0:88858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.438221:0:88849:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783144307.438228:0:88849:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00010000:00010000:2.0:1783144307.438234:0:88858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.438238:0:88849:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2af728f800 00010000:00010000:2.0:1783144307.438254:0:88858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01c00 already unused, calling callback (ffffffffc0c0bce0) 10000000:01000000:3.0:1783144307.438256:0:88849:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783144307.438260:0:88858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.438264:0:88849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2af728f800 10000000:01000000:3.0:1783144307.438270:0:88849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783144307.438275:0:88849:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2af728f800 from 1 00010000:00010000:2.0:1783144307.438275:0:88858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.438281:0:88849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783144307.438293:0:88858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.438302:0:88858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.438310:0:88849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.438313:0:88858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047a8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.438332:0:88849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.438342:0:88849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144307.438360:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144307.438394:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.438428:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.438449:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:3648:x1869759501290112:12345-0@lo:253:kworker.0 Request processed in 7764us (7828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.438457:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783144307.438478:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501290368 00000100:00100000:1.0:1783144307.438484:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501290368 00000100:00100000:1.0:1783144307.438518:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783144307.438525:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:88849:x1869759501290368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144307.438535:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144307.438549:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47da00/0xad8e53a423047a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047a92 expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.438565:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47da00/0xad8e53a423047a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047a92 expref: 7 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.438577:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47da00/0xad8e53a423047a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047a92 expref: 7 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.438583:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47da00, rc 0) 00000100:00100000:1.0:1783144307.438609:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:88849:x1869759501290368:12345-0@lo:101:mount.lustre.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.438615:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783144307.438679:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144307.438691:0:88849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.438700:0:88849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.438713:0:88849:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000020:01000004:0.0:1783144307.438714:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783144307.438718:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00010000:00010000:3.0:1783144307.438744:0:88849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783144307.438746:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144307.438751:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144307.438754:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:3.0:1783144307.438757:0:88849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783144307.438757:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144307.438761:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144307.438764:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144307.438767:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783144307.438769:0:88849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 00000100:00100000:0.0:1783144307.438773:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501290112:0@lo:253:kworker.0 10000000:01000000:3.0:1783144307.438774:0:88849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783144307.438781:0:88849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2af728f800 10000000:01000000:3.0:1783144307.438787:0:88849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783144307.438797:0:88849:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783144307.438799:0:88849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783144307.438814:0:88849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.438822:0:88849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.438829:0:88849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144307.438841:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144307.438866:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.438888:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.438905:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501290496 00000100:00100000:1.0:1783144307.438910:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501290496 00000100:00100000:1.0:1783144307.438937:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783144307.438943:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:88849:x1869759501290496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144307.438949:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144307.438963:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47cc00/0xad8e53a423047aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047aa0 expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.438976:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47cc00/0xad8e53a423047aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047aa0 expref: 8 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.438984:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47cc00/0xad8e53a423047aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047aa0 expref: 8 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.438990:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47cc00, rc 0) 00000100:00100000:1.0:1783144307.439028:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:88849:x1869759501290496:12345-0@lo:101:mount.lustre.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.439035:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783144307.439104:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144307.439113:0:88849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.439120:0:88849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144307.439166:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144307.439189:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144307.439212:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.439260:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501290624 00000100:00100000:2.0:1783144307.439265:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501290624 00000100:00100000:2.0:1783144307.439295:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783144307.439302:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:88849:x1869759501290624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144307.439421:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88849:x1869759501290624:12345-0@lo:501:mount.lustre.0 Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.439428:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783144307.439500:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144307.439588:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144307.439789:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144307.439822:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.439838:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501290752 00000100:00100000:2.0:1783144307.439843:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501290752 00000100:00100000:2.0:1783144307.439911:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783144307.439926:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88849:x1869759501290752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144307.440564:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88849:x1869759501290752:12345-0@lo:503:mount.lustre.0 Request processed in 639us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.440571:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783144307.440657:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501290752:0@lo:503:mount.lustre.0 20000000:01000000:1.0:1783144307.441122:0:88859:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:0.0:1783144307.441148:0:88861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88861:1869759501290880:0@lo:502:llog_process_th.0 20000000:01000000:1.0:1783144307.441151:0:88859:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783144307.441178:0:88861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:2.0:1783144307.441252:0:88858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144307.441256:0:88858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144307.441271:0:88858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441285:0:88858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144307.441293:0:88858:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000058640s 00010000:00010000:2.0:1783144307.441298:0:88858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144307.441301:0:88861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144307.441336:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501290880 00000100:00100000:3.0:1783144307.441340:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501290880 00000100:00100000:1.0:1783144307.441399:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:3651:x1869759501289856:12345-0@lo:253:kworker.0 Request processed in 9926us (10760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144307.441400:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783144307.441412:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88861:x1869759501290880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.441413:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1783144307.441459:0:88858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441467:0:88858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441475:0:88858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441482:0:88858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144307.441487:0:88858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441494:0:88858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441518:0:88858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441525:0:88858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.441532:0:88858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047aae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144307.441666:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783144307.441670:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144307.441671:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144307.441673:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144307.441674:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144307.441675:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144307.441677:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144307.441679:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144307.441681:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144307.441685:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501289856:0@lo:253:kworker.0 00000100:00100000:3.0:1783144307.441926:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:88861:x1869759501290880:12345-0@lo:502:llog_process_th.0 Request processed in 515us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144307.441933:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783144307.441993:0:88861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88861:1869759501290880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144307.442009:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144307.442019:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144307.442021:0:88861:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783144307.442027:0:88861:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783144307.442030:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144307.442042:0:88861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c29c3f14d40) 00000020:00000080:0.0:1783144307.442062:0:88861:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1783144307.442068:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783144307.442125:0:88861:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783144307.442130:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047abc 00000020:00000080:0.0:1783144307.442305:0:88861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783144307.442309:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144307.442312:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144307.442313:0:88861:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783144307.442316:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144307.442319:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144307.442320:0:88861:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783144307.442323:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144307.442329:0:88861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c29c3f13380) 00000020:00000080:0.0:1783144307.442345:0:88861:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1783144307.442349:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783144307.442351:0:88861:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783144307.442354:0:88861:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783144307.442358:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783144307.442398:0:88861:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2af728f800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783144307.442408:0:88861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c29c3f10000) 00000020:00000080:0.0:1783144307.442415:0:88861:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1783144307.442459:0:88861:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783144307.442463:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047ad1 00000020:00000080:0.0:1783144307.442643:0:88861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783144307.442651:0:88861:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783144307.442655:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad8e53a423047ad8 00080000:01000000:0.0:1783144307.442659:0:88861:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783144307.442663:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047adf 00010000:00010000:1.0:1783144307.483154:0:88861:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1783144307.483303:0:88861:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: cace81e7-a6f2-4d37-b197-caf34583781c idx: 0 lr: 98784247817 srv lr: 103079215104 lx: 0 gen 22 00000001:00080000:1.0:1783144307.483342:0:88861:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 21 00000001:00000004:1.0:1783144307.483374:0:88861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:1.0:1783144307.483477:0:88861:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1783144307.483530:0:88861:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2b0102a3c0: xid 1869759481657600, transno 103079215109, client gen 22, slot idx 0 00000001:00080000:1.0:1783144307.483541:0:88861:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2b0102a6c0: xid 1869759481657856, transno 103079215110, client gen 22, slot idx 1 00000020:00000080:1.0:1783144307.484137:0:88861:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c29c356cd40) 00000020:00000080:1.0:1783144307.484155:0:88861:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1783144307.484225:0:88861:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783144307.484231:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047afb 00000020:00000080:1.0:1783144307.484643:0:88861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783144307.492130:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad8e53a423047b02 00000020:00000080:1.0:1783144307.492800:0:88861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783144307.492810:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144307.492816:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.492818:0:88861:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783144307.492821:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783144307.492824:0:88861:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1783144307.492825:0:88861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144307.492827:0:88861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144307.492828:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783144307.492831:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.492832:0:88861:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783144307.492835:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144307.492839:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.492841:0:88861:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783144307.492844:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783144307.492887:0:88861:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783144307.492904:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144307.492907:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.492908:0:88861:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783144307.492911:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144307.492914:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.492915:0:88861:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783144307.492925:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783144307.492930:0:88861:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:1.0:1783144307.492953:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144307.492967:0:88861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c29c3568000) 00000020:00000080:1.0:1783144307.492983:0:88861:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783144307.492988:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783144307.493056:0:88861:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783144307.493060:0:88861:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783144307.493066:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047b10 00010000:00080000:1.0:1783144307.493094:0:88861:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac317f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144307.497280:0:88861:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1783144307.499475:0:88861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144307.499490:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783144307.499528:0:88861:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783144307.499556:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047b17 00000100:00080000:1.0:1783144307.499566:0:88861:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783144307.499574:0:88861:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2ac317f800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144307.499619:0:88861:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afa81aa00 x1869759501291008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144307.499647:0:88861:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783144307.499752:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144307.499759:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144307.499762:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144307.499767:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2837 00000100:00080000:2.0:1783144307.499772:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783144307.499776:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144307.499794:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b3a680 x1869759501291136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144307.499831:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144307.499836:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144307.499837:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144307.499840:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2837 00000100:00080000:2.0:1783144307.499843:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783144307.499846:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144307.499858:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4ea2a00 x1869759501291392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144307.499897:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144307.499900:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144307.499902:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144307.499905:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2837 00000100:00080000:2.0:1783144307.499908:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783144307.499912:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144307.499924:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3c25f80 x1869759501291648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144307.499947:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144307.499949:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144307.499951:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144307.499954:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2837 00000100:00080000:2.0:1783144307.499957:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783144307.499960:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144307.499971:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af7b11c00 x1869759501292032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144307.500009:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501291904:0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.500084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.500130:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144307.500135:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501291264:0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.500164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.500194:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501291520:0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.500218:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.500253:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783144307.500260:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501291776:0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.500283:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.500314:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291904 00000100:00100000:2.0:1783144307.500320:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291904 00000100:00100000:2.0:1783144307.500366:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291776 00000100:00100000:2.0:1783144307.500369:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291776 00000100:00100000:2.0:1783144307.500391:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1783144307.500400:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501291904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.500450:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501291904:12345-0@lo:400:kworker.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.500457:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1783144307.500471:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1783144307.500477:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501291776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.500506:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501291776:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.500512:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1783144307.500530:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291264 00000100:00100000:2.0:1783144307.500533:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291264 00000100:00100000:2.0:1783144307.500555:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291520 00000100:00100000:2.0:1783144307.500557:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291520 00000100:00100000:0.0:1783144307.500609:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa81aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501291008:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144307.500641:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1783144307.500649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.500652:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501291264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144307.500685:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501291136:0@lo:38:kworker.0 00000100:00100000:1.0:1783144307.500698:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501291264:12345-0@lo:400:kworker.0 Request processed in 48us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.500706:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1783144307.500715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144307.500761:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501291392:0@lo:38:kworker.0 00000100:00100000:0.0:1783144307.500783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.501280:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291136 00000100:00100000:1.0:1783144307.501286:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291136 00000100:00100000:1.0:1783144307.501312:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1783144307.501321:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501291520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144307.501362:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501291520:12345-0@lo:400:kworker.0 Request processed in 43us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.501369:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1783144307.501381:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1783144307.501385:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501291136:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144307.501421:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501291136:12345-0@lo:38:kworker.0 Request processed in 34us (707us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144307.501426:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000020:01000000:1.0:1783144307.501507:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144307.501512:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.501514:0:88861:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783144307.501517:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783144307.501520:0:88861:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1783144307.501521:0:88861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144307.501523:0:88861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144307.501524:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783144307.501527:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.501528:0:88861:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783144307.501531:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783144307.501536:0:88861:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783144307.501539:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.501540:0:88861:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783144307.501543:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783144307.501547:0:88861:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1783144307.501568:0:88861:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783144307.501571:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144307.501587:0:88861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c29c31e0000) 00000020:00000080:1.0:1783144307.501605:0:88861:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783144307.501610:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783144307.501686:0:88861:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783144307.501692:0:88861:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783144307.501704:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047b25 00010000:00080000:1.0:1783144307.501922:0:88861:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c29c4cb3000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144307.502115:0:88861:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1783144307.502912:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501291648:0@lo:38:kworker.0 00000100:00100000:0.0:1783144307.502949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144307.502963:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501292032:0@lo:38:kworker.0 00000100:00100000:0.0:1783144307.502982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783144307.503014:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144307.503018:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783144307.503021:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501291136:0@lo:38:kworker.0 00000100:00100000:1.0:1783144307.503664:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291392 00000100:00100000:1.0:1783144307.503672:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291392 00000100:00100000:1.0:1783144307.503698:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292032 00000100:00100000:1.0:1783144307.503700:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292032 00000100:00100000:1.0:1783144307.503713:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1783144307.503719:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501291392:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144307.503789:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501291392:12345-0@lo:38:kworker.0 Request processed in 69us (3004us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144307.503797:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1783144307.503812:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1783144307.503816:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501292032:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144307.503845:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501292032:12345-0@lo:38:kworker.0 Request processed in 28us (862us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144307.503851:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1783144307.503873:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291008 00000100:00100000:1.0:1783144307.503877:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291008 00000100:00100000:1.0:1783144307.503894:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501291648 00000100:00100000:1.0:1783144307.503896:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501291648 00000100:00100000:1.0:1783144307.503910:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:1.0:1783144307.503914:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501291008:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783144307.503931:0:78024:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2841 last 0 00000020:00000080:1.0:1783144307.503964:0:78024:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047b2c 00000004:00100000:1.0:1783144307.503978:0:78024:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783144307.504121:0:78024:0:(import.c:65:import_set_state_nolock()) ffff9c2affddc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144307.504161:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501291008:12345-0@lo:38:llog_process_th.0 Request processed in 244us (3513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.504174:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:1.0:1783144307.504187:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:1.0:1783144307.504191:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501291648:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144307.504222:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501291648:12345-0@lo:38:kworker.0 Request processed in 29us (1272us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144307.504228:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:1.0:1783144307.504290:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783144307.504298:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1783144307.504307:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783144307.504310:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144307.504313:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783144307.504317:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144307.504318:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783144307.504322:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144307.504327:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa81aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501291008:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783144307.504342:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783144307.504364:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501291776:0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.504376:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501291520:0@lo:400:kworker.0 00000100:00100000:2.0:1783144307.504405:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501291264:0@lo:400:kworker.0 00000100:00080000:1.0:1783144307.504411:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144307.504416:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501291392:0@lo:38:kworker.0 00000100:00100000:2.0:1783144307.504437:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501291904:0@lo:400:kworker.0 00000100:00080000:1.0:1783144307.504439:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144307.504447:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144307.504451:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501291648:0@lo:38:kworker.0 00000100:00080000:1.0:1783144307.504463:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144307.504468:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144307.504472:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501292032:0@lo:38:kworker.0 00000100:00100000:0.0:1783144307.504584:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501292160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144307.504623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.505313:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292160 00000100:00100000:3.0:1783144307.505319:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292160 00000100:00100000:3.0:1783144307.505346:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:3.0:1783144307.505353:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501292160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783144307.505377:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144307.505427:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501292160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144307.505441:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:2.0:1783144307.505535:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501292160:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1783144307.505788:0:88861:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783144307.505812:0:88861:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783144307.505878:0:88861:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1783144307.506612:0:88861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783144307.506639:0:88861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:2.0:1783144307.509919:0:88861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:1.0:1783144307.511116:0:88867:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:1.0:1783144307.511122:0:88867:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783144307.511543:0:88867:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1783144307.511570:0:88867:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783144307.511701:0:88867:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1783144307.511705:0:88867:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783144307.512060:0:88861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144307.512072:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783144307.512109:0:88861:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783144307.512130:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047b33 00000100:00080000:3.0:1783144307.512140:0:88861:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783144307.512147:0:88861:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c29c4cb3000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144307.512191:0:88861:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c50e5180 x1869759501292288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144307.512214:0:88861:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783144307.512270:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501292288:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1783144307.512326:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144307.512332:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144307.512334:0:88861:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783144307.512337:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783144307.512340:0:88861:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783144307.512342:0:88861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144307.512344:0:88861:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144307.512345:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783144307.512349:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144307.512351:0:88861:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783144307.512354:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783144307.512363:0:88861:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783144307.512368:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144307.512370:0:88861:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783144307.512374:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783144307.512378:0:88861:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000100:00100000:1.0:1783144307.512394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1783144307.512400:0:88861:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783144307.512405:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783144307.512417:0:88861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c2aee593380) 00000020:00000080:3.0:1783144307.512434:0:88861:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000100:00100000:1.0:1783144307.512453:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292288 00000020:00000080:3.0:1783144307.512458:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1783144307.512462:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292288 00000100:00100000:1.0:1783144307.512494:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00000100:00100000:1.0:1783144307.512501:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3647:x1869759501292288:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783144307.512526:0:26140:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2841 last 0 00000004:00080000:3.0:1783144307.512549:0:88861:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00000020:00000080:1.0:1783144307.512550:0:26140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047b41 00080000:01000000:3.0:1783144307.512557:0:88861:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00002000:00100000:1.0:1783144307.512566:0:26140:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2affdde000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1783144307.512567:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423047b48 00002000:00080000:1.0:1783144307.512574:0:26140:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783144307.512578:0:26140:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1783144307.512603:0:88861:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c29c496e000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00002000:00080000:1.0:1783144307.512631:0:26140:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783144307.512652:0:26140:0:(import.c:65:import_set_state_nolock()) ffff9c2affddf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144307.512696:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501292288:12345-0@lo:8:llog_process_th.0 Request processed in 194us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.512704:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00000100:00100000:1.0:1783144307.512788:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783144307.512796:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783144307.512802:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783144307.512807:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783144307.512809:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c4cb3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783144307.512817:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783144307.512822:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501292288:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1783144307.512867:0:88867:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783144307.512909:0:88867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2841866185984ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783144307.512988:0:88867:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1783144307.512992:0:88861:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1783144307.513207:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144307.513218:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501292416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144307.513269:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.513358:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292416 00000100:00100000:3.0:1783144307.513363:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292416 00000100:00100000:3.0:1783144307.513413:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1783144307.513420:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501292416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783144307.513439:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783144307.513480:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144307.513870:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501292416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 449us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144307.513877:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000040:01000000:3.0:1783144307.513915:0:88861:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783144307.513928:0:88861:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783144307.514010:0:88861:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:0.0:1783144307.514223:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501292416:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1783144307.517711:0:88850:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1783144307.517979:0:88861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783144307.518008:0:88861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:3.0:1783144307.518104:0:88861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000040:00080000:3.0:1783144307.518711:0:88869:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1783144307.518717:0:88869:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783144307.518863:0:88869:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1783144307.518877:0:88869:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1783144307.518983:0:88869:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1783144307.518987:0:88869:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783144307.520570:0:88861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144307.520581:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783144307.520620:0:88861:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783144307.520644:0:88861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047b4f 00000100:00080000:2.0:1783144307.520655:0:88861:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783144307.520660:0:88861:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c29c496e000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144307.520691:0:88861:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60ebb80 x1869759501292544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144307.520718:0:88861:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1783144307.520798:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501292544:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783144307.520865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1783144307.520897:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144307.520902:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144307.520904:0:88861:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783144307.520908:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144307.520912:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144307.520914:0:88861:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783144307.520918:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783144307.520920:0:88861:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783144307.520921:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292544 00000020:01000000:2.0:1783144307.520923:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144307.520927:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144307.520929:0:88861:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000100:00100000:1.0:1783144307.520929:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292544 00000020:01000000:2.0:1783144307.520940:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144307.520944:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144307.520946:0:88861:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783144307.520949:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783144307.520960:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938 00000100:00100000:1.0:1783144307.520967:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3647:x1869759501292544:12345-0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783144307.520980:0:88861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88861:1869759501292672:0@lo:502:llog_process_th.0 00010000:00080000:1.0:1783144307.520992:0:26139:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2841 last 0 00000020:00000080:1.0:1783144307.521019:0:26139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423047b56 00000100:00100000:2.0:1783144307.521030:0:88861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1783144307.521032:0:26139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2aefa7c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783144307.521037:0:26139:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783144307.521040:0:26139:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783144307.521059:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292672 00000100:00100000:2.0:1783144307.521064:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292672 00002000:00080000:1.0:1783144307.521096:0:26139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1783144307.521100:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783144307.521109:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:88861:x1869759501292672:12345-0@lo:502:llog_process_th.0 00000100:00080000:1.0:1783144307.521120:0:26139:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144307.521161:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501292544:12345-0@lo:8:llog_process_th.0 Request processed in 193us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.521169:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938 00000100:00100000:2.0:1783144307.521202:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:88861:x1869759501292672:12345-0@lo:502:llog_process_th.0 Request processed in 93us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.521209:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1783144307.521213:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783144307.521227:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783144307.521235:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783144307.521240:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783144307.521251:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c496e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783144307.521264:0:88861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce5180 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.521280:0:88861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88861:1869759501292672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144307.521304:0:88861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144307.521308:0:88861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144307.521309:0:88861:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783144307.521313:0:88861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783144307.521388:0:88849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783144307.521416:0:88849:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783144307.521433:0:88849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.521449:0:88849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.521457:0:88849:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2af728f800 from 1 10000000:01000000:3.0:1783144307.521459:0:88849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144307.521482:0:88849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.521490:0:88849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.521498:0:88849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144307.521510:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501292800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144307.521546:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.521565:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.521674:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292800 00000100:00100000:2.0:1783144307.521679:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292800 00000100:00100000:2.0:1783144307.521708:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783144307.521714:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:88849:x1869759501292800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144307.521739:0:88859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144307.521753:0:88859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047b5d expref: -99 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.521773:0:88859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047b5d expref: 9 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.521798:0:88859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047b5d expref: 9 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.521806:0:88859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00c00, rc 0) 00000100:00100000:2.0:1783144307.521840:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88849:x1869759501292800:12345-0@lo:101:mount.lustre.0 Request processed in 126us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.521846:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783144307.521872:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501292800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144307.521884:0:88849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.521892:0:88849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144307.522450:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501292928:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783144307.522482:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783144307.522597:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783144307.522625:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144307.522667:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501292544:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783144307.522669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.522670:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144307.522699:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293056 00000100:00100000:3.0:1783144307.522705:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293056 00000004:00080000:1.0:1783144307.522709:0:88869:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:0.0:1783144307.522750:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144307.522768:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:3.0:1783144307.522777:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501293056:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1783144307.522787:0:88869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2841876063779ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783144307.522795:0:88869:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00000024:3.0:1783144307.522796:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144307.522972:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501293056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144307.522980:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000004:00080000:1.0:1783144307.524120:0:88850:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783144307.526349:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144307.526583:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501292928 00000100:00100000:2.0:1783144307.526590:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501292928 00000100:00100000:2.0:1783144307.526672:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783144307.526682:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88849:x1869759501292928:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783144307.526703:0:88856:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783144307.526739:0:88856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783144307.526744:0:88856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783144307.526747:0:88856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783144307.526750:0:88856:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 111 00000100:00100000:2.0:1783144307.526869:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88849:x1869759501292928:12345-0@lo:256:mount.lustre.0 Request processed in 188us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.526877:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783144307.526892:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501292928:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783144307.527787:0:88849:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144307.527858:0:88849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.527870:0:88849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144307.527878:0:88849:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2af728f800 from 1 10000000:01000000:3.0:1783144307.527881:0:88849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144307.527913:0:88849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.527921:0:88849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.527930:0:88849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144307.527947:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144307.527981:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.528026:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.529871:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293184 00000100:00100000:2.0:1783144307.529878:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293184 00000100:00100000:2.0:1783144307.529924:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783144307.529935:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:88849:x1869759501293184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144307.529948:0:88856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144307.529963:0:88856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047b72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047b6b expref: -99 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.530000:0:88856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047b6b expref: 10 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.530010:0:88856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047b6b expref: 10 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.530018:0:88856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01c00, rc 0) 00000100:00100000:2.0:1783144307.530068:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88849:x1869759501293184:12345-0@lo:101:mount.lustre.0 Request processed in 136us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.530076:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783144307.530114:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144307.530129:0:88849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.530138:0:88849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144307.530195:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144307.530234:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.530269:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144307.530361:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293312 00000100:00100000:0.0:1783144307.530366:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293312 00000100:00100000:0.0:1783144307.530399:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783144307.530407:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88849:x1869759501293312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144307.530545:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88849:x1869759501293312:12345-0@lo:501:mount.lustre.0 Request processed in 138us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144307.530552:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783144307.530692:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144307.530748:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144307.530788:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.530811:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.531259:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293440 00000100:00100000:2.0:1783144307.531263:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293440 00000100:00100000:2.0:1783144307.531302:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783144307.531308:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88849:x1869759501293440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144307.531397:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88849:x1869759501293440:12345-0@lo:503:mount.lustre.0 Request processed in 89us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.531404:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783144307.531433:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144307.532556:0:88871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88871:1869759501293568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.532613:0:88871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.532641:0:88871:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144307.532660:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293568 00000100:00100000:0.0:1783144307.532666:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293568 00000100:00100000:0.0:1783144307.532744:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783144307.532754:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88871:x1869759501293568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144307.533487:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88871:x1869759501293568:12345-0@lo:502:llog_process_th.0 Request processed in 734us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144307.533495:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783144307.533535:0:88871:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88871:1869759501293568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144307.533561:0:88871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144307.533571:0:88871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.533574:0:88871:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783144307.533581:0:88871:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2af728f800 00000020:00000080:1.0:1783144307.533584:0:88871:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783144307.533591:0:88871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144307.533594:0:88871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.533596:0:88871:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783144307.533598:0:88871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144307.533601:0:88871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144307.533615:0:88871:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783144307.533620:0:88871:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2af728f800 00000020:00000080:1.0:1783144307.533623:0:88871:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783144307.533697:0:88871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88871:1869759501293696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.533779:0:88871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.533818:0:88871:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144307.535224:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293696 00000100:00100000:2.0:1783144307.535233:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293696 00000100:00100000:2.0:1783144307.535294:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783144307.535303:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88871:x1869759501293696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144307.535426:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88871:x1869759501293696:12345-0@lo:502:llog_process_th.0 Request processed in 124us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.535433:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783144307.536822:0:88871:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88871:1869759501293696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783144307.536863:0:88871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144307.536871:0:88871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144307.536874:0:88871:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783144307.536879:0:88871:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783144307.537058:0:88849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1783144307.537087:0:88849:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783144307.537121:0:88849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.537133:0:88849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144307.537194:0:88849:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783144307.537198:0:88849:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2af728f800 10000000:01000000:2.0:1783144307.537202:0:88849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2af728f800 10000000:01000000:2.0:1783144307.537206:0:88849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783144307.537211:0:88849:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2af728f800 from 1 10000000:01000000:2.0:1783144307.537214:0:88849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144307.537259:0:88849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.537268:0:88849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.537278:0:88849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144307.537299:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783144307.537361:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.537405:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144307.537454:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293824 00000100:00100000:3.0:1783144307.537459:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293824 00000100:00100000:3.0:1783144307.537503:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783144307.537511:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88849:x1869759501293824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144307.537526:0:88859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144307.537541:0:88859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0000/0xad8e53a423047b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047b79 expref: -99 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.537565:0:88859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0000/0xad8e53a423047b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047b79 expref: 11 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.537585:0:88859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0000/0xad8e53a423047b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047b79 expref: 11 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144307.537594:0:88859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0000, rc 0) 00000100:00100000:3.0:1783144307.537637:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88849:x1869759501293824:12345-0@lo:101:mount.lustre.0 Request processed in 127us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144307.537644:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783144307.537706:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144307.537718:0:88849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.537757:0:88849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144307.537814:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144307.537838:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.537853:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144307.538604:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501293952 00000100:00100000:3.0:1783144307.538610:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501293952 00000100:00100000:3.0:1783144307.538645:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783144307.538653:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88849:x1869759501293952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144307.538804:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88849:x1869759501293952:12345-0@lo:501:mount.lustre.0 Request processed in 150us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144307.538811:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783144307.538842:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501293952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144307.538895:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501294080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144307.539870:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144307.539908:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d96240 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.540313:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294080 00000100:00100000:1.0:1783144307.540319:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294080 00000100:00100000:1.0:1783144307.540361:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783144307.540369:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88849:x1869759501294080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144307.540474:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88849:x1869759501294080:12345-0@lo:503:mount.lustre.0 Request processed in 105us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.540481:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783144307.540873:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501294080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144307.544902:0:88874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88874:1869759501294208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144307.544980:0:88874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144307.546579:0:88874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.549224:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294208 00000100:00100000:1.0:1783144307.549235:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294208 00000100:00100000:1.0:1783144307.549329:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783144307.549339:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88874:x1869759501294208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.549485:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88874:x1869759501294208:12345-0@lo:502:llog_process_th.0 Request processed in 148us (4504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.549493:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783144307.549570:0:88874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88874:1869759501294208:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783144307.549632:0:88874:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783144307.549645:0:88874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c2ad08db380) 00000020:00000080:0.0:1783144307.549669:0:88874:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783144307.549846:0:88874:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2af728f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783144307.549851:0:88874:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2af728f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783144307.549853:0:88874:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af728f800 4 00010000:00080000:0.0:1783144307.549881:0:88874:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ad06c4000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1783144307.551356:0:88874:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1783144307.551439:0:88874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783144307.551471:0:88874:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783144307.551483:0:88874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad8e53a423047b8e 00000100:00080000:0.0:1783144307.551490:0:88874:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144307.551495:0:88874:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ad06c4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144307.551526:0:88874:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee582a00 x1869759501294336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144307.551552:0:88874:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783144307.555336:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501294336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783144307.555415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.555578:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294336 00000100:00100000:1.0:1783144307.555586:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294336 00000100:00100000:1.0:1783144307.555627:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1783144307.555635:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501294336:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144307.555693:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501294336:12345-0@lo:38:llog_process_th.0 Request processed in 58us (277us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144307.555701:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1783144307.555862:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783144307.555870:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ad06c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144307.555874:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144307.555878:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501294336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144307.556081:0:88874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88874:1869759501294464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.556125:0:88874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.556146:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294464 00000100:00100000:1.0:1783144307.556150:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294464 00000100:00100000:1.0:1783144307.556177:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783144307.556184:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88874:x1869759501294464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.556289:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88874:x1869759501294464:12345-0@lo:502:llog_process_th.0 Request processed in 104us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.556295:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783144307.556346:0:88874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.556361:0:88874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88874:1869759501294464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.556399:0:88874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88874:1869759501294592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.556435:0:88874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.556460:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294592 00000100:00100000:1.0:1783144307.556464:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294592 00000100:00100000:1.0:1783144307.556493:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783144307.556500:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88874:x1869759501294592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144307.556569:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88874:x1869759501294592:12345-0@lo:502:llog_process_th.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.556577:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783144307.556610:0:88874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.556623:0:88874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88874:1869759501294592:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144307.556644:0:88874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783144307.556710:0:88849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783144307.556799:0:88849:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144307.556814:0:88849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.556839:0:88849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144307.556884:0:88849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783144307.556886:0:88849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144307.556888:0:88849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144307.556889:0:88849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144307.556890:0:88849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144307.556892:0:88849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144307.556893:0:88849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144307.556895:0:88849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144307.556897:0:88849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144307.556898:0:88849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783144307.556902:0:88849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783144307.556905:0:88849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783144307.556907:0:88849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144307.556908:0:88849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144307.556909:0:88849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144307.556910:0:88849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144307.556912:0:88849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144307.556913:0:88849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144307.556914:0:88849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144307.556916:0:88849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144307.556917:0:88849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783144307.556931:0:88849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783144307.556940:0:88849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501294720:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783144307.556975:0:88849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144307.557001:0:88849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.557022:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294720 00000100:00100000:1.0:1783144307.557026:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294720 00000100:00100000:1.0:1783144307.557053:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783144307.557061:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:88849:x1869759501294720:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144307.557083:0:88855:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783144307.557101:0:88855:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783144307.563372:0:88855:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783144307.563423:0:88855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783144307.563521:0:88858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144307.563526:0:88858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144307.563550:0:88858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.563568:0:88858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047b5d expref: 11 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.563576:0:88858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.563611:0:88858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423047b5d expref: 11 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.563624:0:88858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423047b5d expref: 11 pid: 88859 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144307.563639:0:88858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88858:1869759501294848:0@lo:104: 00000100:00100000:2.0:1783144307.563701:0:88858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.563814:0:88858:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144307.564439:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294848 00000100:00100000:1.0:1783144307.564447:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294848 00000100:00100000:1.0:1783144307.564554:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1783144307.564564:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:88858:x1869759501294848:12345-0@lo:104: 00010000:00010000:1.0:1783144307.564579:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.564823:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783144307.564830:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:88858:x1869759501294848:12345-0@lo:104: Request processed in 268us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.564838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:0.0:1783144307.565298:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144307.565306:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.565315:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0c00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144307.565319:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.565329:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144307.565336:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144307.565341:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144307.565379:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.565386:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144307.565417:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.565425:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423047b64 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144307.565439:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144307.565441:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144307.565443:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144307.565544:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501294976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144307.565590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144307.565591:0:88858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88858:1869759501294848:0@lo:104: 00010000:00010000:2.0:1783144307.565612:0:88858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144307.565683:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501294976 00000100:00100000:1.0:1783144307.565688:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501294976 00010000:00010000:1.0:1783144307.565707:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423047b5d expref: 12 pid: 88859 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144307.565762:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:1.0:1783144307.565772:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:3648:x1869759501294976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144307.565784:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144307.565790:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423047b5d expref: 12 pid: 88859 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565804:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423047b5d expref: 12 pid: 88859 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565819:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423047b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423047b5d expref: 12 pid: 88859 timeout: 2941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565851:0:26153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565859:0:26153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783144307.565872:0:26153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002346170s 00010000:00010000:1.0:1783144307.565876:0:26153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565883:0:26153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565905:0:26153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565912:0:26153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565925:0:26153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144307.565929:0:26153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565936:0:26153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565953:0:26153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144307.565962:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144307.565999:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3648:x1869759501294976:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144307.566007:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:3.0:1783144307.566038:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501294976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144307.566278:0:88858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.566293:0:88858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144307.566299:0:88858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00a00/0xad8e53a423047b95 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144307.566396:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:88849:x1869759501294720:12345-0@lo:253:mount.lustre.0 Request processed in 9335us (9419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144307.566410:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783144307.566487:0:88849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa818380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:88849:1869759501294720:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783144307.566497:0:88849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783144307.566500:0:88849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783144307.566501:0:88849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144307.566502:0:88849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144307.566503:0:88849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144307.566505:0:88849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144307.566506:0:88849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144307.566507:0:88849:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144307.566509:0:88849:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144307.566510:0:88849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144307.566511:0:88849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783144307.566523:0:88849:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1783144307.572827:0:88849:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:1.0:1783144307.573088:0:88849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783144307.573274:0:88879:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:3.0:1783144307.573279:0:88879:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:0.0:1783144307.573701:0:88880:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1783144307.573975:0:88880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783144307.574874:0:88849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1783144307.576494:0:88880:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783144307.576561:0:88880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1783144307.577039:0:88881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88881:1869759501295104:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144307.577109:0:88881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.577143:0:88881:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144307.577197:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501295104 00000100:00100000:0.0:1783144307.577203:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501295104 00000100:00100000:0.0:1783144307.577253:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:0.0:1783144307.577261:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88881:x1869759501295104:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144307.577337:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88881:x1869759501295104:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144307.577344:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:3.0:1783144307.577451:0:88881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88881:1869759501295104:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783144307.577480:0:88881:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783144307.577513:0:88881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88881:1869759501295232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144307.577542:0:88881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144307.577564:0:88881:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144307.577610:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501295232 00000100:00100000:0.0:1783144307.577614:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501295232 00000100:00100000:0.0:1783144307.577678:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:0.0:1783144307.577685:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88881:x1869759501295232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144307.577806:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88881:x1869759501295232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 121us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144307.577812:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1783144307.577866:0:88881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88881:1869759501295232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144307.577917:0:88881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88881:1869759501295360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144307.577940:0:88881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1783144307.578330:0:88849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783144307.578369:0:88849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783144307.578829:0:88849:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783144307.578837:0:88849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783144307.578869:0:88849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783144307.579882:0:88849:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1783144307.580539:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501295360 00000100:00100000:2.0:1783144307.580548:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501295360 00000040:00080000:1.0:1783144307.580552:0:88849:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783144307.580592:0:88849:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:2.0:1783144307.580593:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:2.0:1783144307.580605:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88881:x1869759501295360:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783144307.580673:0:88849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783144307.580708:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88881:x1869759501295360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144307.580716:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00080000:10000000:1.0:1783144307.581195:0:88849:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:1.0:1783144307.582862:0:88849:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215110 00000100:00100000:3.0:1783144307.583030:0:88881:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144307.583060:0:88881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88881:1869759501295360:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783144307.583120:0:88881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:1.0:1783144307.584039:0:88882:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88882 00010000:02000000:1.0:1783144307.584048:0:88882:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783144307.584052:0:88882:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783144307.584060:0:88882:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783144307.584187:0:88849:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783144307.584204:0:88849:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783144307.584221:0:88849:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783144307.584253:0:88849:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783144307.585099:0:88849:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144307.585362:0:88849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1783144307.590668:0:88881:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783144307.590815:0:88881:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783144307.590821:0:88881:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1783144307.592099:0:88882:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1783144307.664302:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144308.326255:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144308.326303:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144308.326429:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144308.326462:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144308.326513:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144308.326545:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664000 00000100:00100000:1.0:1783144308.326554:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664000 00000100:00100000:3.0:1783144308.326562:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664128 00000100:00100000:3.0:1783144308.326569:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664128 00000100:00100000:1.0:1783144308.326637:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4939 00000100:00100000:1.0:1783144308.326648:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cace81e7-a6f2-4d37-b197-caf34583781c+5:2402:x1869759481664000:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1783144308.326676:0:26147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047719 00000100:00080000:1.0:1783144308.326685:0:26147:0:(import.c:65:import_set_state_nolock()) ffff9c29c340a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783144308.326754:0:26147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968824 00000100:00100000:1.0:1783144308.326915:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:cace81e7-a6f2-4d37-b197-caf34583781c+2:2402:x1869759481664000:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 268us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.326924:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4939 00000100:00100000:1.0:1783144308.326947:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481663616 00000100:00100000:1.0:1783144308.326951:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481663616 00000100:00100000:1.0:1783144308.326974:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1783144308.326979:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2405:x1869759481663616:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:1.0:1783144308.326985:0:88857:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:1.0:1783144308.327009:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2405:x1869759481663616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (496us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144308.327016:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00010000:00010000:1.0:1783144308.327047:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144308.327364:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481663872 00000100:00100000:0.0:1783144308.327370:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481663872 00000100:00100000:2.0:1783144308.327429:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481663744 00000100:00100000:2.0:1783144308.327433:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481663744 00000100:00100000:2.0:1783144308.327458:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1095 00000100:00100000:2.0:1783144308.327465:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1869759481663744:12345-192.168.203.4@tcp:38:kworker.0 00010000:00080000:2.0:1783144308.327487:0:66113:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'cace81e7-a6f2-4d37-b197-caf34583781c' at ffff9c29c5775000, cookie 0xad8e53a423047ae6 00010000:00080000:2.0:1783144308.327493:0:66113:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp recovering/t103079215111 exp ffff9c29c5775000 cur 2842 last 1783144307 00010000:02000400:2.0:1783144308.327512:0:66113:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1783144308.327518:0:66113:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1783144308.327536:0:66113:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783144308.327677:0:66113:0:(import.c:65:import_set_state_nolock()) ffff9c2aee191000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144308.327717:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481663744:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 251us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144308.327739:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1095 00000100:00080000:1.0:1783144308.328650:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144308.328655:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144308.328658:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144308.328806:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 774 00000100:00100000:0.0:1783144308.328815:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481663872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144308.328855:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481663872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 41us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144308.328862:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 774 00000100:00100000:3.0:1783144308.332356:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4940 00000100:00100000:3.0:1783144308.332370:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:cace81e7-a6f2-4d37-b197-caf34583781c+5:2402:x1869759481664128:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:3.0:1783144308.332397:0:26152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047720 00000100:00080000:3.0:1783144308.332408:0:26152:0:(import.c:65:import_set_state_nolock()) ffff9c29c340c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783144308.332423:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144308.332450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144308.332473:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664256 00000100:00100000:1.0:1783144308.332479:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664256 00000100:00100000:0.0:1783144308.332492:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481658752 00000100:00100000:0.0:1783144308.332499:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481658752 00000001:00000004:3.0:1783144308.332507:0:26152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968824 00000100:00100000:1.0:1783144308.332521:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1783144308.332625:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2402:x1869759481664256:12345-192.168.203.4@tcp:250:ptlrpcd_01_00.0 00010000:00080000:1.0:1783144308.332642:0:88859:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12@192.168.203.4@tcp t0 exp 0000000000000000 cur 2842 last 0 00000100:00100000:3.0:1783144308.332652:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:cace81e7-a6f2-4d37-b197-caf34583781c+2:2402:x1869759481664128:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 284us (6187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.332661:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4940 00000020:00000080:1.0:1783144308.332662:0:88859:0:(genops.c:1406:class_connect()) connect: client 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12, cookie 0xad8e53a423047b9c 00000100:00100000:0.0:1783144308.332845:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1096 00000100:00100000:0.0:1783144308.332853:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481658752:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00080000:0.0:1783144308.332866:0:66947:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:0.0:1783144308.332881:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481658752:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 31us (431us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144308.332887:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1096 00010000:00080000:0.0:1783144308.332908:0:88882:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1783144308.333148:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144308.333345:0:88859:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3dad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144308.333445:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:2402:x1869759481664256:12345-192.168.203.4@tcp:250:ptlrpcd_01_00.0 Request processed in 819us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.333453:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00010000:00010000:0.0:1783144308.686020:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783144308.686069:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783144308.686072:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2af728f800 from 112 10000000:01000000:2.0:1783144308.686078:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783144308.686114:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.686126:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.686136:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.686160:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.686230:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144308.686280:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501295488 00000100:00100000:2.0:1783144308.686281:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.686286:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501295488 00000100:00100000:1.0:1783144308.686335:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783144308.686344:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:6518:x1869759501295488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144308.686358:0:88857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144308.686371:0:88857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47ce00/0xad8e53a423047baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047ba3 expref: -99 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.686392:0:88857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47ce00/0xad8e53a423047baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047ba3 expref: 11 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.686402:0:88857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47ce00/0xad8e53a423047baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047ba3 expref: 11 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.686411:0:88857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47ce00, rc 0) 00000100:00100000:1.0:1783144308.686457:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501295488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.686469:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783144308.686850:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.686864:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.686873:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.686913:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.686934:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.686954:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.686963:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501295616 00000100:00100000:3.0:1783144308.686967:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501295616 00000100:00100000:3.0:1783144308.687069:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783144308.687078:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501295616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144308.687096:0:88855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783144308.687110:0:88855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144308.687113:0:88855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 112 00000100:00100000:3.0:1783144308.687200:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501295616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.687208:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783144308.687234:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783144308.687287:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783144308.687293:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.687300:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144308.687307:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144308.687309:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 52 10000000:01000000:2.0:1783144308.687311:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144308.687325:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.687331:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.687338:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.687349:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.687371:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.687393:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.687428:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501295744 00000100:00100000:1.0:1783144308.687432:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501295744 00000100:00100000:1.0:1783144308.687462:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783144308.687469:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501295744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144308.687476:0:88856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144308.687485:0:88856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47d800/0xad8e53a423047bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047bb1 expref: -99 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.687499:0:88856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47d800/0xad8e53a423047bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047bb1 expref: 12 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.687571:0:88856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47d800/0xad8e53a423047bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047bb1 expref: 12 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.687579:0:88856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d800, rc 0) 00000100:00100000:1.0:1783144308.687954:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501295744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 484us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.687960:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783144308.688147:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.688164:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.688172:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047bb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.688222:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.688257:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.688311:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.688352:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501295872 00000100:00100000:3.0:1783144308.688356:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501295872 00000100:00100000:3.0:1783144308.688388:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783144308.688395:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501295872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.688712:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501295872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.688743:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783144308.688872:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501295872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.688898:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.688933:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.688960:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.689014:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296000 00000100:00100000:1.0:1783144308.689018:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296000 00000100:00100000:1.0:1783144308.689045:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783144308.689051:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501296000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.689128:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501296000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.689135:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783144308.689170:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144308.689986:0:88967:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783144308.690230:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783144308.690255:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144308.690262:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.690271:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144308.690278:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783144308.690280:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2ac91e0000 from 109 10000000:01000000:0.0:1783144308.690282:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783144308.690302:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.690309:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.690316:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144308.690338:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.690367:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.690385:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26faa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.690858:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296128 00000100:00100000:1.0:1783144308.690863:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296128 00000100:00100000:1.0:1783144308.690898:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783144308.690906:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501296128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144308.690916:0:88859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144308.690925:0:88859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c000/0xad8e53a423047bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047bbf expref: -99 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.690941:0:88859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c000/0xad8e53a423047bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047bbf expref: 13 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.690949:0:88859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c000/0xad8e53a423047bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047bbf expref: 13 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.690957:0:88859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c000, rc 0) 00000100:00100000:1.0:1783144308.690987:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501296128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.690993:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783144308.691181:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144308.691193:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.691212:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047bc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144308.691263:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.691291:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.691318:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26faa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.691323:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296256 00000100:00100000:1.0:1783144308.691328:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296256 00000100:00100000:1.0:1783144308.691501:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783144308.691865:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501296256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783144308.691879:0:88857:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783144308.691893:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783144308.691898:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783144308.691901:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783144308.691903:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783144308.691910:0:88857:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:1.0:1783144308.691985:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501296256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 476us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.691992:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783144308.692262:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783144308.692326:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144308.692333:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.692341:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144308.692348:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783144308.692350:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783144308.692353:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783144308.692371:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.692378:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.692391:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144308.692405:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.692820:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144308.692879:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.692972:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296384 00000100:00100000:1.0:1783144308.692977:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296384 00000100:00100000:0.0:1783144308.693961:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783144308.693974:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501296384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144308.693985:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144308.693998:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f6000/0xad8e53a423047bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047bcd expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.694018:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f6000/0xad8e53a423047bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047bcd expref: 14 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.694028:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f6000/0xad8e53a423047bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047bcd expref: 14 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.694035:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6000, rc 0) 00000100:00100000:0.0:1783144308.694120:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501296384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144308.694127:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783144308.694324:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.694340:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bd4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.694349:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047bd4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.694406:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.694432:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.694458:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.694496:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296512 00000100:00100000:3.0:1783144308.694501:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296512 00000100:00100000:3.0:1783144308.694590:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783144308.694598:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501296512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.694747:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501296512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.694754:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783144308.694851:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.694876:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.694913:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.694941:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.694981:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296640 00000100:00100000:3.0:1783144308.694985:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296640 00000100:00100000:3.0:1783144308.695041:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783144308.695048:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addf85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501296640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.695640:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addf85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501296640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 592us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.695647:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783144308.695711:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144308.697023:0:88970:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1783144308.697124:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1783144308.697142:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783144308.697150:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bd4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.697161:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bd4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144308.697175:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1783144308.697177:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2ac91e0000 from 1 10000000:01000000:3.0:1783144308.697180:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783144308.697213:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.697221:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.697230:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144308.697256:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.697288:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144308.697314:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c840 going to sleep for 11 seconds 00000100:00100000:2.0:1783144308.697397:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296768 00000100:00100000:2.0:1783144308.697402:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296768 00000100:00100000:2.0:1783144308.697465:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783144308.697474:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addf85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501296768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.697484:0:88857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144308.697494:0:88857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047bdb expref: -99 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.697522:0:88857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047bdb expref: 15 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.697532:0:88857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047bdb expref: 15 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.697540:0:88857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00400, rc 0) 00000100:00100000:2.0:1783144308.697574:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addf85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501296768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144308.697580:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783144308.697706:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.697718:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047be2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.697871:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047be2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144308.697889:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783144308.697893:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047be2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.697900:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047be2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144308.697906:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783144308.697908:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2ac91e0000 from 7 10000000:01000000:2.0:1783144308.697910:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783144308.697922:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.697929:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.697937:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.697949:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.697972:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.697990:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.698365:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501296896 00000100:00100000:1.0:1783144308.698370:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501296896 00000100:00100000:1.0:1783144308.698400:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783144308.698407:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addf87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501296896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144308.698414:0:88859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144308.698421:0:88859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47d400/0xad8e53a423047bf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047be9 expref: -99 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.698434:0:88859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47d400/0xad8e53a423047bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047be9 expref: 16 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.698442:0:88859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47d400/0xad8e53a423047bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047be9 expref: 16 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.698448:0:88859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d400, rc 0) 00000100:00100000:1.0:1783144308.698594:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addf87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501296896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.698600:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783144308.698654:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501296896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.698664:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bf0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.698673:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047bf0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.698956:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.698983:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.699034:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.699110:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297024 00000100:00100000:3.0:1783144308.699115:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297024 00000100:00100000:3.0:1783144308.699146:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783144308.699153:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addf86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501297024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.699268:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addf86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501297024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.699275:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783144308.699448:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.699474:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.699566:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.699616:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.699647:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297152 00000100:00100000:3.0:1783144308.699650:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297152 00000100:00100000:3.0:1783144308.699710:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783144308.699717:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addf84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501297152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.699821:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addf84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501297152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.699833:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783144308.699924:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144308.700578:0:88971:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783144308.700619:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783144308.700633:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783144308.700640:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bf0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.700648:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bf0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144308.700656:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144308.700658:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 52 10000000:01000000:2.0:1783144308.700660:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144308.700682:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.700690:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.700707:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.700759:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.700788:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.700811:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.701039:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297280 00000100:00100000:1.0:1783144308.701044:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297280 00000100:00100000:1.0:1783144308.701071:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783144308.701079:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afcbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501297280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144308.701145:0:88856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144308.701216:0:88856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c800/0xad8e53a423047bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047bf7 expref: -99 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.701249:0:88856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c800/0xad8e53a423047bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047bf7 expref: 17 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.701260:0:88856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c800/0xad8e53a423047bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047bf7 expref: 17 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.701269:0:88856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c800, rc 0) 00000100:00100000:1.0:1783144308.701313:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afcbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501297280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.701320:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783144308.701334:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.701347:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bfe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.701357:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047bfe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.701395:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.701420:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.701445:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.701513:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297408 00000100:00100000:1.0:1783144308.701518:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297408 00000100:00100000:1.0:1783144308.701551:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783144308.701558:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afcbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501297408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.701706:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afcbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501297408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.701714:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783144308.701753:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.701867:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.701901:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.701926:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.701960:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297536 00000100:00100000:1.0:1783144308.701965:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297536 00000100:00100000:1.0:1783144308.701998:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783144308.702006:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afcbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501297536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.702082:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afcbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501297536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.702160:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.702610:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000040:00080000:3.0:1783144308.703362:0:88973:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783144308.703568:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783144308.703587:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144308.703595:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bfe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.703614:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047bfe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144308.703623:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783144308.703625:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783144308.703627:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783144308.703648:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.703656:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.703665:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.703682:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.703763:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.703787:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.703917:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297664 00000100:00100000:3.0:1783144308.703923:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297664 00000100:00100000:3.0:1783144308.703955:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783144308.703964:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501297664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144308.703974:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144308.703984:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423047c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047c05 expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.704001:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423047c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047c05 expref: 18 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.704010:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423047c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047c05 expref: 18 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.704018:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1600, rc 0) 00000100:00100000:3.0:1783144308.704049:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501297664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.704056:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783144308.704795:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144308.704810:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.704820:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047c0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144308.704879:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.704910:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.704933:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.704976:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297792 00000100:00100000:1.0:1783144308.704987:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297792 00000100:00100000:1.0:1783144308.705062:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783144308.705071:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501297792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.705273:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501297792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.705280:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783144308.705379:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.705421:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.705457:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.705479:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.705583:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501297920 00000100:00100000:3.0:1783144308.705587:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501297920 00000100:00100000:3.0:1783144308.705616:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783144308.705623:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501297920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.706278:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501297920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 654us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.706293:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783144308.706342:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501297920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144308.707826:0:88974:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1783144308.707938:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1783144308.707961:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783144308.707972:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.707982:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144308.707989:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783144308.707992:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2b017f2000 from 7 10000000:01000000:1.0:1783144308.707994:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783144308.708020:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.708029:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.708038:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144308.708057:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.708096:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144308.708191:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca1cfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144308.708683:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298048 00000100:00100000:0.0:1783144308.708689:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298048 00000100:00100000:0.0:1783144308.709408:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783144308.709419:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501298048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144308.709432:0:88856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144308.709445:0:88856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7600/0xad8e53a423047c1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047c13 expref: -99 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.709481:0:88856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7600/0xad8e53a423047c1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047c13 expref: 19 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.709492:0:88856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7600/0xad8e53a423047c1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047c13 expref: 19 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.709501:0:88856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7600, rc 0) 00000100:00100000:0.0:1783144308.709549:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501298048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144308.709556:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783144308.709564:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.709583:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c1a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.709594:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047c1a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.709653:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.709686:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.710987:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144308.711184:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298176 00000100:00100000:0.0:1783144308.711191:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298176 00000100:00100000:0.0:1783144308.711243:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783144308.711252:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501298176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.711638:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501298176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 386us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144308.711646:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783144308.711969:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.712010:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.712054:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.712086:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144308.712290:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298304 00000100:00100000:0.0:1783144308.712294:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298304 00000100:00100000:0.0:1783144308.712329:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783144308.712339:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af79ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501298304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.712584:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af79ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501298304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144308.712591:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783144308.712638:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144308.714066:0:88978:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783144308.714128:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783144308.714151:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783144308.714161:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c1a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.714182:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c1a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144308.714192:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144308.714194:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 52 10000000:01000000:1.0:1783144308.714197:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144308.714224:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.714233:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.714253:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144308.714273:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.714317:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144308.714361:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca1cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144308.714596:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298432 00000100:00100000:0.0:1783144308.714602:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298432 00000100:00100000:0.0:1783144308.714644:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783144308.714652:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af79cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501298432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144308.714664:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144308.714676:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047c21 expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.714698:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047c21 expref: 20 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.714708:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047c21 expref: 20 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.714716:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7c00, rc 0) 00000100:00100000:0.0:1783144308.714804:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af79cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501298432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144308.714812:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783144308.714836:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.714851:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.714859:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047c28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.714905:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.714929:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.714952:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.715003:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298560 00000100:00100000:1.0:1783144308.715008:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298560 00000100:00100000:1.0:1783144308.715069:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783144308.715077:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af79cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501298560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144308.715182:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af79cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501298560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.715189:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783144308.715295:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.715323:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.715360:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.715374:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144308.715385:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298688 00000100:00100000:2.0:1783144308.715388:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298688 00000100:00100000:2.0:1783144308.715409:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783144308.715415:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af79cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501298688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.715491:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af79cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501298688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144308.715506:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783144308.715562:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144308.716972:0:88979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783144308.717079:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783144308.717100:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144308.717109:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.717119:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144308.717126:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783144308.717129:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783144308.717131:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783144308.717154:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.717162:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.717170:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144308.717187:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.717224:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144308.717331:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144308.717376:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298816 00000100:00100000:2.0:1783144308.717382:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298816 00000100:00100000:2.0:1783144308.718388:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783144308.718398:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af79cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501298816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.718410:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144308.718429:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423047c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047c2f expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.718454:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423047c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047c2f expref: 21 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.718464:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423047c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047c2f expref: 21 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.718472:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01a00, rc 0) 00000100:00100000:2.0:1783144308.718521:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af79cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501298816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144308.718529:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783144308.718574:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.718588:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.718596:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144308.718652:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.718677:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.718704:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144308.718843:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501298944 00000100:00100000:3.0:1783144308.718849:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501298944 00000100:00100000:3.0:1783144308.718932:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783144308.718940:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501298944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.719871:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501298944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 929us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144308.719886:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783144308.720744:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501298944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.720781:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.720822:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144308.720856:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144308.720871:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299072 00000100:00100000:0.0:1783144308.720876:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299072 00000100:00100000:0.0:1783144308.720913:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783144308.720922:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501299072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.721826:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501299072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 903us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144308.721834:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783144308.721843:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af7b10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144308.722639:0:88983:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783144308.724600:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783144308.724628:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783144308.724639:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.724650:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144308.724659:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144308.724661:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2afaac8800 from 7 10000000:01000000:3.0:1783144308.724664:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144308.724695:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.724704:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.724713:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144308.725075:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.725130:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144308.725170:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823600 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.725284:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299200 00000100:00100000:1.0:1783144308.725290:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299200 00000100:00100000:1.0:1783144308.725327:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783144308.725336:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cd1cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501299200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144308.725348:0:88859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144308.725360:0:88859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c200/0xad8e53a423047c44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047c3d expref: -99 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.725386:0:88859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c200/0xad8e53a423047c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047c3d expref: 22 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.725396:0:88859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c200/0xad8e53a423047c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047c3d expref: 22 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.725404:0:88859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c200, rc 0) 00000100:00100000:1.0:1783144308.725452:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cd1cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501299200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.725459:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783144308.725537:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144308.725550:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144308.725560:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047c44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144308.725614:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144308.725638:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144308.725778:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144308.725863:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299328 00000100:00100000:2.0:1783144308.725868:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299328 00000100:00100000:2.0:1783144308.725926:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783144308.725933:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c27d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501299328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.728319:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c27d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501299328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2379us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144308.728330:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783144308.728372:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.728430:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.728480:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.728508:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144308.728562:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299456 00000100:00100000:2.0:1783144308.728567:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299456 00000100:00100000:2.0:1783144308.728603:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783144308.728611:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c27d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501299456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.728712:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c27d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501299456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144308.728718:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783144308.728941:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144308.730638:0:88987:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783144308.731339:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783144308.731360:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783144308.731371:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.731382:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144308.731390:0:6518:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783144308.731392:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144308.731400:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783144308.731430:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.731438:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.731448:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144308.731466:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.731511:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.731581:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144308.731664:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299584 00000100:00100000:1.0:1783144308.731669:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299584 00000100:00100000:1.0:1783144308.731798:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783144308.731806:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c27d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501299584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144308.731822:0:88856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144308.731834:0:88856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423047c52 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047c4b expref: -99 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.731865:0:88856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423047c52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047c4b expref: 23 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.731875:0:88856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423047c52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047c4b expref: 23 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144308.731885:0:88856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47dc00, rc 0) 00000100:00100000:1.0:1783144308.731922:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c27d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501299584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144308.731929:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783144308.731999:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144308.732010:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.732024:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144308.732041:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783144308.732044:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.732051:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144308.732057:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783144308.732058:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144308.732061:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783144308.732073:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.732081:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.732088:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144308.732098:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.732121:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.732254:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144308.732371:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299712 00000100:00100000:2.0:1783144308.732375:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299712 00000100:00100000:2.0:1783144308.732406:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783144308.732413:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c27d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501299712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144308.732420:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144308.732427:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01000/0xad8e53a423047c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423047c59 expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.732439:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01000/0xad8e53a423047c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423047c59 expref: 24 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.732447:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01000/0xad8e53a423047c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423047c59 expref: 24 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144308.732452:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01000, rc 0) 00000100:00100000:2.0:1783144308.732478:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c27d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501299712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144308.732484:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783144308.732543:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144308.732552:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.732570:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047c60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144308.732628:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144308.732653:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144308.732673:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144308.732845:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299840 00000100:00100000:2.0:1783144308.732849:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299840 00000100:00100000:2.0:1783144308.732878:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783144308.732884:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c27d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501299840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144308.732946:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c27d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501299840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (292us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144308.732953:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783144308.733013:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501299840:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783144308.733037:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783144308.733043:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144308.733050:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047c60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144309.713345:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783144310.100858:0:89132:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783144310.114410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144310.114662:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664384 00000100:00100000:0.0:1783144310.114672:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664384 00000100:00100000:0.0:1783144310.114919:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:0.0:1783144310.114929:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c27d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:42333:x1869759481664384:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144310.114953:0:88859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144310.114969:0:88859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a423047c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a73 expref: -99 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144310.114995:0:88859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a423047c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a73 expref: 6 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144310.115007:0:88859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a423047c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a73 expref: 6 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144310.115021:0:88859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6e00, rc 0) 00000100:00100000:0.0:1783144310.115080:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c27d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481664384:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 152us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144310.115087:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:1.0:1783144310.117304:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144310.120088:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664512 00000100:00100000:0.0:1783144310.120101:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664512 00000100:00100000:0.0:1783144310.120338:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:0.0:1783144310.120350:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481664512:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783144310.120375:0:88857:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1783144310.120392:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783144310.120396:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783144310.120400:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783144310.120403:0:88857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783144310.120405:0:88857:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:0.0:1783144310.129083:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481664512:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 Request processed in 8725us (11776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144310.129098:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:2.0:1783144310.134840:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144310.135123:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664640 00000100:00100000:3.0:1783144310.135133:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664640 00000100:00100000:3.0:1783144310.135191:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:3.0:1783144310.135203:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481664640:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144310.135220:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144310.135249:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047c6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a7a expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144310.135278:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a7a expref: 7 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144310.135292:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a7a expref: 7 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144310.135301:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0800, rc 0) 00000100:00100000:3.0:1783144310.135362:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481664640:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 162us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144310.135370:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1783144310.140813:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144310.141285:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664768 00000100:00100000:2.0:1783144310.141297:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664768 00000100:00100000:2.0:1783144310.141393:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1783144310.141404:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481664768:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144310.141560:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481664768:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 157us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144310.141569:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:2.0:1783144310.143812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144310.143864:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481664896 00000100:00100000:0.0:1783144310.143872:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481664896 00000100:00100000:0.0:1783144310.143926:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:0.0:1783144310.143936:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481664896:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144310.144076:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481664896:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 141us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144310.144084:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1783144310.148475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144310.150579:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665024 00000100:00100000:0.0:1783144310.150595:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665024 00000100:00100000:0.0:1783144310.150682:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:0.0:1783144310.150694:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481665024:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144310.150712:0:88857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144310.150752:0:88857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7200/0xad8e53a423047c75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a81 expref: -99 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144310.150782:0:88857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7200/0xad8e53a423047c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a81 expref: 9 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144310.150792:0:88857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7200/0xad8e53a423047c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a81 expref: 9 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144310.150801:0:88857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7200, rc 0) 00000100:00100000:0.0:1783144310.150854:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481665024:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 163us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144310.150861:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1783144310.156369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144310.156508:0:88859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665152 00000100:00100000:0.0:1783144310.156519:0:88859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665152 00000100:00100000:0.0:1783144310.156568:0:88859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:0.0:1783144310.156578:0:88859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481665152:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144310.156817:0:88859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481665152:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 235us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144310.156825:0:88859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1783144310.163838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144310.166290:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665280 00000100:00100000:0.0:1783144310.166300:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665280 00000100:00100000:0.0:1783144310.166357:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1783144310.166368:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481665280:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144310.168111:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481665280:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 1738us (4275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144310.168121:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:1.0:1783144310.178534:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144310.178756:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665408 00000100:00100000:3.0:1783144310.178765:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665408 00000100:00100000:3.0:1783144310.178812:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:3.0:1783144310.178820:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481665408:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144310.178844:0:88855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144310.178858:0:88855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a423047c7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a88 expref: -99 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144310.178882:0:88855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a423047c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a88 expref: 10 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144310.178891:0:88855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a423047c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a88 expref: 10 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144310.178899:0:88855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1c00, rc 0) 00000100:00100000:3.0:1783144310.178947:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481665408:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 128us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144310.178953:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:0.0:1783144310.184870:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144310.187515:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665536 00000100:00100000:2.0:1783144310.187527:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665536 00000100:00100000:2.0:1783144310.187583:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1783144310.187593:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481665536:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144310.187699:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481665536:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 108us (2839us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144310.187707:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:3.0:1783144310.285872:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144310.285894:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501299968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144310.285970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144310.286015:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501299968 00000100:00100000:3.0:1783144310.286023:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501299968 00000100:00100000:3.0:1783144310.286082:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:3.0:1783144310.286093:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afad30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501299968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144310.286124:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144310.286141:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144310.286154:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501300096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144310.286175:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afad30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501299968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144310.286183:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:0.0:1783144310.286195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144310.286444:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300096 00000100:00100000:3.0:1783144310.286449:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300096 00000100:00100000:3.0:1783144310.287371:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:3.0:1783144310.287382:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501300096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144310.287404:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144310.287448:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501300096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144310.287455:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00080000:2.0:1783144310.288772:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144310.288778:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144310.288903:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501299968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144310.288955:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501300096:0@lo:13:osp-pre-1-1.0 00000020:00000004:0.0:1783144310.664551:0:89184:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783144310.664771:0:89184:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783144310.734011:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783144311.208109:0:89234:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144311.208346:0:89234:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783144311.758186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.781862:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783144312.845933:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144312.845941:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144312.845945:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144312.845959:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144312.845972:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501300352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144312.845983:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee580a80 x1869759501300480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144312.846024:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144312.846028:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144312.846030:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144312.846036:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144312.846043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144312.846046:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501300480:0@lo:38:kworker.0 00000100:00100000:0.0:1783144312.846052:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee581f80 x1869759501300736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144312.846085:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1783144312.846085:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144312.846092:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783144312.846093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783144312.846097:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783144312.846098:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501300608:0@lo:400:kworker.0 00000100:00080000:0.0:1783144312.846117:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144312.846128:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501300736:0@lo:38:kworker.0 00000100:00100000:0.0:1783144312.846134:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b39c00 x1869759501300992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144312.846145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144312.846169:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300480 00000100:00080000:0.0:1783144312.846173:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783144312.846177:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300480 00000100:00080000:0.0:1783144312.846177:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783144312.846181:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501301248:0@lo:400:kworker.0 00000100:00080000:0.0:1783144312.846182:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144312.846191:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144312.846225:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300608 00000100:00100000:0.0:1783144312.846225:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4e9c380 x1869759501301376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144312.846226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144312.846230:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300608 00000100:00100000:3.0:1783144312.846257:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1783144312.846264:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:3.0:1783144312.846267:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501301504:0@lo:400:kworker.0 00000100:00080000:0.0:1783144312.846270:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144312.846274:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2ad06c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783144312.846275:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00080000:0.0:1783144312.846281:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ad06c4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144312.846288:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501300608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144312.846296:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4e9ce00 x1869759501301760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144312.846307:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144312.846366:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1783144312.846372:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501300480:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783144312.846394:0:66114:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2847 last 0 00000100:00100000:0.0:1783144312.846425:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501301248 00000020:00000080:3.0:1783144312.846429:0:66114:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad8e53a423047c83 00000100:00100000:0.0:1783144312.846431:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501301248 00000004:00100000:3.0:1783144312.846444:0:66114:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783144312.846469:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501301504 00000100:00100000:0.0:1783144312.846473:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501301504 00000100:00100000:0.0:1783144312.846503:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:0.0:1783144312.846512:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501301248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.846580:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501300224:0@lo:400:kworker.0 00000100:00100000:1.0:1783144312.846589:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501300608:12345-0@lo:400:kworker.0 Request processed in 303us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144312.846595:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501301248:12345-0@lo:400:kworker.0 Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144312.846607:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:1.0:1783144312.846615:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1783144312.846625:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.846634:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1783144312.846652:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501301504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144312.846659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144312.846663:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501301120:0@lo:400:kworker.0 00000100:00100000:1.0:1783144312.846690:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501300992:0@lo:38:kworker.0 00000100:00100000:0.0:1783144312.846702:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501301504:12345-0@lo:400:kworker.0 Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144312.846705:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.846714:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1783144312.846752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.846753:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501301120 00000100:00100000:2.0:1783144312.846756:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783144312.846758:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501301120 00000100:00100000:2.0:1783144312.846766:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501300864:0@lo:400:kworker.0 00000100:00100000:1.0:1783144312.846779:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501301376:0@lo:38:kworker.0 00000100:00100000:0.0:1783144312.846791:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1783144312.846809:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.846816:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501301120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.846841:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501301632:0@lo:400:kworker.0 00000100:00100000:1.0:1783144312.846841:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300736 00000100:00100000:1.0:1783144312.846847:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300736 00000100:00100000:0.0:1783144312.846856:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501301120:12345-0@lo:400:kworker.0 Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144312.846864:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1783144312.846874:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300864 00000100:00100000:2.0:1783144312.846879:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144312.846879:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300864 00000100:00100000:0.0:1783144312.846896:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501301632 00000100:00100000:0.0:1783144312.846902:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501301632 00000100:00100000:1.0:1783144312.846915:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1783144312.846917:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501301120:0@lo:400:kworker.0 00000100:00100000:1.0:1783144312.846928:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501300864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144312.846937:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1783144312.846948:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501301632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.846954:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300352 00000100:00100000:2.0:1783144312.846959:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300352 00000100:00100000:1.0:1783144312.846978:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501300864:12345-0@lo:400:kworker.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144312.846986:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1783144312.846993:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501301632:12345-0@lo:400:kworker.0 Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144312.846997:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300992 00000100:00100000:2.0:1783144312.847002:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300992 00000100:00100000:0.0:1783144312.847002:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1783144312.847008:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1783144312.847015:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501300736:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144312.847027:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00010000:00080000:1.0:1783144312.847035:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2847 last 0 00000100:00100000:0.0:1783144312.847036:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:2.0:1783144312.847040:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501300352:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144312.847049:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501300992:12345-0@lo:38:kworker.0 00000020:00000080:1.0:1783144312.847066:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad8e53a423047c8a 00000004:00000024:2.0:1783144312.847069:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000004:00100000:1.0:1783144312.847076:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1783144312.847079:0:78024:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c29c5777000, cookie 0xad8e53a423047aed 00010000:00080000:0.0:1783144312.847086:0:78024:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c29c5777000 cur 2847 last 1783144307 00000004:00100000:0.0:1783144312.847098:0:78024:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783144312.847108:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2afa9bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144312.847109:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501300352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144312.847121:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00080000:0.0:1783144312.847121:0:78024:0:(import.c:65:import_set_state_nolock()) ffff9c2aefdda000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783144312.847145:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144312.847151:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144312.847153:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144312.847157:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869759501300736:12345-0@lo:38:kworker.0 Request processed in 139us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144312.847166:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1783144312.847167:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501300224 00000100:00100000:2.0:1783144312.847172:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501300224 00000100:00100000:0.0:1783144312.847176:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501300992:12345-0@lo:38:kworker.0 Request processed in 128us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144312.847194:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:1.0:1783144312.847217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144312.847219:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783144312.847229:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501300224:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1783144312.847237:0:88882:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1783144312.847242:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501301760:0@lo:38:kworker.0 00010000:00080000:0.0:1783144312.847244:0:88882:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 103079215111 00000020:00080000:0.0:1783144312.847250:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144312.847255:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:0.0:1783144312.847262:0:88882:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215111) 00000100:00100000:2.0:1783144312.847266:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501300224:12345-0@lo:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000020:00080000:0.0:1783144312.847267:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:2.0:1783144312.847280:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1783144312.847281:0:88882:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481658752 t103079215111 from 192.168.203.4@tcp req@ffff9c2af9ef4000 x1869759481658752/t0(103079215111) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:419/0 lens 528/0 e 0 to 0 dl 1783144319 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144312.847290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783144312.847324:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aee581f80 x1869759501300736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144312.847327:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501301376 00000100:00100000:2.0:1783144312.847332:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501301376 00000100:00080000:1.0:1783144312.847341:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00100000:2.0:1783144312.847347:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501301760 00000100:00100000:2.0:1783144312.847356:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501301760 00000100:00100000:0.0:1783144312.847360:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1783144312.847367:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501301376:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144312.847375:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1783144312.847382:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501301760:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783144312.847386:0:66143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2847 last 0 00010000:00080000:2.0:1783144312.847401:0:66112:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2847 last 0 00000020:00000080:0.0:1783144312.847435:0:66143:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad8e53a423047c91 00000004:00100000:0.0:1783144312.847444:0:66143:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783144312.847460:0:66143:0:(import.c:65:import_set_state_nolock()) ffff9c2aefddf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144312.847489:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869759501301376:12345-0@lo:38:kworker.0 Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144312.847497:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000020:00000080:2.0:1783144312.847629:0:66112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad8e53a423047c98 00000004:00100000:2.0:1783144312.847637:0:66112:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783144312.847655:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c2aee195800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144312.847687:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501301760:12345-0@lo:38:kworker.0 Request processed in 304us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144312.847694:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1783144312.847752:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501300864:0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.847763:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501301632:0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.847770:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501300224:0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.847822:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501301504:0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.847833:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501301248:0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.847844:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501300608:0@lo:400:kworker.0 00000100:00100000:2.0:1783144312.847857:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501300352:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1783144312.847988:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c29c496e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144312.848026:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501300480:12345-0@lo:38:kworker.0 Request processed in 1652us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144312.848033:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000004:00080000:2.0:1783144312.848089:0:88882:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 752us 00000100:00080000:1.0:1783144312.848104:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2aee581f80 x1869759501300736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144337 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144312.848113:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783144312.848116:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144312.848120:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783144312.848125:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501300736:0@lo:38:kworker.0 00010000:00080000:1.0:1783144312.848145:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aee580a80 x1869759501300480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144312.848154:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00080000:1.0:1783144312.848931:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2aee580a80 x1869759501300480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144337 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144312.848939:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783144312.848942:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144312.848945:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783144312.848948:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501300480:0@lo:38:kworker.0 00000100:00080000:1.0:1783144312.848975:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:1.0:1783144312.848982:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783144312.848985:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1783144312.848988:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00080000:1.0:1783144312.848991:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2af7208000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:1.0:1783144312.849000:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1783144312.849423:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501300992:0@lo:38:kworker.0 00010000:00080000:1.0:1783144312.849441:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2ae4e9c380 x1869759501301376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144312.849452:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00010000:00080000:3.0:1783144312.849836:0:89247:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1783144312.849839:0:89247:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1783144312.849845:0:89247:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1783144312.850329:0:89247:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:1.0:1783144312.852276:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2ae4e9c380 x1869759501301376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144337 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144312.852285:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783144312.852289:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144312.852294:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783144312.852300:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501301376:0@lo:38:kworker.0 00010000:00080000:1.0:1783144312.852329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2ae4e9ce00 x1869759501301760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144312.852343:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:1.0:1783144312.852350:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783144312.852354:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783144312.852355:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ad06c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783144312.852360:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501301760:0@lo:38:kworker.0 00000100:00100000:1.0:1783144312.852393:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501301888:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783144312.852451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144312.852563:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501301888 00000100:00100000:2.0:1783144312.852570:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501301888 00000100:00100000:2.0:1783144312.852650:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1783144312.852660:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501301888:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783144312.852676:0:23926:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2af9ef5c00 x1869759501301888/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:423/0 lens 224/0 e 0 to 0 dl 1783144323 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144312.852696:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501301888:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (246us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144312.852703:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00010000:00010000:2.0:1783144312.864696:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.864742:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.864762:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.864777:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.864785:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.864793:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865375:0:88882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865383:0:88882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865391:0:88882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865398:0:88882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144312.865410:0:88882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865418:0:88882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865433:0:88882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71e9400) 00010000:00010000:2.0:1783144312.865436:0:88882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144312.865441:0:88882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865448:0:88882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047c9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144312.865466:0:88882:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017ee2562 reply state 00000000ed957ed8 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865477:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.865483:0:88882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af71e9a00) 00010000:00010000:2.0:1783144312.865486:0:88882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144312.865488:0:88882:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1783144312.865600:0:88882:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783144312.865625:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144312.865629:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:2.0:1783144312.865633:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144312.865635:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000001:00080000:3.0:1783144312.867911:0:88850:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215111 is committed 00010000:00010000:2.0:1783144312.868118:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.868129:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.868147:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.868153:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144312.868157:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.868165:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.868182:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2af71e9a00) 00010000:00010000:2.0:1783144312.868185:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144312.868189:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.868195:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047ca6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144312.868690:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144312.868815:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481659264 00000100:00100000:2.0:1783144312.868823:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481659264 00000100:00100000:2.0:1783144312.868917:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1101 00000100:00100000:2.0:1783144312.868927:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481659264:12345-192.168.203.4@tcp:36:rm.0 00010000:00080000:2.0:1783144312.868943:0:66143:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:2.0:1783144312.868958:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481659264:12345-192.168.203.4@tcp:36:rm.0 Request processed in 34us (273us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144312.868965:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1101 00000020:00080000:0.0:1783144312.868980:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144312.868984:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:0.0:1783144312.868988:0:88882:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:0.0:1783144312.868991:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144312.869000:0:88882:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481659264 t103079215112 from 192.168.203.4@tcp req@ffff9c2ae4e9f480 x1869759481659264/t0(103079215112) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 512/0 e 0 to 0 dl 1783144323 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783144312.869081:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869094:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869104:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869114:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869120:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869126:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869199:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869222:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869230:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869427:0:88882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869435:0:88882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869446:0:88882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869451:0:88882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144312.869454:0:88882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869461:0:88882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869470:0:88882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:0.0:1783144312.869473:0:88882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783144312.869475:0:88882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869494:0:88882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7e00/0xad8e53a423047cbb lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869510:0:88882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869517:0:88882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869523:0:88882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869528:0:88882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144312.869531:0:88882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869547:0:88882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869555:0:88882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089800) 00010000:00010000:0.0:1783144312.869558:0:88882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144312.869561:0:88882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869567:0:88882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6800/0xad8e53a423047cad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144312.869578:0:88882:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019c8db3a reply state 0000000089083acb transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869588:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.869594:0:88882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2afa089400) 00010000:00010000:0.0:1783144312.869596:0:88882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144312.869598:0:88882:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783144312.869695:0:88882:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783144312.869709:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144312.869712:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:0.0:1783144312.869715:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144312.869717:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:1.0:1783144312.871398:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144312.871463:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660672 00000100:00100000:2.0:1783144312.871471:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660672 00000100:00100000:2.0:1783144312.871541:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1102 00000100:00100000:2.0:1783144312.871551:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481660672:12345-192.168.203.4@tcp:36:dd.0 00010000:00080000:2.0:1783144312.871567:0:81077:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215114, replaying 00000100:00100000:2.0:1783144312.871581:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481660672:12345-192.168.203.4@tcp:36:dd.0 Request processed in 32us (190us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144312.871587:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1102 00000020:00080000:3.0:1783144312.871695:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144312.871699:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215114, next_transno: 103079215113 00010000:00080000:3.0:1783144312.871703:0:88882:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 103079215113, ql: 1, comp: 1, conn: 2, next: 103079215114, next_update 0 last_committed: 103079215111) 00000020:00080000:3.0:1783144312.871707:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144312.871716:0:88882:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481660672 t103079215114 from 192.168.203.4@tcp req@ffff9c2af9ef7100 x1869759481660672/t0(103079215114) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 488/0 e 0 to 0 dl 1783144323 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783144312.871915:0:88882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.871928:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.871938:0:88882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144312.872024:0:88882:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b3d072f reply state 00000000880c749b transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.872036:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.872050:0:88882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:3.0:1783144312.872052:0:88882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144312.872055:0:88882:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783144312.872388:0:88882:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783144312.872400:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144312.872403:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000020:00080000:3.0:1783144312.872406:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144312.872408:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000100:00100000:1.0:1783144312.873956:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144312.874026:0:66125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481660928 00000100:00100000:3.0:1783144312.874033:0:66125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481660928 00000100:00100000:3.0:1783144312.874111:0:66125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1783144312.874121:0:66125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481660928:12345-192.168.203.4@tcp:10:dd.0 00010000:00080000:3.0:1783144312.874134:0:66125:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215115, current: 103079215115, replaying 00000100:00100000:3.0:1783144312.874153:0:66125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481660928:12345-192.168.203.4@tcp:10:dd.0 Request processed in 34us (202us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144312.874160:0:66125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000020:00080000:1.0:1783144312.874196:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144312.874199:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215115, next_transno: 103079215115 00010000:00080000:1.0:1783144312.874219:0:88882:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215115) 00000020:00080000:1.0:1783144312.874222:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144312.874230:0:88882:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481660928 t103079215115 from 192.168.203.4@tcp req@ffff9c2ae4b36a00 x1869759481660928/t0(103079215115) o10->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 440/0 e 0 to 0 dl 1783144323 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144312.874413:0:88882:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783144312.874426:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144312.874428:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000020:00080000:1.0:1783144312.874431:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144312.874433:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000100:00100000:0.0:1783144312.879446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144312.879547:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665792 00000100:00100000:2.0:1783144312.879557:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665792 00000100:00100000:2.0:1783144312.879615:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1103 00000100:00100000:2.0:1783144312.879625:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+11:2402:x1869759481665792:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1783144312.879649:0:66947:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2ae4e9d180 x1869759481665792/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 328/0 e 0 to 0 dl 1783144323 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144312.879664:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+11:2402:x1869759481665792:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 43us (229us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144312.879671:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1103 00000020:00080000:1.0:1783144312.879753:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144312.879758:0:88882:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215116 00010000:00080000:1.0:1783144312.879761:0:88882:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1783144312.879764:0:88882:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144312.879770:0:88882:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783144312.879772:0:88882:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783144312.879779:0:88882:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2ae4e9d180 x1869759481665792/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 328/0 e 0 to 0 dl 1783144323 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783144312.879795:0:88882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144312.879819:0:88882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 2/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a65 expref: -99 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.879845:0:88882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 12 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.879859:0:88882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 12 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.879882:0:88882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47de00, rc 0) 00010000:00080000:1.0:1783144312.879943:0:88882:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1783144312.879953:0:88882:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1783144312.883198:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144312.883361:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665920 00000100:00100000:3.0:1783144312.883370:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665920 00000100:00100000:3.0:1783144312.883420:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 777 00000100:00100000:3.0:1783144312.883430:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+12:2402:x1869759481665920:12345-192.168.203.4@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1783144312.883446:0:66112:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2ae4ea2a00 x1869759481665920/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 224/0 e 0 to 0 dl 1783144323 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144312.883941:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+12:2402:x1869759481665920:12345-192.168.203.4@tcp:400:ptlrpcd_rcv.0 Request processed in 511us (748us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144312.883949:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 777 00010000:00080000:1.0:1783144312.886587:0:88882:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1783144312.886711:0:88882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:2.0:1783144312.891569:0:88850:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:2.0:1783144312.891579:0:88850:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783144312.891603:0:88850:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215115 is committed 00000001:00080000:0.0:1783144312.891774:0:88882:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1783144312.891816:0:88882:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1783144312.891831:0:88882:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2af9ef5c00 x1869759501301888/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:423/0 lens 224/0 e 0 to 0 dl 1783144323 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783144312.891960:0:88882:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.203.4@tcp: req@ffff9c2ae4ea2a00 x1869759481665920/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 224/0 e 0 to 0 dl 1783144323 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1783144312.892017:0:88882:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1783144312.892022:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783144312.892031:0:3647:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2afaba5880 x1869759501301888/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144328 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144312.892041:0:3647:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2afaba5880 x1869759501301888/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144328 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144312.892049:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144312.892067:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1783144312.892073:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a1b5429b): req@ffff9c29c3c26d80 x1869759501286016/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144308 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144312.892088:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501301888:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783144312.892162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.893105:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501286016 00000100:00100000:0.0:1783144312.893112:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501286016 00000100:00100000:0.0:1783144312.893166:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:2.0:1783144312.893171:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501302016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144312.893179:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501286016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783144312.893219:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445007360 avail 1298767872 00000100:00100000:2.0:1783144312.893223:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.893271:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501286016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144312.893292:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501286016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144312.893970:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:0.0:1783144312.893986:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302016 00000100:00100000:0.0:1783144312.893990:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302016 00000100:00100000:0.0:1783144312.894019:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1783144312.894025:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501302016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783144312.894039:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445007360 avail 1298767872 00000100:00100000:0.0:1783144312.894072:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501302016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144312.894077:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1783144312.894112:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501302016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783144312.895308:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895322:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895333:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895340:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144312.895348:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895357:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895376:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2afa089400) 00010000:00010000:1.0:1783144312.895380:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144312.895385:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895395:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6400/0xad8e53a423047cb4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895424:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895451:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895458:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895463:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144312.895466:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895476:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895486:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:1.0:1783144312.895492:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144312.895496:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.895502:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423047cc2 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144312.896085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144312.896127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144312.896159:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144312.896262:0:66127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481662080 00000100:00100000:3.0:1783144312.896271:0:66127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481662080 00002000:00100000:3.0:1783144312.896355:0:66127:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c2aee581c00 x1869759481662080/t0(0) o4->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 496/0 e 0 to 0 dl 1783144323 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783144312.896366:0:66127:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2aee581c00 with x1869759481662080 00002000:00010000:3.0:1783144312.896374:0:66127:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 7 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144312.896416:0:66127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1783144312.896427:0:66127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:0:x1869759481662080:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:3.0:1783144312.896902:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481662208 00000100:00100000:3.0:1783144312.896907:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481662208 00000100:00100000:3.0:1783144312.896935:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481665664 00000100:00100000:3.0:1783144312.896938:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481665664 00000100:00100000:3.0:1783144312.896960:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1104 00000100:00100000:3.0:1783144312.896968:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:0:x1869759481662208:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:3.0:1783144312.897020:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1105 00000100:00100000:3.0:1783144312.897028:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+11:68072:x1869759481665664:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144312.897038:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144312.897058:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a8f expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.897115:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.897128:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.897149:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144312.897189:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144312.897193:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144312.897235:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.897358:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a423047cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a8f expref: 13 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.897375:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a8f expref: 12 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.897383:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae0bf0400) 00010000:00010000:3.0:1783144312.897386:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144312.897389:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0a00, rc 0) 00000100:00100000:3.0:1783144312.897446:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+12:68072:x1869759481665664:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 418us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144312.897454:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1105 00000100:00100000:2.0:1783144312.901931:0:66127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:cace81e7-a6f2-4d37-b197-caf34583781c+11:0:x1869759481662080:12345-192.168.203.4@tcp:4:dd.0 Request processed in 5493us (5789us total) trans 107374182401 rc 0/0 00000100:00100000:2.0:1783144312.901949:0:66127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:2.0:1783144312.901963:0:66127:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c2aee581c00 x1869759481662080/t107374182401(0) o4->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:423/0 lens 496/448 e 0 to 0 dl 1783144323 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144312.901974:0:66127:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2aee581c00 with x1869759481662080 00002000:00010000:2.0:1783144312.901983:0:66127:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 11 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144312.904291:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144312.904366:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666048 00000100:00100000:3.0:1783144312.904375:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666048 00000100:00100000:3.0:1783144312.904424:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1106 00000100:00100000:3.0:1783144312.904433:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:68072:x1869759481666048:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1783144312.904461:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1445007360 avail 1298767872 00000100:00100000:3.0:1783144312.904520:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:68072:x1869759481666048:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144312.904543:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1106 00000001:00080000:3.0:1783144312.908398:0:88850:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182401 is committed 00000100:00100000:1.0:1783144312.908777:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+8:0:x1869759481662208:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 11803us (12689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144312.908791:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1104 00000100:00100000:2.0:1783144312.910171:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144312.910237:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666176 00000100:00100000:3.0:1783144312.910247:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666176 00000100:00080000:2.0:1783144312.910355:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144312.910416:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1107 00000100:00100000:3.0:1783144312.910427:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:68072:x1869759481666176:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1783144312.910452:0:66114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144312.910503:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:68072:x1869759481666176:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144312.910509:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1107 00000004:00000080:0.0:1783144312.911014:0:88882:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc1628868fe10 00100000:10000000:0.0:1783144312.911024:0:88882:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1783144312.911693:0:88870:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:1.0:1783144312.911773:0:88870:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88870:1869759501302144:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783144312.911834:0:88870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144312.911865:0:88870:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad1388240 going to sleep for 11 seconds 00000100:00100000:1.0:1783144312.911887:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302144 00000100:00100000:1.0:1783144312.911900:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302144 00000100:00100000:1.0:1783144312.911943:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941 00000100:00100000:1.0:1783144312.911954:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:88870:x1869759501302144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783144312.911980:0:26143:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -127 00002000:02000040:1.0:1783144312.911986:0:26143:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1793) 00000004:00080000:2.0:1783144312.912255:0:88868:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:2.0:1783144312.912276:0:88868:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88868:1869759501302272:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783144312.912375:0:88868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144312.912424:0:88868:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa8349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144312.912462:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302272 00000100:00100000:3.0:1783144312.912466:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302272 00000100:00100000:3.0:1783144312.912528:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4942 00000100:00100000:3.0:1783144312.912537:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:88868:x1869759501302272:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783144312.912550:0:26141:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -677 00002000:02000040:3.0:1783144312.912554:0:26141:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1793) 00002000:00010000:0.0:1783144312.924626:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.924639:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924672:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.924676:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.924682:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924698:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924708:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924716:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924756:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.924856:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.924862:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924869:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.924872:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.924876:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924884:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924902:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924909:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924925:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144312.924934:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144312.924940:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924947:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.924952:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924973:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924989:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.924997:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689236b0/0xad8e53a423047cde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925014:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.925023:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925030:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.925033:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925041:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925051:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925059:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a19414f/0xad8e53a423047ce5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925072:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925074:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925075:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.925116:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.925122:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925130:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.925133:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.925136:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925155:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925162:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925170:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925184:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144312.925192:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.925196:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925203:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.925216:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925225:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925235:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925243:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e810951/0xad8e53a423047cec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925261:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925262:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925264:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.925317:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.925322:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925330:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.925333:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.925337:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925346:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925353:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925360:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925373:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144312.925380:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.925384:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925402:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.925406:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925413:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925423:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925430:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea48e0a5/0xad8e53a423047cf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925443:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925444:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925446:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.925483:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.925488:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925496:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.925499:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.925503:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925511:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925524:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925530:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925542:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144312.925549:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.925553:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925559:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.925562:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925569:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925579:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925586:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f8ca745/0xad8e53a423047cfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925598:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925604:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925606:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.925642:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.925647:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925655:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.925658:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.925661:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925670:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925678:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925685:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925696:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144312.925702:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.925705:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925711:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.925715:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925752:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925762:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925769:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a6ab7ec/0xad8e53a423047d01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925782:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925783:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925785:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.925824:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.925830:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925837:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.925840:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.925844:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925853:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925860:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925873:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925887:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144312.925894:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.925898:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925905:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.925908:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925916:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925926:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925933:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5ec59f7/0xad8e53a423047d08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.925946:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925948:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.925950:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.926268:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.926467:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.926477:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926485:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.926488:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.926492:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926501:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926508:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926515:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926530:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.926567:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.926573:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926577:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.926584:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.926587:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926589:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.926597:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926603:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.926609:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926613:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926622:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926631:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926639:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.926641:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926661:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf57889/0xad8e53a423047d0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926679:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.926687:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926695:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.926705:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926714:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926745:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.926754:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.926756:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.926792:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783144312.926798:0:26143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d53103b/0xad8e53a423047d16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.928384:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.929121:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.929130:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929143:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.929147:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.929152:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929163:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929172:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929195:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929221:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144312.929232:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.929238:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929246:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.929250:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929260:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929274:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929282:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f02dad2/0xad8e53a423047d1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929301:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.929303:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.929305:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.929318:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.929368:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.929380:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929388:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.929392:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.929396:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929406:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929414:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929420:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929538:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.929581:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.929586:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929593:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.929596:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.929600:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929608:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929622:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929629:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929650:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783144312.929686:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.929691:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929699:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.929702:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.929705:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929714:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929740:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929748:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.929762:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144312.929771:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929776:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144312.929785:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.929790:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.929800:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.929814:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144312.929816:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.929826:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.929828:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423047d24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929835:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.929843:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.929852:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.929863:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144312.929863:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.929869:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929876:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.929883:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.929889:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929890:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929917:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144312.929923:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144312.929927:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929934:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.929943:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929951:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929961:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929967:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbd70636/0xad8e53a423047d32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929980:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.929984:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.929990:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.929993:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930000:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930009:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930016:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070ce28cd/0xad8e53a423047d39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.930024:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930041:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.930045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.930046:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.930059:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d1d5842/0xad8e53a423047d2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.930079:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.930081:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.930083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.930088:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.930090:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.930095:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930103:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.930107:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.930110:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930119:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930127:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930133:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930313:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.930352:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.930357:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930374:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.930377:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.930381:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930390:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930399:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.930405:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931226:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144312.931234:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931242:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.931246:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931255:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931267:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931274:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f92498fb/0xad8e53a423047d40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931348:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144312.931352:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931359:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.931362:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931377:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931388:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.931395:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.931397:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.931398:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.932592:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783144312.932600:0:26143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d58b1a/0xad8e53a423047d47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144312.932691:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.932697:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932707:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.932711:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.932716:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932746:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.932765:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932773:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932781:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932805:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.932845:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.932851:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932859:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.932862:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.932866:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932875:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932880:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144312.932884:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932888:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932907:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932928:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.932932:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.932933:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932946:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932958:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932966:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af429d7/0xad8e53a423047d4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.932983:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1783144312.932985:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.932988:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.932993:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933002:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.933009:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.933013:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933014:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.933023:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933028:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933038:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933044:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933048:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933060:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933075:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3ebe81a/0xad8e53a423047d55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933083:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.933092:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.933097:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933105:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.933109:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933118:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144312.933119:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.933130:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933137:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933154:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.933156:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf90e6fe/0xad8e53a423047d5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933159:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.933168:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933175:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.933178:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.933179:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.933181:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.933190:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.933191:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933422:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.933442:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144312.934012:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144312.934019:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.934028:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.934032:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.934040:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.934051:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.934059:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ebf124c/0xad8e53a423047d63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.934091:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.934092:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.934094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.934108:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.934824:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783144312.935955:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000100:00100000:2.0:1783144312.935970:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00000080:1.0:1783144312.935973:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c29c340c000/cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:1.0:1783144312.935996:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144312.936015:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c340c000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0001 00000100:00100000:3.0:1783144312.936041:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666304 00000100:00100000:3.0:1783144312.936052:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666304 00000020:00000080:1.0:1783144312.936063:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c340c800 for lustre-OST0001 00000100:00100000:3.0:1783144312.936092:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4943 00000100:00100000:3.0:1783144312.936100:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1869759481666304:12345-192.168.203.4@tcp:8:lfs.0 00002000:00010000:1.0:1783144312.936102:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.936111:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.936124:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.936128:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.936133:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1783144312.936134:0:8602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t0 exp 0000000000000000 cur 2847 last 0 00010000:00010000:1.0:1783144312.936152:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.936161:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144312.936162:0:8602:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a423047d71 00010000:00010000:1.0:1783144312.936172:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1783144312.936175:0:8602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cace81e7-a6f2-4d37-b197-caf34583781c/ffff9c2af5c48800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783144312.936198:0:8602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00010000:1.0:1783144312.936215:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783144312.936271:0:8602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00010000:2.0:1783144312.936343:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144312.936350:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.936358:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d000 already unused, calling callback (ffffffffc0c0bce0) 00000100:00080000:3.0:1783144312.936363:0:8602:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4a800 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1783144312.936364:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.936376:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.936389:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.936395:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423047d6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.936412:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.936414:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.936415:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144312.936438:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481666304:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 330us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144312.936447:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4943 00002000:00010000:1.0:1783144312.936604:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.936611:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.936631:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.936634:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.936639:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.936648:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.936656:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.936663:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937076:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.937089:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.937098:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937107:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.937111:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.937115:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937126:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937145:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937152:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937174:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783144312.937225:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.937231:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144312.937233:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937237:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937245:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.937251:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144312.937252:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.937257:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937259:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937346:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937370:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937377:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a423047d78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937391:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937392:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.937398:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937409:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937411:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.937417:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937424:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937429:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937441:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937455:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b920c333/0xad8e53a423047d7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937459:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.937470:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.937474:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937487:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.937491:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937498:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937509:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144312.937511:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.937522:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab42ea08/0xad8e53a423047d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937523:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937545:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.937548:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.937549:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.937552:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.937555:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937556:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.937567:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937575:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937582:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937609:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.937647:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.937653:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937660:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.937671:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.937675:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937684:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937692:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937699:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937709:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783144312.937762:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.937768:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937776:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.937779:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.937783:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937792:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.937799:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937844:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144312.937849:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937857:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.937860:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937869:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937886:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937893:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6e258ec/0xad8e53a423047d8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937908:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.937911:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937917:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.937920:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937927:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937936:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937943:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d15eddee/0xad8e53a423047d94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.937953:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144312.938056:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938066:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.938100:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.938105:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938113:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.938116:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.938120:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938129:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938136:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938143:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938150:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783144312.938179:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.938184:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938196:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.938199:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.938203:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938223:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938231:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938238:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938246:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783144312.938338:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.938344:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938352:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.938355:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.938359:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938367:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938385:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938392:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938400:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783144312.938440:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.938445:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938453:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.938455:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.938459:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938468:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938546:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783144312.938555:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938562:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.938566:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938574:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938584:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938591:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000749585c6/0xad8e53a423047d9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938629:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144312.938633:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938639:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3cc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.938642:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938650:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938668:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938675:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007037445c/0xad8e53a423047da2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938686:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144312.938689:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938695:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.938697:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938704:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.938713:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938779:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938786:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938805:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144312.938842:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd277147/0xad8e53a423047da9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144312.938895:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.938901:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938909:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.938912:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.938916:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938924:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938932:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938939:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.938946:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144312.939013:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144312.939019:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939030:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.939034:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939042:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939052:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939060:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b95ddd9a/0xad8e53a423047db0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939073:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144312.939076:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939082:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3ce00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.939085:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939092:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939101:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939113:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d050c6/0xad8e53a423047db7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939123:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.939126:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939132:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.939135:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939142:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939150:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939157:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000914e6147/0xad8e53a423047dbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.939166:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.939168:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.939170:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.939178:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144312.939241:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.939246:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939253:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.939261:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.939265:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939274:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939341:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939349:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939590:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144312.939628:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144312.939633:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939640:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:0.0:1783144312.939643:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144312.939647:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939655:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939663:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144312.939675:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940100:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144312.940110:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940118:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.940121:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940129:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940139:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940146:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004259800e/0xad8e53a423047dc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940159:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.940162:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940168:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3de00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.940171:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940178:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940197:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940204:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.940217:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.940219:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144312.940263:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.940268:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940276:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.940288:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.940292:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940301:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940308:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940316:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940327:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144312.940363:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.940372:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940379:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.940382:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.940386:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940394:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940401:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940409:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940420:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144312.940427:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144312.940430:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940448:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.940451:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940459:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940475:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940614:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a423047dd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940628:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.940631:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940637:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.940640:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940648:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940658:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940665:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000832cb507/0xad8e53a423047dda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940675:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.940676:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.940683:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144312.940736:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.940742:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940749:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.940752:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.940756:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940764:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940771:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940778:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940790:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.940796:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.940799:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940805:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.940808:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940825:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940835:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940841:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcac911f/0xad8e53a423047de1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940853:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.940854:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.940856:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144312.940890:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.940896:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940903:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.940906:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.940909:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940917:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940924:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940937:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.940950:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.940956:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.940960:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941026:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.941029:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941037:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941048:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941056:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009389a432/0xad8e53a423047de8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941068:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941070:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941071:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144312.941108:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.941118:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941126:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.941128:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.941132:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941141:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941148:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941155:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941167:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.941173:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.941177:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941184:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.941187:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941195:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941222:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941229:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5e155de/0xad8e53a423047def lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941244:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941246:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941248:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144312.941290:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.941296:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941303:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.941306:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.941311:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941320:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941327:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941335:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941357:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.941363:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.941367:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941373:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.941376:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941383:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941393:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941400:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000203c5214/0xad8e53a423047df6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941412:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941414:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941415:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144312.941449:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.941454:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941461:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.941469:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.941473:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941488:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941496:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941503:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941514:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144312.941521:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.941525:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941532:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.941536:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941544:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941554:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941571:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000444787ab/0xad8e53a423047dfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941573:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.941581:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941589:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941592:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.941594:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144312.941634:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.941639:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941646:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.941649:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.941653:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941661:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941669:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941675:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941692:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144312.941751:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.941757:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941763:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144312.941765:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:2.0:1783144312.941770:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941770:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.941779:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941785:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.941791:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941795:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941804:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941809:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941818:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941820:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941839:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027beca45/0xad8e53a423047e04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941847:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144312.941855:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144312.941859:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941865:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.941868:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144312.941886:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144312.941887:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941899:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941904:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941913:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:2.0:1783144312.941915:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080845839/0xad8e53a423047e0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.941918:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.941928:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.941934:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.941936:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.941938:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.941943:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.942100:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144312.942282:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.942293:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.942300:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783144312.942399:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:3.0:1783144312.942406:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:3.0:1783144312.942409:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c29c340e800/cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:3.0:1783144312.942424:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783144312.942499:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144312.942506:0:26143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4cee29a/0xad8e53a423047dcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.942538:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144312.942579:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.942584:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.942592:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.942595:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.942599:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.942608:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.942616:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.942633:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.945931:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144312.945945:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.945958:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.945962:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.945973:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.945993:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.946014:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064c8e8ff/0xad8e53a423047e12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.946032:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144312.946041:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.946041:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.946045:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.946048:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.946054:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144312.946058:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783144312.946064:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c340e800/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0000 00010000:00010000:3.0:1783144312.946067:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.946080:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.946088:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.946091:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.946094:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144312.946114:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c340a800 for lustre-OST0000 00000100:00100000:3.0:1783144312.946164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1783144312.946278:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783144312.946284:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce75c51/0xad8e53a423047e19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144312.946389:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.946395:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946406:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.946410:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.946416:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946428:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946437:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946446:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946470:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144312.946511:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.946516:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946524:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.946527:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.946532:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946542:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946551:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946558:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946571:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783144312.946604:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.946609:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946616:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.946624:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.946628:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946636:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946643:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946649:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946659:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783144312.946694:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.946698:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946705:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.946708:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.946712:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946735:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946744:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946757:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946766:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783144312.946800:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.946805:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946812:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.946815:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.946819:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946828:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946836:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946844:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946851:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783144312.946881:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.946886:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946898:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.946901:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.946905:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946914:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946922:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946930:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946938:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783144312.946970:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.946975:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946982:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.946985:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.946989:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.946997:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947016:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947023:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947032:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783144312.947065:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947070:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947078:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947081:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947085:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947094:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947102:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947109:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947129:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783144312.947161:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947165:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947173:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947175:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947179:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947188:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947196:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947204:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947226:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1783144312.947260:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666432 00002000:00010000:1.0:1783144312.947262:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947268:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144312.947274:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666432 00010000:00010000:1.0:1783144312.947277:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947286:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947291:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947302:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947310:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947318:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947328:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:2.0:1783144312.947345:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1588 00000100:00100000:2.0:1783144312.947363:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:68072:x1869759481666432:12345-192.168.203.4@tcp:13:lfs.0 00002000:00010000:1.0:1783144312.947363:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947373:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947381:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947384:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947388:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1783144312.947395:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00010000:00010000:1.0:1783144312.947398:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947408:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947421:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947429:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000100:00100000:2.0:1783144312.947465:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:68072:x1869759481666432:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 106us (1299us total) trans 0 rc 0/0 00002000:00010000:1.0:1783144312.947467:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947477:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947485:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947488:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947492:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947500:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947508:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947516:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947524:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00000100:00100000:2.0:1783144312.947540:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1588 00002000:00010000:1.0:1783144312.947555:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947562:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947574:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=2847s v=(0 0) 00000100:00080000:2.0:1783144312.947576:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783144312.947578:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947584:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947593:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947601:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947609:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947619:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1783144312.947652:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947657:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947664:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947667:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947671:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947680:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947698:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947705:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947713:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1783144312.947761:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947765:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947773:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947776:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947780:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947790:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947799:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947807:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947827:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1783144312.947828:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:2.0:1783144312.947837:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947850:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.947855:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144312.947864:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.947874:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947881:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947885:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.947894:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.947899:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947901:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947920:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947924:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fba7c50/0xad8e53a423047e20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947937:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947946:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947951:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1783144312.947956:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.947956:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:2.0:1783144312.947966:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.947969:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947978:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.947988:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144312.947993:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144312.947996:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e58085d/0xad8e53a423047e27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948000:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948012:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.948022:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144312.948024:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1783144312.948028:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948029:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948049:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144312.948051:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948053:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948074:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948075:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948099:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948102:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948115:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:2.0:1783144312.948117:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab8c17b4/0xad8e53a423047e2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948131:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1783144312.948136:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948142:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948146:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144312.948153:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.948161:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948171:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.948174:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.948179:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948187:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948195:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948223:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948232:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1783144312.948266:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144312.948270:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948278:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=2847s v=(0 0) 00010000:00010000:1.0:1783144312.948280:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144312.948283:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948292:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948299:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948307:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144312.948314:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00010000:00010000:2.0:1783144312.948534:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948551:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948560:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005fe3543/0xad8e53a423047e35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948577:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1783144312.948580:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948588:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948592:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948601:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948611:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948620:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd104b9/0xad8e53a423047e3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948643:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1783144312.948647:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948654:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948657:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948665:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948675:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948683:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b4ec625/0xad8e53a423047e43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948696:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1783144312.948700:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948708:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948711:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948748:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948761:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948769:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074d8c8b0/0xad8e53a423047e4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948784:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1783144312.948787:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948795:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948799:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948807:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948818:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948827:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423047e51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948853:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1783144312.948858:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948865:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948868:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948877:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948889:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948899:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423047e58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948912:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1783144312.948916:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948923:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948927:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948947:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948959:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948967:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a423047e5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948980:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783144312.948984:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.948991:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.948993:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949001:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949010:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949018:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423047e66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949039:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783144312.949043:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949050:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.949053:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949061:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949073:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949080:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a423047e6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949094:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783144312.949099:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949106:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.949109:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949129:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949141:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949149:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423047e74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.949162:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783144312.949329:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783144312.949336:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949344:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144312.949347:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949355:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949366:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949374:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423047e82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949388:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783144312.949391:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949398:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144312.949401:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949408:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949425:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949433:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423047e89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949445:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783144312.949448:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949454:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144312.949457:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949464:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949472:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949478:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423047e90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949488:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144312.949492:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949505:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144312.949508:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949516:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949526:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949532:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423047e97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949544:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144312.949547:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949553:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144312.949556:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949563:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949572:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949585:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423047e9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144312.949598:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.949600:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.949602:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.949608:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144312.949613:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.950339:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.950351:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144312.950355:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.950365:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.950378:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.950386:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047e7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144312.950423:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.950426:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144312.950429:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144312.951299:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144312.951769:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666560 00000100:00100000:3.0:1783144312.951779:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666560 00000100:00100000:3.0:1783144312.951821:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4944 00000100:00100000:3.0:1783144312.951829:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1869759481666560:12345-192.168.203.4@tcp:8:lfs.0 00010000:00080000:3.0:1783144312.951865:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp t0 exp 0000000000000000 cur 2847 last 0 00000020:00000080:3.0:1783144312.951894:0:8438:0:(genops.c:1406:class_connect()) connect: client cace81e7-a6f2-4d37-b197-caf34583781c, cookie 0xad8e53a423047ea5 00002000:00100000:3.0:1783144312.951904:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cace81e7-a6f2-4d37-b197-caf34583781c/ffff9c2af5c4c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783144312.951920:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783144312.951976:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783144312.952001:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144312.952061:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481666560:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 231us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144312.952068:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4944 00002000:00080000:0.0:1783144312.954105:0:26143:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:0.0:1783144312.954196:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:88870:x1869759501302144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 42241us (42367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144312.954217:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941 00000100:00100000:2.0:1783144312.954274:0:88870:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88870:1869759501302144:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783144312.954291:0:88870:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:2.0:1783144312.954374:0:88870:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88870:1869759501302528:0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783144312.954406:0:26141:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:2.0:1783144312.954413:0:88870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144312.954442:0:88870:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144312.954459:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:88868:x1869759501302272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 41922us (42081us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144312.954464:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302528 00000100:00100000:2.0:1783144312.954470:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302528 00000100:00100000:1.0:1783144312.954479:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4942 00000100:00100000:2.0:1783144312.954517:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4945 00000100:00100000:2.0:1783144312.954525:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:88870:x1869759501302528:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783144312.954552:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501302400:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1783144312.954557:0:26146:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00000100:00100000:3.0:1783144312.954589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.954903:0:88868:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88868:1869759501302272:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783144312.954912:0:88868:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:3.0:1783144312.954969:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144312.955007:0:88868:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88868:1869759501302784:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783144312.955038:0:88868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.955057:0:88868:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3a3180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144312.955074:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302784 00000100:00100000:0.0:1783144312.955078:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302784 00000100:00100000:0.0:1783144312.955109:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4946 00000100:00100000:0.0:1783144312.955117:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:88868:x1869759501302784:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783144312.955140:0:26152:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00000100:00100000:0.0:1783144312.956817:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:88868:x1869759501302784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1699us (1776us total) trans 4294968825 rc 0/0 00000100:00100000:0.0:1783144312.956825:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4946 00000100:00100000:0.0:1783144312.956870:0:88868:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88868:1869759501302784:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783144312.956881:0:88868:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00000100:00100000:3.0:1783144312.957149:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501302656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144312.957173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144312.957335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144312.957445:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302400 00000100:00100000:1.0:1783144312.957451:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302400 00000100:00100000:1.0:1783144312.957490:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302656 00000100:00100000:1.0:1783144312.957494:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302656 00000100:00100000:1.0:1783144312.957505:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666688 00000100:00100000:1.0:1783144312.957507:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666688 00000100:00100000:1.0:1783144312.957531:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1783144312.957538:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501302400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783144312.957554:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144312.957591:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501302400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (3001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144312.957597:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1783144312.957610:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1783144312.957616:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501302656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144312.957624:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144312.957646:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501302656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144312.957652:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1783144312.957663:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1591 00000100:00100000:1.0:1783144312.957669:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:68072:x1869759481666688:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144312.957678:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144312.957713:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:68072:x1869759481666688:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144312.957740:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1591 00000100:00100000:2.0:1783144312.958376:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:88870:x1869759501302528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3848us (3960us total) trans 4294968825 rc 0/0 00000100:00100000:2.0:1783144312.958385:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4945 00000100:00080000:2.0:1783144312.958416:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144312.958778:0:88870:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88870:1869759501302528:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783144312.958799:0:88870:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00000100:00100000:2.0:1783144312.965419:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501302656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144312.965441:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501302400:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1783144313.360549:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783144313.444303:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144313.444404:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666816 00000100:00100000:2.0:1783144313.444415:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666816 00000100:00100000:2.0:1783144313.444483:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:2.0:1783144313.444495:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481666816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144313.444588:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481666816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144313.444597:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00010000:00010000:3.0:1783144313.809691:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144314.830008:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144315.405997:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144315.406019:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aca303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501302912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144315.406080:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144315.406175:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501302912 00000100:00100000:3.0:1783144315.406183:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501302912 00000100:00100000:3.0:1783144315.406261:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:3.0:1783144315.406270:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501302912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144315.406297:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144315.406339:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501302912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144315.406345:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:3.0:1783144315.406391:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aca303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501302912:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783144315.406460:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144315.409495:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501303040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144315.409548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144315.410365:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303040 00000100:00100000:0.0:1783144315.410373:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303040 00000100:00100000:0.0:1783144315.410436:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:0.0:1783144315.410447:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501303040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144315.410473:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144315.410526:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501303040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144315.410533:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:2.0:1783144315.410624:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501303040:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783144315.410647:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783144315.853940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144315.970403:0:89430:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:2.0:1783144316.877822:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783144316.908677:0:89478:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783144317.902226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144317.965920:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c615b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501303168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144317.965947:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501303424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144317.966080:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501303296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144317.966261:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501303552:0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967110:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144317.967149:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501303936:0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967188:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144317.967205:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501304448:0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967226:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144317.967243:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501304960:0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967266:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144317.967317:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303424 00000100:00100000:3.0:1783144317.967324:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303424 00000100:00100000:3.0:1783144317.967365:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:3.0:1783144317.967373:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501303424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783144317.967405:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144317.967448:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501303424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144317.967456:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:3.0:1783144317.967477:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304448 00000100:00100000:3.0:1783144317.967480:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304448 00000100:00100000:3.0:1783144317.967510:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304960 00000100:00100000:3.0:1783144317.967513:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304960 00000100:00100000:3.0:1783144317.967531:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:3.0:1783144317.967538:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501304448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967568:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501304448:12345-0@lo:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144317.967575:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:3.0:1783144317.967585:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1783144317.967590:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501304960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967614:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501304960:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144317.967621:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1783144317.967656:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501304448:0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967666:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501304960:0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967679:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501303424:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1783144317.967740:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144317.967751:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144317.967760:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303936 00000100:00100000:3.0:1783144317.967764:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303936 00000100:00100000:3.0:1783144317.967793:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1783144317.967800:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501303936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144317.967832:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501303936:12345-0@lo:400:kworker.0 Request processed in 33us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144317.967838:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00080000:3.0:1783144317.967853:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144317.967867:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501303936:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144317.968226:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144317.968231:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501303680:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144317.968287:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501304192:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968303:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501303808:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968307:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144317.968322:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501304704:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144317.968341:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501304320:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144317.968355:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501305216:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968358:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144317.968376:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501304832:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144317.968395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144317.968413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144317.968437:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501304064:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968450:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303296 00000100:00100000:1.0:1783144317.968455:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303296 00000100:00100000:2.0:1783144317.968475:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303680 00000100:00100000:2.0:1783144317.968479:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303680 00000100:00100000:1.0:1783144317.968480:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1783144317.968486:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501303296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144317.968505:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303808 00000100:00100000:2.0:1783144317.968508:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303808 00002000:00000024:1.0:1783144317.968514:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144317.968523:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304704 00000100:00100000:2.0:1783144317.968525:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304704 00000100:00100000:2.0:1783144317.968535:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501305216 00000100:00100000:2.0:1783144317.968538:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501305216 00000100:00100000:1.0:1783144317.968547:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501303296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144317.968549:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1783144317.968554:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:2.0:1783144317.968555:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501303680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968572:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303168 00000100:00100000:1.0:1783144317.968575:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303168 00000100:00100000:2.0:1783144317.968587:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501303680:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144317.968592:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304192 00000100:00100000:1.0:1783144317.968599:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304192 00000100:00100000:2.0:1783144317.968601:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1783144317.968613:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304832 00000100:00100000:2.0:1783144317.968615:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1783144317.968615:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304832 00000100:00100000:2.0:1783144317.968621:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501303808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968631:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:0.0:1783144317.968634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144317.968640:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501303168:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144317.968656:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501303808:12345-0@lo:400:kworker.0 Request processed in 36us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144317.968658:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501304576:0@lo:13:osp-pre-1-0.0 00000004:00000024:1.0:1783144317.968659:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445003264 avail 1298763776 00000100:00100000:2.0:1783144317.968666:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1783144317.968678:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304064 00000100:00100000:2.0:1783144317.968681:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304064 00000100:00100000:1.0:1783144317.968693:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501303168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144317.968697:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1783144317.968702:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:0.0:1783144317.968707:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144317.968708:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501304704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968713:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1783144317.968718:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501304192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144317.968756:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501305088:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968763:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501304704:12345-0@lo:400:kworker.0 Request processed in 57us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144317.968763:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501304192:12345-0@lo:400:kworker.0 Request processed in 42us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144317.968771:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1783144317.968771:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:2.0:1783144317.968788:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1783144317.968788:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1783144317.968791:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144317.968798:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501304832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968806:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501305216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.968830:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501305216:12345-0@lo:400:kworker.0 Request processed in 36us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144317.968830:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501304832:12345-0@lo:400:kworker.0 Request processed in 35us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144317.968833:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304576 00000100:00100000:2.0:1783144317.968839:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1783144317.968839:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1783144317.968840:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304576 00000100:00100000:2.0:1783144317.968855:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1783144317.968863:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501304064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144317.968876:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:1.0:1783144317.968886:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501303296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144317.968895:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501304576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144317.968900:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501303808:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.968911:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501304832:0@lo:400:kworker.0 00002000:00000024:0.0:1783144317.968913:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144317.968958:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501304576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144317.968959:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501304320 00000100:00100000:1.0:1783144317.968965:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501304320 00000100:00100000:2.0:1783144317.968970:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501304064:12345-0@lo:400:kworker.0 Request processed in 107us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144317.968970:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:2.0:1783144317.968981:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1783144317.968991:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501305088 00000100:00100000:1.0:1783144317.969000:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501305088 00000100:00100000:2.0:1783144317.969004:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501303552 00000100:00100000:2.0:1783144317.969007:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501303552 00000100:00100000:0.0:1783144317.969010:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501304064:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.969026:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:1.0:1783144317.969034:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501304320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144317.969037:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501304576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144317.969042:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783144317.969051:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501303552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.969072:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501304320:12345-0@lo:400:kworker.0 Request processed in 39us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144317.969079:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:2.0:1783144317.969087:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501303552:12345-0@lo:400:kworker.0 Request processed in 38us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144317.969088:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1783144317.969097:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783144317.969103:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501305088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.969112:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501304320:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.969133:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501303680:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.969144:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501304192:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.969147:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501303552:0@lo:400:kworker.0 00000100:00100000:2.0:1783144317.969153:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af9d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501304704:0@lo:400:kworker.0 00000100:00100000:1.0:1783144317.969168:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501305088:0@lo:400:kworker.0 00000100:00100000:0.0:1783144317.969180:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501305088:12345-0@lo:400:kworker.0 Request processed in 67us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144317.969190:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00080000:3.0:1783144317.969238:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144317.969243:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144317.969243:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501305216:0@lo:400:kworker.0 00000100:00080000:3.0:1783144317.969248:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144317.969251:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144317.969316:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c615b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501303168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144318.350155:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144318.350225:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481666944 00000100:00100000:1.0:1783144318.350235:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481666944 00000100:00100000:1.0:1783144318.350326:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1108 00000100:00100000:1.0:1783144318.350338:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+8:68541:x1869759481666944:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144318.350374:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445003264 avail 1298763776 00000100:00100000:1.0:1783144318.350444:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+8:68541:x1869759481666944:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144318.350451:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1108 00000100:00080000:3.0:1783144318.350615:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144318.352885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144318.353526:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481667072 00000100:00100000:2.0:1783144318.353535:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481667072 00000100:00100000:2.0:1783144318.353668:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1109 00000100:00100000:2.0:1783144318.353679:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:68541:x1869759481667072:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144318.353710:0:66112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144318.353824:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:68541:x1869759481667072:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 147us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144318.353832:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1109 00000100:00080000:3.0:1783144318.353882:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144318.361443:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144318.361572:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481667200 00000100:00100000:1.0:1783144318.361582:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481667200 00000100:00100000:1.0:1783144318.361685:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1596 00000100:00100000:1.0:1783144318.361696:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:68541:x1869759481667200:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144318.361761:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144318.361850:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:68541:x1869759481667200:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 156us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144318.361873:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1596 00000100:00080000:3.0:1783144318.362200:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144318.364355:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144318.364576:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481667328 00000100:00100000:3.0:1783144318.364584:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481667328 00000100:00100000:3.0:1783144318.364679:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1597 00000100:00100000:3.0:1783144318.364698:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:68541:x1869759481667328:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1783144318.364740:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144318.364811:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:68541:x1869759481667328:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 123us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144318.364819:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1597 00000100:00080000:0.0:1783144318.365071:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144318.385186:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144318.385387:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481667584 00000100:00100000:0.0:1783144318.385397:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481667584 00000100:00100000:0.0:1783144318.385453:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1110 00000100:00100000:0.0:1783144318.385462:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:68557:x1869759481667584:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1783144318.385482:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144318.385503:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423047eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a96 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385610:0:66114:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 9 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385628:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385654:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385665:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385773:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385778:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385783:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385786:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144318.385789:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385794:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385803:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:0.0:1783144318.385805:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144318.385808:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385812:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047eb3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385852:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423047eac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a96 expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385864:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae0bf0400) 00010000:00010000:0.0:1783144318.385865:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144318.385868:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423047eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a96 expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.385874:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d600, rc 0) 00000100:00100000:0.0:1783144318.385921:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+9:68557:x1869759481667584:12345-192.168.203.4@tcp:101:cat.0 Request processed in 460us (753us total) trans 107374182402 rc 301/301 00000100:00100000:0.0:1783144318.385928:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1110 00000100:00100000:2.0:1783144318.390501:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144318.390574:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481667712 00000100:00100000:0.0:1783144318.390582:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481667712 00000100:00100000:0.0:1783144318.390671:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1111 00000100:00100000:0.0:1783144318.390680:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+9:68557:x1869759481667712:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1783144318.390698:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144318.390712:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047ec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41a9d expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.390790:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.390805:0:66947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 10 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.390813:0:66947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 4/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.390847:0:66947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 10 pid: 88882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.390872:0:66947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 10 pid: 88882 timeout: 2952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144318.390884:0:66947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:66947:1869759501305344:192.168.203.4@tcp:104: 00000100:00100000:0.0:1783144318.390967:0:66947:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad1388780 going to sleep for 11 seconds 00000100:00100000:1.0:1783144318.393287:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144318.393784:0:66947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:66947:1869759501305344:192.168.203.4@tcp:104: 00010000:00010000:0.0:1783144318.393809:0:66947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144318.393906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481667840 00000100:00100000:2.0:1783144318.393913:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481667840 00010000:00010000:2.0:1783144318.393945:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 11 pid: 88882 timeout: 2952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144318.394042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2542 00000100:00100000:2.0:1783144318.394053:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cace81e7-a6f2-4d37-b197-caf34583781c+11:2403:x1869759481667840:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783144318.394069:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:2.0:1783144318.394089:0:6505:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:2.0:1783144318.394093:0:6505:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1783144289 00000004:00010000:2.0:1783144318.394095:0:6505:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1783144285 00000004:00010000:2.0:1783144318.394097:0:6505:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1783144289 00010000:00010000:2.0:1783144318.394103:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 11 pid: 88882 timeout: 2952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144318.394116:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 11 pid: 88882 timeout: 2952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144318.394142:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423047cc9 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a65 expref: 11 pid: 88882 timeout: 2952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144318.394158:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:2.0:1783144318.394163:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144318.394184:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144318.394189:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 4/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144318.394210:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144318.394229:0:66947:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.394248:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144318.394293:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144318.394312:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.394341:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047ec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a9d expref: 11 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.394361:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a9d expref: 10 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.394369:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:0.0:1783144318.394371:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783144318.394380:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3c000, rc 0) 00000100:00100000:2.0:1783144318.394577:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:2403:x1869759481667840:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 524us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144318.394577:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+10:68557:x1869759481667712:12345-192.168.203.4@tcp:101:cat.0 Request processed in 3899us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144318.394586:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2542 00000100:00100000:0.0:1783144318.394586:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1111 00000100:00100000:2.0:1783144318.398573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144318.398649:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481667968 00000100:00100000:0.0:1783144318.398659:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481667968 00000100:00100000:0.0:1783144318.398715:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1112 00000100:00100000:0.0:1783144318.398743:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+9:68557:x1869759481667968:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1783144318.398760:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144318.398776:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423047ecf lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41aa4 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.398821:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423047ecf lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aa4 expref: 10 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.398832:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423047ecf lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aa4 expref: 10 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.398845:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:0.0:1783144318.398847:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783144318.398849:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d600, rc 0) 00000100:00100000:0.0:1783144318.398891:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:68557:x1869759481667968:12345-192.168.203.4@tcp:101:cat.0 Request processed in 171us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144318.398896:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1112 00000100:00100000:3.0:1783144318.404617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144318.404673:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481668096 00000100:00100000:0.0:1783144318.404684:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481668096 00000100:00100000:0.0:1783144318.404891:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1113 00000100:00100000:0.0:1783144318.404904:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+10:2404:x1869759481668096:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1783144318.404949:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144318.404971:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047ed6 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41aab expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.405008:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047ed6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aab expref: 11 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144318.405046:0:81077:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:0.0:1783144318.405050:0:81077:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1783144289 -> 1783144289 00000004:00010000:0.0:1783144318.405061:0:81077:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1783144285 -> 1783144285 00000004:00010000:0.0:1783144318.405064:0:81077:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1783144289 -> 1783144289 00000004:00010000:0.0:1783144318.405067:0:81077:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:0.0:1783144318.405072:0:81077:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:0.0:1783144318.405080:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047ed6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aab expref: 11 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144318.405094:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2ae0bf0a00) 00010000:00010000:0.0:1783144318.405097:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783144318.405100:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d800, rc 0) 00000100:00100000:0.0:1783144318.405212:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+11:2404:x1869759481668096:12345-192.168.203.4@tcp:101:cat.0 Request processed in 307us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144318.405220:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1113 00000100:00100000:1.0:1783144318.407521:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144318.407583:0:66125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481668224 00000100:00100000:3.0:1783144318.407603:0:66125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481668224 00002000:00100000:3.0:1783144318.407660:0:66125:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c2aeff04a80 x1869759481668224/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:429/0 lens 488/0 e 0 to 0 dl 1783144329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783144318.407672:0:66125:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2aeff04a80 with x1869759481668224 00000100:00100000:3.0:1783144318.407717:0:66125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1783144318.407760:0:66125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+11:2403:x1869759481668224:12345-192.168.203.4@tcp:3:cat.0 00000100:00100000:2.0:1783144318.409118:0:66125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+11:2403:x1869759481668224:12345-192.168.203.4@tcp:3:cat.0 Request processed in 1350us (1670us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783144318.409128:0:66125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:2.0:1783144318.409143:0:66125:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c2aeff04a80 x1869759481668224/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:429/0 lens 488/4536 e 0 to 0 dl 1783144329 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144318.409151:0:66125:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2aeff04a80 with x1869759481668224 00000100:00100000:2.0:1783144318.412591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144318.413398:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481668480 00000100:00100000:3.0:1783144318.413408:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481668480 00000100:00100000:3.0:1783144318.413549:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:3.0:1783144318.413560:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:68557:x1869759481668480:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:3.0:1783144318.413834:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+12:68557:x1869759481668480:12345-192.168.203.4@tcp:35:cat.0 Request processed in 275us (1250us total) trans 107374182403 rc 0/0 00000100:00100000:3.0:1783144318.413842:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 220 00000001:00080000:1.0:1783144318.481574:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968825 is committed 00000001:00100000:1.0:1783144318.481590:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00080000:2.0:1783144318.488604:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968825 is committed 00000100:00100000:2.0:1783144318.562892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144318.563219:0:88857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481668608 00000100:00100000:0.0:1783144318.563229:0:88857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481668608 00000100:00100000:0.0:1783144318.563326:0:88857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:0.0:1783144318.563336:0:88857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2406:x1869759481668608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144318.563407:0:88857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2406:x1869759481668608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144318.563427:0:88857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00010000:00010000:3.0:1783144318.926534:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783144319.504368:0:88850:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182403 is committed 00010000:00010000:3.0:1783144319.949935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144320.526018:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501305472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144320.526097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144320.526259:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501305472 00000100:00100000:0.0:1783144320.526266:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501305472 00000100:00100000:0.0:1783144320.526360:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:0.0:1783144320.526370:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501305472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144320.526398:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144320.526439:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501305472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144320.526445:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:1.0:1783144320.527113:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501305472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144320.527680:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783144320.527691:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501305600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144320.527743:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144320.527904:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501305600 00000100:00100000:0.0:1783144320.527908:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501305600 00000100:00080000:3.0:1783144320.528264:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144320.528269:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144320.529002:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:0.0:1783144320.529015:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501305600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144320.529042:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144320.529097:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501305600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144320.529105:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:2.0:1783144320.529190:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501305600:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783144320.975074:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783144321.862519:0:89673:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:3.0:1783144321.997980:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144322.739435:0:89721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 01:52:02 (1783144322) 00000100:00100000:3.0:1783144322.805396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144322.805450:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481668736 00000100:00100000:2.0:1783144322.805519:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481668736 00000100:00100000:2.0:1783144322.805636:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1114 00000100:00100000:2.0:1783144322.805646:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:69279:x1869759481668736:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144322.805670:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144322.805689:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ab2 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805769:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805790:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805803:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805818:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805826:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805833:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805876:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805884:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805891:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805897:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805904:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144322.805908:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805915:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805934:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae0bf0400) 00010000:00010000:2.0:1783144322.805938:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144322.805943:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805950:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805963:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805971:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805977:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805983:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144322.805987:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.805994:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.806002:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2af71e9a00) 00010000:00010000:2.0:1783144322.806004:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144322.806008:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.806014:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047eeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.806053:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047edd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab2 expref: 11 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.806064:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae0bf0400) 00010000:00010000:2.0:1783144322.806067:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144322.806070:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab2 expref: 11 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144322.806080:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00e00, rc 0) 00000100:00100000:2.0:1783144322.806151:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:69279:x1869759481668736:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 505us (761us total) trans 0 rc 301/301 00000100:00100000:2.0:1783144322.806159:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1114 00000100:00080000:3.0:1783144322.806851:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144322.812994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144322.813233:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481668992 00000100:00100000:3.0:1783144322.813298:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481668992 00000100:00100000:3.0:1783144322.813395:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1115 00000100:00100000:3.0:1783144322.813415:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:69279:x1869759481668992:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144322.813435:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144322.813449:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783144322.813473:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423047cd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a8f expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.813490:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae0bf0400) 00010000:00010000:3.0:1783144322.813499:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144322.813513:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047ef2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ab9 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.813605:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.813618:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.813627:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.813639:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.813646:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.814208:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.814587:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.814597:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.814615:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144322.814625:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:3.0:1783144322.814648:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.814813:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.814820:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.814826:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144322.814831:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.815002:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.815014:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbc00) 00010000:00010000:3.0:1783144322.815017:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144322.815021:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.815026:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047ef9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144322.815036:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d87212eb reply state 00000000892b276c transno 107374182404 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.815058:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.815064:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2aee3dbf00) 00010000:00010000:3.0:1783144322.815066:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144322.815069:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144322.815096:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047ef2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.815111:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.815118:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2aee3db800) 00010000:00010000:3.0:1783144322.815120:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144322.815122:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f600, rc 0) 00000100:00100000:3.0:1783144322.815200:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+12:69279:x1869759481668992:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1796us (2214us total) trans 107374182404 rc 0/0 00000100:00100000:3.0:1783144322.815208:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1115 00000100:00100000:2.0:1783144322.819082:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144322.819344:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481669248 00000100:00100000:3.0:1783144322.819354:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481669248 00000100:00100000:3.0:1783144322.819558:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1116 00000100:00100000:3.0:1783144322.819569:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+12:69279:x1869759481669248:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144322.819592:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144322.819611:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a423047f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ac0 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.819751:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.819772:0:66114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.819782:0:66114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.819822:0:66114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144322.819836:0:66114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 13 pid: 66143 timeout: 2957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144322.819850:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66114:1869759501305728:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144322.819915:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9ee2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783144322.822985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144322.823022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481669376 00000100:00100000:1.0:1783144322.823030:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481669376 00010000:00010000:1.0:1783144322.823061:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 14 pid: 66143 timeout: 2957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144322.823094:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2543 00000100:00100000:1.0:1783144322.823103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cace81e7-a6f2-4d37-b197-caf34583781c+14:2403:x1869759481669376:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144322.823117:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144322.823123:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 14 pid: 66143 timeout: 2957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144322.823149:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 14 pid: 66143 timeout: 2957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144322.823170:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2aee3db800) 00010000:00010000:1.0:1783144322.823180:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144322.823189:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823193:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a423047f07 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ab9 expref: 14 pid: 66143 timeout: 2957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144322.823196:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144322.823207:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66114:1869759501305728:192.168.203.4@tcp:104: 00010000:00010000:1.0:1783144322.823213:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144322.823224:0:66114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823232:0:66114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823242:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144322.823255:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cace81e7-a6f2-4d37-b197-caf34583781c+13:2403:x1869759481669376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 153us (278us total) trans 0 rc 0/0 00000004:00200000:0.0:1783144322.823257:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00000100:00100000:1.0:1783144322.823263:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2543 00000004:00080000:0.0:1783144322.823402:0:66114:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x683:0x0], count =127 00000004:00080000:0.0:1783144322.823410:0:66114:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x683:0x0]+127 in llog 00000004:00080000:0.0:1783144322.823449:0:66114:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x702:0x0], index 1: 0 00010000:00010000:0.0:1783144322.823549:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823558:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823564:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823570:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144322.823575:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823582:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823591:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2aee3db800) 00010000:00010000:0.0:1783144322.823594:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783144322.823598:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823605:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423047f1c lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823666:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a423047f15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ac0 expref: 13 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823675:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3db000) 00010000:00010000:0.0:1783144322.823677:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144322.823681:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a423047f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ac0 expref: 13 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144322.823692:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e600, rc 0) 00000100:00100000:0.0:1783144322.823716:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+12:69279:x1869759481669248:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 4150us (4643us total) trans 107374182405 rc 301/301 00000100:00100000:0.0:1783144322.823746:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1116 00000100:00100000:1.0:1783144322.825651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144322.825890:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481669632 00000100:00100000:3.0:1783144322.825898:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481669632 00000100:00100000:3.0:1783144322.825947:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:3.0:1783144322.825957:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+12:69279:x1869759481669632:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1783144322.826197:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+13:69279:x1869759481669632:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 240us (552us total) trans 107374182406 rc 0/0 00000100:00100000:3.0:1783144322.826205:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 221 00000100:00100000:1.0:1783144322.830236:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144322.830323:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481669888 00000100:00100000:3.0:1783144322.830332:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481669888 00000100:00100000:2.0:1783144322.830413:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:2.0:1783144322.830425:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+13:69279:x1869759481669888:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1783144322.830638:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+14:69279:x1869759481669888:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 215us (413us total) trans 107374182407 rc 0/0 00000100:00100000:2.0:1783144322.830646:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222 00010000:00010000:1.0:1783144323.024349:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144323.086062:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c615b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501305856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144323.086147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.086200:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501305856 00000100:00100000:3.0:1783144323.086229:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501305856 00000100:00100000:3.0:1783144323.086277:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:3.0:1783144323.086286:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501305856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783144323.086317:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:3.0:1783144323.086360:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501305856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.086367:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00100000:3.0:1783144323.086412:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c615b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501305856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144323.087301:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501305984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144323.087339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144323.087380:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501305984 00000100:00100000:1.0:1783144323.087385:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501305984 00000100:00100000:1.0:1783144323.087423:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:1.0:1783144323.087431:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501305984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144323.087453:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144323.087489:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501305984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144323.087495:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00080000:1.0:1783144323.087514:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144323.087534:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968825 gen 2 00000100:00100000:1.0:1783144323.087549:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501305984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144323.087795:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501306240:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.087824:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.087844:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501306752:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.087866:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.087882:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501307264:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.087906:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.087925:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783144323.087930:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501306368:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.087950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.087965:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501306880:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.087984:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.087999:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501307392:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088024:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.088050:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501306240 00000100:00100000:3.0:1783144323.088054:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501306240 00000100:00100000:3.0:1783144323.088085:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501306368 00000100:00100000:3.0:1783144323.088089:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501306368 00000100:00100000:3.0:1783144323.088106:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307392 00000100:00100000:3.0:1783144323.088116:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307392 00000100:00100000:3.0:1783144323.088153:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1783144323.088160:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501306240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088197:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501306240:12345-0@lo:400:kworker.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.088203:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1783144323.088216:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1783144323.088223:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501306368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088248:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501306368:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.088254:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1783144323.088270:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1783144323.088276:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501307392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088300:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869759501307392:12345-0@lo:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.088304:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1783144323.088325:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501306752 00000100:00100000:3.0:1783144323.088328:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501306752 00000100:00100000:3.0:1783144323.088350:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:3.0:1783144323.088357:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501306752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088387:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501306752:12345-0@lo:400:kworker.0 Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.088393:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:3.0:1783144323.088410:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307264 00000100:00100000:3.0:1783144323.088413:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307264 00000100:00100000:3.0:1783144323.088436:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501306880 00000100:00100000:3.0:1783144323.088439:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501306880 00000100:00100000:3.0:1783144323.088470:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:3.0:1783144323.088476:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501307264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088505:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501307264:12345-0@lo:400:kworker.0 Request processed in 29us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.088510:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:3.0:1783144323.088521:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1783144323.088526:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501306880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088550:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501306880:12345-0@lo:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.088555:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1783144323.088592:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501306368:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088600:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501306880:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088608:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869759501307392:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088616:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501306240:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088624:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501306752:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088631:0:3650:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968825 gen 2 00000100:00100000:3.0:1783144323.088641:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501307264:0@lo:400:kworker.0 00000100:00080000:3.0:1783144323.088669:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144323.088672:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144323.088674:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144323.088676:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144323.088683:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501306496:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.088743:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501307008:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.088791:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783144323.088796:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501306112:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088821:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.088844:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501306624:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088863:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.088877:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501307136:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.088893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144323.088910:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501306496 00000100:00100000:3.0:1783144323.088913:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501306496 00000100:00100000:3.0:1783144323.088934:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501306624 00000100:00100000:3.0:1783144323.088937:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501306624 00000100:00100000:3.0:1783144323.088950:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307136 00000100:00100000:3.0:1783144323.088953:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307136 00000100:00100000:3.0:1783144323.088967:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1783144323.088973:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501306496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089005:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501306496:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.089011:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1783144323.089021:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1783144323.089026:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501306624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089048:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501306624:12345-0@lo:400:kworker.0 Request processed in 22us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.089053:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1783144323.089062:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1783144323.089067:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501307136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089102:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501307136:12345-0@lo:400:kworker.0 Request processed in 34us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.089107:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1783144323.089123:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307008 00000100:00100000:3.0:1783144323.089126:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307008 00000100:00100000:3.0:1783144323.089165:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1783144323.089172:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501307008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089200:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501307008:12345-0@lo:400:kworker.0 Request processed in 28us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.089206:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1783144323.089223:0:88855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501306112 00000100:00100000:3.0:1783144323.089226:0:88855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501306112 00000100:00100000:3.0:1783144323.089255:0:88855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783144323.089261:0:88855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501306112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089287:0:88855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501306112:12345-0@lo:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.089292:0:88855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1783144323.089325:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144323.089328:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144323.089330:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144323.089342:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501306112:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089351:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501306624:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089358:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501307136:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089365:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501306496:0@lo:400:kworker.0 00000100:00100000:3.0:1783144323.089372:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501307008:0@lo:400:kworker.0 00000100:00100000:2.0:1783144323.092255:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c615b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501307520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144323.092313:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144323.092362:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307520 00000100:00100000:2.0:1783144323.092367:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307520 00000100:00100000:2.0:1783144323.092406:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:2.0:1783144323.092416:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501307520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783144323.092451:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144323.092491:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501307520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144323.092498:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:2.0:1783144323.092540:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c615b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501307520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144323.095480:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144323.095499:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501307648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144323.095569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144323.095615:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307648 00000100:00100000:1.0:1783144323.095620:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307648 00000100:00100000:1.0:1783144323.095662:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:1.0:1783144323.095670:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501307648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144323.095708:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445003264 avail 1298763776 00000100:00100000:1.0:1783144323.095930:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501307648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 260us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144323.095938:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:1.0:1783144323.096443:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501307648:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1783144323.283867:0:88850:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:3.0:1783144323.283893:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.283906:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.283914:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.283921:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144323.283925:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.283933:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.283948:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2aee3dbf00) 00010000:00010000:3.0:1783144323.283951:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144323.283956:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.283963:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f00 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144323.313048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144323.313139:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670016 00000100:00100000:3.0:1783144323.313148:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670016 00000100:00100000:3.0:1783144323.313206:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1117 00000100:00100000:3.0:1783144323.313215:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+9:69297:x1869759481670016:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144323.313238:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144323.313258:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ac7 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.313321:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047f31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.313333:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.313343:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144323.313381:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144323.313384:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144323.313401:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.313434:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ac7 expref: 11 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.313449:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ac7 expref: 10 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.313458:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbf00) 00010000:00010000:3.0:1783144323.313461:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144323.313465:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ea00, rc 0) 00000100:00100000:3.0:1783144323.314160:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+10:69297:x1869759481670016:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 944us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.314168:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1117 00000100:00100000:0.0:1783144323.321979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144323.323206:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670144 00000100:00100000:3.0:1783144323.323215:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670144 00000100:00100000:3.0:1783144323.323279:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1118 00000100:00100000:3.0:1783144323.323293:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:69297:x1869759481670144:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1783144323.323320:0:66112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445003264 avail 1298763776 00000100:00100000:3.0:1783144323.323389:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+10:69297:x1869759481670144:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 97us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.323396:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1118 00000100:00100000:1.0:1783144323.326276:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144323.326524:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670272 00000100:00100000:2.0:1783144323.326533:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670272 00000100:00100000:2.0:1783144323.326601:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1119 00000100:00100000:2.0:1783144323.326611:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:69297:x1869759481670272:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144323.326637:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144323.326690:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+6:69297:x1869759481670272:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 80us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144323.326698:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1119 00000100:00080000:0.0:1783144323.326812:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144323.330814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144323.330868:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670400 00000100:00100000:2.0:1783144323.330877:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670400 00000100:00100000:2.0:1783144323.331010:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1602 00000100:00100000:2.0:1783144323.331020:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:69297:x1869759481670400:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144323.331047:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144323.331110:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:69297:x1869759481670400:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144323.331118:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1602 00000100:00080000:3.0:1783144323.331182:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144323.334101:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144323.334164:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670528 00000100:00100000:3.0:1783144323.334173:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670528 00000100:00100000:3.0:1783144323.334241:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1603 00000100:00100000:3.0:1783144323.334252:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:69297:x1869759481670528:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1783144323.334277:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144323.334340:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+5:69297:x1869759481670528:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144323.334348:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1603 00000100:00080000:2.0:1783144323.334402:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144323.372293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144323.375518:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670784 00000100:00100000:3.0:1783144323.375528:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670784 00000100:00100000:3.0:1783144323.375575:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1120 00000100:00100000:3.0:1783144323.375585:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:69304:x1869759481670784:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00010000:3.0:1783144323.375636:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144323.375662:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047f31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ac7 expref: 10 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.375679:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbf00) 00010000:00010000:3.0:1783144323.375689:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144323.375803:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.375819:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.375826:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.375838:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.375842:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.375847:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376122:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376128:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376169:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376176:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376182:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144323.376187:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376195:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376212:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbc00) 00010000:00010000:3.0:1783144323.376215:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144323.376218:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376225:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144323.376238:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3a80234 reply state 00000000eb57e77e transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376249:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.376256:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee3db400) 00010000:00010000:3.0:1783144323.376259:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144323.376261:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783144323.376343:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:69304:x1869759481670784:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 759us (4058us total) trans 107374182408 rc 0/0 00000100:00100000:3.0:1783144323.376351:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1120 00000100:00100000:3.0:1783144323.393674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144323.394582:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670912 00000100:00100000:0.0:1783144323.394592:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670912 00000100:00100000:0.0:1783144323.394646:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1121 00000100:00100000:0.0:1783144323.394657:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:69307:x1869759481670912:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1783144323.394678:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144323.394698:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423047f46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ace expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.394782:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047f4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.394795:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.394816:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144323.394861:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783144323.394865:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144323.394884:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.394908:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423047f46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ace expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.394926:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047f4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ace expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.394935:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29c3701500) 00010000:00010000:0.0:1783144323.394938:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783144323.394941:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3cc00, rc 0) 00000100:00100000:0.0:1783144323.394998:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+12:69307:x1869759481670912:12345-192.168.203.4@tcp:101:rm.0 Request processed in 342us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144323.395005:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1121 00000100:00100000:2.0:1783144323.396827:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144323.397491:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481671040 00000100:00100000:0.0:1783144323.397501:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481671040 00000100:00100000:0.0:1783144323.397553:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1122 00000100:00100000:0.0:1783144323.397563:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+12:69307:x1869759481671040:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1783144323.397580:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144323.397598:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ad5 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397671:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397695:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397705:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397716:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397760:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397767:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397849:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047f69 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397857:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047f69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397865:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047f69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144323.397902:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0xa:0x0]: returning size 0 00000004:00200000:0.0:1783144323.397905:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144323.397921:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047f69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397941:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047f69 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397949:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397955:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397962:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397968:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144323.397973:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397980:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.397992:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29c3701500) 00010000:00010000:0.0:1783144323.397995:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144323.397999:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398005:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423047f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398017:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398023:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398035:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398041:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144323.398044:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398052:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398062:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee3db400) 00010000:00010000:0.0:1783144323.398065:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144323.398068:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398073:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423047f62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398104:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ad5 expref: 14 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398120:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047f69 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ad5 expref: 13 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144323.398129:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c29c3701c00) 00010000:00010000:0.0:1783144323.398144:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144323.398147:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3de00, rc 0) 00000100:00100000:0.0:1783144323.398205:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+13:69307:x1869759481671040:12345-192.168.203.4@tcp:101:rm.0 Request processed in 643us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144323.398221:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1122 00000100:00100000:2.0:1783144323.401106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144323.401579:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481671296 00000100:00100000:3.0:1783144323.401599:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481671296 00000100:00100000:3.0:1783144323.401651:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1123 00000100:00100000:3.0:1783144323.401662:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+13:69307:x1869759481671296:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1783144323.401710:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783144323.401763:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047f69 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ad5 expref: 13 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.401793:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c29c3701c00) 00010000:00010000:3.0:1783144323.401808:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047f4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ace expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.401817:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29c3701500) 00010000:00010000:3.0:1783144323.401821:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144323.401968:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.401982:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.401992:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402004:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402012:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402018:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402109:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402118:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402126:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402327:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402336:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402344:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402358:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402366:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402372:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402398:0:66113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144323.402430:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402437:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402443:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402449:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144323.402453:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402461:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402470:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:2.0:1783144323.402472:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783144323.402476:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402492:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047f7e lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402509:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402515:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402521:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402527:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402532:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144323.402536:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402542:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402549:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:2.0:1783144323.402552:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144323.402555:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402560:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f70 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144323.402573:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002248ab1f reply state 000000007d783c71 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402590:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144323.402597:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee3db400) 00010000:00010000:2.0:1783144323.402599:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144323.402601:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144323.402674:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+13:69307:x1869759481671296:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1013us (1575us total) trans 107374182409 rc 0/0 00010000:00010000:3.0:1783144323.402676:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144323.402686:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144323.402686:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1123 00010000:00010000:3.0:1783144323.402696:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144323.402700:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.402707:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.402717:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:3.0:1783144323.402744:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783144323.402748:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.402754:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047f85 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144323.402768:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144323.402770:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144323.402771:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144323.683581:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144323.683659:0:88856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481671424 00000100:00100000:1.0:1783144323.683668:0:88856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481671424 00000100:00100000:1.0:1783144323.683738:0:88856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1783144323.683749:0:88856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2404:x1869759481671424:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144323.683808:0:88856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2404:x1869759481671424:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 61us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144323.683816:0:88856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00010000:00010000:2.0:1783144324.046933:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144325.070334:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144325.646138:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501307776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144325.646210:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144325.646272:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307776 00000100:00100000:1.0:1783144325.646290:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307776 00000100:00100000:1.0:1783144325.646344:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1783144325.646354:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501307776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144325.646383:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144325.646430:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501307776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144325.646437:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00080000:1.0:1783144325.646457:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144325.646501:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501307776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144325.646517:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144325.646522:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501307904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144325.646544:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144325.646617:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501307904 00000100:00100000:0.0:1783144325.646621:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501307904 00000100:00100000:0.0:1783144325.646680:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:0.0:1783144325.646687:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501307904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144325.646702:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144325.646834:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501307904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144325.646841:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00080000:1.0:1783144325.646861:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144325.646954:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501307904:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783144326.093865:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783144326.817378:0:90115:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1783144326.845031:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144326.845354:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481671552 00000100:00100000:3.0:1783144326.845366:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481671552 00000100:00100000:3.0:1783144326.845452:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1124 00000100:00080000:2.0:1783144326.845533:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144326.845634:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+13:69374:x1869759481671552:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144326.845744:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144326.845772:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423047f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41adc expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.845845:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.845862:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.845877:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144326.845927:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144326.845930:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144326.846545:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.846575:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423047f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41adc expref: 15 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.846594:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41adc expref: 14 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.846605:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3db300) 00010000:00010000:3.0:1783144326.846614:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144326.846619:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e000, rc 0) 00010000:00000080:3.0:1783144326.846628:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb7100 x1869759481671552/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 576/688 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144326.847356:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+14:69374:x1869759481671552:12345-192.168.203.4@tcp:101:dd.0 Request processed in 1725us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144326.847363:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1124 00000100:00100000:0.0:1783144326.852617:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144326.852691:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481671808 00000100:00100000:3.0:1783144326.852704:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481671808 00000100:00100000:3.0:1783144326.852778:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1125 00000100:00100000:3.0:1783144326.852788:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+14:69374:x1869759481671808:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144326.852883:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144326.852889:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783144326.852922:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423047f93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41adc expref: 14 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.852944:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3db300) 00010000:00010000:2.0:1783144326.852956:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144326.852975:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ae3 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854053:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854071:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854096:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854126:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854135:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854143:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854234:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047faf lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854242:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047faf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854248:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047faf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144326.854259:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:2.0:1783144326.854355:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854364:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854376:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854383:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144326.854395:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854403:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854416:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2b01242f00) 00010000:00010000:2.0:1783144326.854419:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144326.854423:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854430:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00c00/0xad8e53a423047fa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854443:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854449:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854455:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854600:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144326.854605:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854612:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854621:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2b01242300) 00010000:00010000:2.0:1783144326.854624:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144326.854634:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854640:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423047fa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854774:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423047f9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ae3 expref: 16 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854800:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047faf lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ae3 expref: 15 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.854808:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:2.0:1783144326.854811:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144326.854814:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01800, rc 0) 00010000:00000080:2.0:1783144326.854824:0:66114:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4ea4700 x1869759481671808/t107374182410(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 776/848 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144326.854915:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+15:69374:x1869759481671808:12345-192.168.203.4@tcp:101:dd.0 Request processed in 2128us (2312us total) trans 107374182410 rc 0/0 00000100:00100000:2.0:1783144326.854925:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1125 00000100:00100000:2.0:1783144326.857656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144326.857773:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481671936 00000100:00100000:0.0:1783144326.857785:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481671936 00000100:00100000:0.0:1783144326.857844:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1126 00000100:00100000:0.0:1783144326.857854:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+15:69374:x1869759481671936:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144326.857880:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144326.857900:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423047fbd lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41aea expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.857936:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047fc4 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.857952:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047fc4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.857964:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047fc4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.858079:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423047fbd lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aea expref: 17 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.858101:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047fc4 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aea expref: 16 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.858123:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:0.0:1783144326.858127:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783144326.858130:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3cc00, rc 0) 00010000:00000080:0.0:1783144326.858141:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef4bdc00 x1869759481671936/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 568/1344 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144326.858211:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+16:69374:x1869759481671936:12345-192.168.203.4@tcp:101:dd.0 Request processed in 358us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144326.858218:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1126 00000100:00100000:3.0:1783144326.859927:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144326.860141:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672192 00000100:00100000:0.0:1783144326.860150:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672192 00000100:00100000:0.0:1783144326.860204:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1127 00000100:00100000:0.0:1783144326.860214:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+16:69374:x1869759481672192:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1783144326.860263:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144326.860290:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423047faf lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ae3 expref: 16 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.860305:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:0.0:1783144326.860310:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144326.860500:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.860516:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.861163:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144326.861220:0:66143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182411 00000004:00010000:0.0:1783144326.861245:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079682422 reply state 000000004a32e0a7 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.861258:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.861266:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:0.0:1783144326.861269:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144326.861271:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783144326.861311:0:66143:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef92f800 x1869759481672192/t107374182412(0) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 488/456 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144326.861418:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+18:69374:x1869759481672192:12345-192.168.203.4@tcp:36:dd.0 Request processed in 1205us (1497us total) trans 107374182412 rc 0/0 00000100:00100000:0.0:1783144326.861426:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1127 00000020:00080000:0.0:1783144326.861432:0:66143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783144326.866423:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144326.867519:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672320 00000100:00100000:2.0:1783144326.867532:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672320 00000100:00100000:2.0:1783144326.867634:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1128 00000100:00100000:2.0:1783144326.867648:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+18:69374:x1869759481672320:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144326.867672:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144326.867702:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423047fd2 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41af1 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.867797:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423047fd2 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af1 expref: 19 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.867810:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423047fd2 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af1 expref: 19 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.867827:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:2.0:1783144326.867830:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144326.867836:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d600, rc 0) 00010000:00000080:2.0:1783144326.867844:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aeea41500 x1869759481672320/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 376/584 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144326.867911:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+19:69374:x1869759481672320:12345-192.168.203.4@tcp:101:dd.0 Request processed in 267us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144326.867918:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1128 00000100:00100000:2.0:1783144326.870539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144326.870593:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672576 00000100:00100000:0.0:1783144326.870605:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672576 00000100:00100000:0.0:1783144326.870668:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1129 00000100:00100000:0.0:1783144326.870679:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+19:69374:x1869759481672576:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144326.870700:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144326.870703:0:66947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783144326.870757:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423047fd2 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af1 expref: 19 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.870789:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:0.0:1783144326.870794:0:66947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144326.870808:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423047fd9 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41af8 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.870859:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047fe0 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.870873:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047fe0 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.870884:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047fe0 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783144326.871012:0:66947:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x45d:0x0], count =677 00000004:00080000:0.0:1783144326.871020:0:66947:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x45d:0x0]+677 in llog 00000004:00080000:0.0:1783144326.871049:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x702:0x0], index 0: 0 00000004:00080000:0.0:1783144326.871055:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x703:0x0], index 1: 0 00010000:00010000:0.0:1783144326.871168:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047fe0 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 21 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.871177:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:0.0:1783144326.871180:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1783144326.871188:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423047fd9 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 21 pid: 66947 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.871202:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047fe0 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 20 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.871246:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:0.0:1783144326.871249:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1783144326.871252:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3ce00, rc 0) 00010000:00000080:0.0:1783144326.871260:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef4be300 x1869759481672576/t107374182413(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 376/608 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144326.871325:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+20:69374:x1869759481672576:12345-192.168.203.4@tcp:101:dd.0 Request processed in 648us (796us total) trans 107374182413 rc 0/0 00000100:00100000:0.0:1783144326.871333:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1129 00000100:00100000:0.0:1783144326.875862:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144326.875941:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672704 00000100:00100000:1.0:1783144326.875953:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672704 00000100:00080000:3.0:1783144326.876025:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144326.876055:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4947 00000100:00100000:1.0:1783144326.876069:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cace81e7-a6f2-4d37-b197-caf34583781c+5:69374:x1869759481672704:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144326.876088:0:26141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144326.876118:0:26141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a423047fe7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41aff expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144326.876148:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144326.876174:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=2861s v=(0 0) 00010000:00010000:1.0:1783144326.876179:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144326.876251:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a423047fe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aff expref: 6 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.876273:0:26141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a423047fe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aff expref: 6 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.876287:0:26141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9a00, rc 0) 00000100:00100000:1.0:1783144326.876360:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cace81e7-a6f2-4d37-b197-caf34583781c+6:69374:x1869759481672704:12345-192.168.203.4@tcp:101:dd.0 Request processed in 294us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144326.876369:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4947 00000100:00100000:3.0:1783144326.878795:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144326.878904:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672832 00000100:00100000:1.0:1783144326.878915:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672832 00000100:00080000:3.0:1783144326.878966:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144326.879014:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4948 00000100:00100000:1.0:1783144326.879027:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:cace81e7-a6f2-4d37-b197-caf34583781c+5:69374:x1869759481672832:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144326.879044:0:26152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144326.879064:0:26152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047fee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b06 expref: -99 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144326.879088:0:26152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144326.879118:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=2861s v=(0 0) 00010000:00010000:1.0:1783144326.879122:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144326.879131:0:26152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047fee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b06 expref: 6 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.879158:0:26152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047fee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b06 expref: 6 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.879182:0:26152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8600, rc 0) 00000100:00100000:1.0:1783144326.879239:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:cace81e7-a6f2-4d37-b197-caf34583781c+6:69374:x1869759481672832:12345-192.168.203.4@tcp:101:dd.0 Request processed in 215us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144326.879246:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4948 00000100:00100000:2.0:1783144326.881996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144326.882157:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672960 00000100:00100000:1.0:1783144326.882167:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672960 00000100:00100000:1.0:1783144326.882232:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4949 00000100:00100000:1.0:1783144326.882245:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+6:69374:x1869759481672960:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144326.882264:0:26146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144326.882287:0:26146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000282468df/0xad8e53a423047ff5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b0d expref: -99 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144326.882314:0:26146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144326.882334:0:26146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=2861s v=(0 0) 00010000:00010000:1.0:1783144326.882338:0:26146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144326.882347:0:26146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282468df/0xad8e53a423047ff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b0d expref: 7 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.882363:0:26146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000282468df/0xad8e53a423047ff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b0d expref: 7 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.882375:0:26146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9e00, rc 0) 00000100:00100000:1.0:1783144326.882433:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+7:69374:x1869759481672960:12345-192.168.203.4@tcp:101:dd.0 Request processed in 190us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144326.882452:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4949 00000100:00100000:3.0:1783144326.884918:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144326.884958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144326.885011:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481673088 00000100:00100000:0.0:1783144326.885022:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481673088 00002000:00010000:0.0:1783144326.885077:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1794 (1048576->18446744073709551615) 00002000:00100000:0.0:1783144326.885083:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2addaaca80 with x1869759481673088 ext(1048576->18446744073709551615) 00000100:00100000:1.0:1783144326.885094:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481673216 00002000:00010000:0.0:1783144326.885098:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2addaaca80. 00000100:00100000:1.0:1783144326.885101:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481673216 00002000:00010000:1.0:1783144326.885131:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1795 (0->18446744073709551615) 00002000:00100000:1.0:1783144326.885135:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c61fc380 with x1869759481673216 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144326.885143:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c61fc380. 00000100:00100000:0.0:1783144326.885153:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 746 00000100:00100000:0.0:1783144326.885219:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481673088:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:0.0:1783144326.885498:0:24814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1783144326.885502:0:24814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb mtime from disk: 0 -> 1783144327 00002000:00010000:0.0:1783144326.885505:0:24814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783144326.885507:0:24814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb ctime from disk: 0 -> 1783144327 00002000:00010000:0.0:1783144326.885509:0:24814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783144326.885584:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cace81e7-a6f2-4d37-b197-caf34583781c+7:2404:x1869759481673088:12345-192.168.203.4@tcp:10:dd.0 Request processed in 368us (674us total) trans 4294968826 rc 0/0 00000100:00100000:1.0:1783144326.885986:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 747 00000100:00100000:1.0:1783144326.885998:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:2404:x1869759481673216:12345-192.168.203.4@tcp:10:dd.0 00000100:00100000:0.0:1783144326.886036:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 746 00002000:00010000:0.0:1783144326.886049:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1794 (1048576->18446744073709551615) 00002000:00100000:0.0:1783144326.886053:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2addaaca80 with x1869759481673088 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1783144326.886059:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2addaaca80. 00002000:00010000:1.0:1783144326.886125:0:24810:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144326.886127:0:24810:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb mtime from disk: 0 -> 1783144327 00002000:00010000:1.0:1783144326.886129:0:24810:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783144326.886131:0:24810:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb ctime from disk: 0 -> 1783144327 00002000:00010000:1.0:1783144326.886132:0:24810:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x703:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783144326.886152:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481673216:12345-192.168.203.4@tcp:10:dd.0 Request processed in 159us (1195us total) trans 4294968826 rc 0/0 00000100:00100000:1.0:1783144326.886157:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 747 00002000:00010000:1.0:1783144326.886159:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1795 (0->18446744073709551615) 00002000:00100000:1.0:1783144326.886161:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c61fc380 with x1869759481673216 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144326.886164:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c61fc380. 00000100:00100000:3.0:1783144326.921526:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144326.921597:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481673472 00000100:00100000:2.0:1783144326.921607:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481673472 00000100:00100000:2.0:1783144326.921679:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:2.0:1783144326.921686:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+20:69374:x1869759481673472:12345-192.168.203.4@tcp:35:dd.0 00010000:00000080:2.0:1783144326.921920:0:80989:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c61fdf80 x1869759481673472/t107374182414(0) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 392/456 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144326.921966:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+21:69374:x1869759481673472:12345-192.168.203.4@tcp:35:dd.0 Request processed in 280us (449us total) trans 107374182414 rc 0/0 00000100:00100000:2.0:1783144326.921990:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 223 00000100:00100000:0.0:1783144326.930778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144326.930849:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481673600 00000100:00100000:3.0:1783144326.930857:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481673600 00000100:00100000:3.0:1783144326.930913:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1130 00000100:00100000:3.0:1783144326.930921:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+21:69375:x1869759481673600:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144326.930938:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144326.930954:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b14 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.930998:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423048003 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.931016:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423048003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.931023:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423048003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144326.931056:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144326.931059:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144326.931076:0:66112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423048003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.931098:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423047ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b14 expref: 23 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.931124:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423048003 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b14 expref: 22 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.931133:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbe00) 00010000:00010000:3.0:1783144326.931136:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144326.931139:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f000, rc 0) 00010000:00000080:3.0:1783144326.931146:0:66112:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e8b100 x1869759481673600/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 576/688 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144326.931200:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+22:69375:x1869759481673600:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 281us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144326.931205:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1130 00000100:00100000:3.0:1783144326.935088:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144326.935156:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481673856 00000100:00100000:1.0:1783144326.935165:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481673856 00000100:00100000:1.0:1783144326.935211:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1131 00000100:00100000:1.0:1783144326.935220:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+22:69375:x1869759481673856:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144326.935236:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144326.935252:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304800a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b1b expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935329:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935341:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935351:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935364:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935370:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935376:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935446:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935453:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935459:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935466:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144326.935470:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935487:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935497:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbe00) 00010000:00010000:1.0:1783144326.935500:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144326.935504:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935517:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8c00/0xad8e53a423048011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935527:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935533:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935539:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935544:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144326.935546:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935552:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935559:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2af71ead00) 00010000:00010000:1.0:1783144326.935562:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144326.935564:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935580:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8400/0xad8e53a423048018 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935671:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304800a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b1b expref: 23 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935681:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbe00) 00010000:00010000:1.0:1783144326.935683:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783144326.935686:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9400/0xad8e53a42304800a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b1b expref: 23 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144326.935695:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9400, rc 0) 00010000:00000080:1.0:1783144326.935702:0:66114:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c61ff480 x1869759481673856/t0(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 800/608 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144326.936083:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+22:69375:x1869759481673856:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 864us (1000us total) trans 0 rc 301/301 00000100:00100000:1.0:1783144326.936091:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1131 00000100:00100000:1.0:1783144326.937995:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144326.938098:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481673984 00000100:00100000:0.0:1783144326.938115:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481673984 00000100:00100000:0.0:1783144326.938159:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1132 00000100:00100000:0.0:1783144326.938168:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+22:69375:x1869759481673984:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1783144326.938214:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938227:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938237:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938248:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938254:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938260:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938309:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938317:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938336:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144326.938372:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1783144326.938376:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144326.938387:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938398:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938404:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938409:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938415:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938421:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3ca00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144326.938424:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938431:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938440:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbe00) 00010000:00010000:0.0:1783144326.938443:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144326.938446:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938461:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a42304801f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938472:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938478:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938484:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938488:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3dc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144326.938491:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938496:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938503:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c29c3701d00) 00010000:00010000:0.0:1783144326.938569:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144326.938573:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938579:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423048026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938591:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938597:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938607:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938612:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3da00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144326.938615:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938622:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938630:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:0.0:1783144326.938633:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144326.938636:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144326.938642:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a42304802d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1783144326.938660:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb4a80 x1869759481673984/t0(0) o34->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 472/728 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144326.938705:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+22:69375:x1869759481673984:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 539us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144326.938712:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1132 00000100:00100000:0.0:1783144326.952079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144326.952180:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481674240 00000100:00100000:3.0:1783144326.952189:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481674240 00000100:00100000:3.0:1783144326.952287:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1133 00000100:00100000:3.0:1783144326.952298:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+22:69377:x1869759481674240:12345-192.168.203.4@tcp:101:md5sum.0 00010000:00010000:3.0:1783144326.952316:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144326.952334:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423048034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b22 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952404:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952418:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952429:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952442:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952449:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952456:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952567:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423048049 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952577:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423048049 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952583:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423048049 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144326.952603:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00010000:00010000:3.0:1783144326.952676:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952685:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952691:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952698:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952703:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144326.952708:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952715:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952764:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbe00) 00010000:00010000:3.0:1783144326.952767:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144326.952771:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952777:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a42304803b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952788:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952804:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952810:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952815:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144326.952818:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952824:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952832:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2aee3dbb00) 00010000:00010000:3.0:1783144326.952834:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144326.952836:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952841:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a423048042 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952884:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423048034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b22 expref: 25 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952894:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423048049 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b22 expref: 24 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144326.952900:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:3.0:1783144326.952902:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144326.952909:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ee00, rc 0) 00010000:00000080:3.0:1783144326.952915:0:66112:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e89880 x1869759481674240/t107374182415(0) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 800/872 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144326.952959:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+24:69377:x1869759481674240:12345-192.168.203.4@tcp:101:md5sum.0 Request processed in 665us (888us total) trans 107374182415 rc 0/0 00000100:00100000:3.0:1783144326.952965:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1133 00000100:00100000:3.0:1783144326.955622:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144326.955761:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481674368 00000100:00100000:1.0:1783144326.955769:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481674368 00002000:00100000:1.0:1783144326.955815:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9c29ceadad80 x1869759481674368/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 488/0 e 0 to 0 dl 1783144337 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144326.955826:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ceadad80 with x1869759481674368 ext(0->32767) 00002000:00010000:1.0:1783144326.955831:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29ceadad80 00000100:00100000:1.0:1783144326.955864:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 748 00000100:00100000:1.0:1783144326.955873:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:2406:x1869759481674368:12345-192.168.203.4@tcp:3:md5sum.0 00000100:00100000:2.0:1783144326.959467:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:2406:x1869759481674368:12345-192.168.203.4@tcp:3:md5sum.0 Request processed in 3587us (3845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144326.959481:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 748 00002000:00100000:2.0:1783144326.959495:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9c29ceadad80 x1869759481674368/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 488/440 e 0 to 0 dl 1783144337 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144326.959512:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ceadad80 with x1869759481674368 ext(0->32767) 00002000:00010000:2.0:1783144326.959519:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29ceadad80 00000100:00100000:0.0:1783144326.966417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144326.966513:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481674496 00000100:00100000:2.0:1783144326.966523:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481674496 00002000:00100000:2.0:1783144326.966573:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9c29c9e8a680 x1869759481674496/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 488/0 e 0 to 0 dl 1783144337 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144326.966584:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e8a680 with x1869759481674496 ext(32768->1048575) 00002000:00010000:2.0:1783144326.966590:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c9e8a680 00000100:00100000:2.0:1783144326.966654:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 749 00000100:00100000:2.0:1783144326.966664:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cace81e7-a6f2-4d37-b197-caf34583781c+8:2403:x1869759481674496:12345-192.168.203.4@tcp:3:md5sum.0 00000100:00100000:2.0:1783144326.970548:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cace81e7-a6f2-4d37-b197-caf34583781c+8:2403:x1869759481674496:12345-192.168.203.4@tcp:3:md5sum.0 Request processed in 3877us (4131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144326.970559:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 749 00002000:00100000:2.0:1783144326.970570:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9c29c9e8a680 x1869759481674496/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 488/440 e 0 to 0 dl 1783144337 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144326.970580:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e8a680 with x1869759481674496 ext(32768->1048575) 00002000:00010000:2.0:1783144326.970587:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c9e8a680 00000100:00100000:1.0:1783144326.986041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144326.986189:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481674752 00000100:00100000:2.0:1783144326.986197:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481674752 00000100:00100000:2.0:1783144326.986297:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:2.0:1783144326.986307:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+24:69377:x1869759481674752:12345-192.168.203.4@tcp:35:md5sum.0 00010000:00000080:2.0:1783144326.986508:0:66115:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e8d180 x1869759481674752/t107374182416(0) o35->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 392/456 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144326.986573:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cace81e7-a6f2-4d37-b197-caf34583781c+25:69377:x1869759481674752:12345-192.168.203.4@tcp:35:md5sum.0 Request processed in 267us (542us total) trans 107374182416 rc 0/0 00000100:00100000:2.0:1783144326.986580:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:0.0:1783144326.997818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144326.997888:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481674880 00000100:00100000:2.0:1783144326.997899:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481674880 00000100:00100000:2.0:1783144326.997948:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1134 00000100:00100000:2.0:1783144326.997958:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+25:69379:x1869759481674880:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:2.0:1783144326.998031:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998046:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998054:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998065:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998070:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998073:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998159:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998169:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998175:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144326.998216:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1783144326.998221:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144326.998233:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998247:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998254:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998261:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998267:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144326.998271:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998279:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998290:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2aee3dbe00) 00010000:00010000:2.0:1783144326.998300:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144326.998304:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998310:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048057 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998325:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998331:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998337:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998342:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144326.998345:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998351:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998358:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2b01242f00) 00010000:00010000:2.0:1783144326.998361:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144326.998363:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998368:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a42304805e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998497:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998508:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998512:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998515:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144326.998517:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998521:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998526:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:2.0:1783144326.998528:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144326.998529:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144326.998533:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d600/0xad8e53a423048065 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1783144326.998549:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e88700 x1869759481674880/t0(0) o34->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:437/0 lens 472/728 e 0 to 0 dl 1783144337 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144326.998600:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+25:69379:x1869759481674880:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 643us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144326.998608:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1134 00010000:00010000:2.0:1783144327.117863:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783144327.925206:0:90212:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783144327.925256:0:90212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.925276:0:90212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.925283:0:90212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.925291:0:90212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.925314:0:90212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783144327.925319:0:90212:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783144327.925346:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783144327.925351:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783144327.925355:0:90212:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783144327.925376:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c2ad06c4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783144327.925406:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501308032:0@lo:39:umount.0 00000100:00100000:2.0:1783144327.925472:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144327.925520:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308032 00000100:00100000:2.0:1783144327.925527:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308032 00010000:00010000:1.0:1783144327.925582:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144327.925590:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.925598:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144327.925601:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.925610:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144327.925618:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144327.925623:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783144327.925626:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783144327.925628:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783144327.925650:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.925656:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144327.925684:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.925692:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423047b79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047b80 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144327.925692:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1783144327.925708:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144327.925708:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501308160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144327.925712:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144327.925742:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144327.925778:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144327.925822:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308160 00000100:00100000:0.0:1783144327.925826:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308160 00000100:00100000:2.0:1783144327.925840:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1783144327.925852:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501308032:12345-0@lo:39:umount.0 00000100:00100000:0.0:1783144327.925863:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1783144327.925872:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501308160:12345-0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783144327.925876:0:66113:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047c98 00010000:00010000:0.0:1783144327.925882:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1783144327.925891:0:66113:0:(import.c:65:import_set_state_nolock()) ffff9c2aee195800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783144327.925899:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0000/0xad8e53a423047b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047b79 expref: 24 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.925912:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000080:2.0:1783144327.925916:0:66113:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab11180 x1869759501308032/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:438/0 lens 224/224 e 0 to 0 dl 1783144338 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144327.925950:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3649:x1869759501308160:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144327.925958:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1783144327.925968:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1869759501308032:12345-0@lo:39:umount.0 Request processed in 117us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144327.925982:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000020:00000080:2.0:1783144327.925992:0:66113:0:(genops.c:906:class_export_put()) final put ffff9c2aee194800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1783144327.925995:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501308160:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1783144327.926055:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee194800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783144327.926108:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee195800 for lustre-MDT0000 00010000:00010000:1.0:1783144327.926133:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783144327.926135:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ad06c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783144327.926143:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501308032:0@lo:39:umount.0 00000100:00080000:2.0:1783144327.926168:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783144327.926171:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783144327.926174:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783144327.927471:0:90212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927483:0:90212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927490:0:90212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927496:0:90212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927521:0:90212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144327.927527:0:90212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927533:0:90212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927538:0:90212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927550:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144327.927559:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927563:0:90212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927576:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144327.927581:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927587:0:90212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144327.927590:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927599:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1783144327.927599:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927608:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144327.927608:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144327.927619:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01e00 already unused, calling callback (ffffffffc1204c20) 10000000:01000000:0.0:1783144327.927620:0:9525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:00010000:2.0:1783144327.927625:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927634:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144327.927642:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927644:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927653:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1783144327.927656:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783144327.927661:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783144327.927664:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783144327.927677:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927683:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927686:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a423047aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047aa7 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927691:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144327.927703:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144327.927706:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144327.927708:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927710:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144327.927715:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423047ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047baa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144327.927716:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1783144327.927746:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144327.927747:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501308416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144327.927750:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144327.927752:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783144327.927753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144327.927767:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501308288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144327.927769:0:90212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927775:0:90212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927785:0:90212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144327.927786:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144327.927793:0:90212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927806:0:90212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144327.927810:0:90212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927816:0:90212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144327.927818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144327.927825:0:90212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927829:0:90212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144327.927839:0:90212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144327.927844:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1783144327.927846:0:90212:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1783144327.927850:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144327.927851:0:90212:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1783144327.927861:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144327.927865:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144327.927866:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308416 00000100:00100000:0.0:1783144327.927872:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308416 00010000:00010000:1.0:1783144327.927876:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783144327.927877:0:90212:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783144327.927882:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 10000000:00010000:1.0:1783144327.927888:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783144327.927889:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1783144327.927894:0:90212:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 10000000:01000000:1.0:1783144327.927896:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1783144327.927898:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308288 10000000:01000000:1.0:1783144327.927902:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000100:00100000:3.0:1783144327.927904:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308288 10000000:01000000:1.0:1783144327.927906:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1783144327.927918:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00010000:00010000:1.0:1783144327.927927:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144327.927929:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501308416:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144327.927937:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00010000:00010000:1.0:1783144327.927941:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783144327.927947:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501308288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144327.927953:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144327.927955:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144327.927961:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144327.927966:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47cc00/0xad8e53a423047aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047aa0 expref: 24 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927969:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47ce00/0xad8e53a423047baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047ba3 expref: 24 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144327.927993:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144327.927996:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a423047b6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047b72 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144327.927999:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144327.928011:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144327.928015:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.928021:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144327.928025:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144327.928035:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3648:x1869759501308288:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144327.928042:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3651:x1869759501308416:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144327.928043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00010000:00010000:1.0:1783144327.928054:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144327.928054:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 10000000:00010000:1.0:1783144327.928064:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144327.928068:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:1.0:1783144327.928070:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783144327.928074:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783144327.928076:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1783144327.928078:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501308544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144327.928097:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144327.928113:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501308288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144327.928117:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783144327.928127:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144327.928132:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.928140:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1800/0xad8e53a423047a92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423047a99 expref: -99 pid: 88849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144327.928142:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501308672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144327.928151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144327.928170:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144327.928172:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144327.928174:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308544 00000100:00100000:3.0:1783144327.928179:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308544 00000100:00100000:0.0:1783144327.928180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144327.928211:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308672 00000100:00100000:3.0:1783144327.928215:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308672 00000100:00100000:0.0:1783144327.928224:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1783144327.928234:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3650:x1869759501308544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144327.928235:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144327.928243:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00010000:00010000:0.0:1783144327.928246:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144327.928260:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423047b72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047b6b expref: 22 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144327.928263:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3648:x1869759501308672:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144327.928264:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501308416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144327.928280:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144327.928282:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144327.928294:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47da00/0xad8e53a423047a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047a92 expref: 21 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144327.928305:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144327.928329:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3650:x1869759501308544:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144327.928337:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1783144327.928342:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3648:x1869759501308672:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144327.928350:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1783144327.928388:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501308544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144327.928409:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501308672:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1783144327.930871:0:90212:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1783144327.931337:0:88850:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182416 is committed 00010000:00010000:1.0:1783144327.931417:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931430:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931438:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931444:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144327.931448:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931456:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931474:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee3db400) 00010000:00010000:1.0:1783144327.931477:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144327.931480:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931487:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423047f3f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931513:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931520:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931526:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931531:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144327.931534:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931540:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931548:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2aee3db400) 00010000:00010000:1.0:1783144327.931551:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144327.931554:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931572:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423047f77 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931589:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931595:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931601:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931611:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3de00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144327.931615:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931621:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931630:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2b01242e00) 00010000:00010000:1.0:1783144327.931632:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144327.931635:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.931640:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423047fcb lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783144327.931794:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1783144327.931802:0:90212:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aefddf800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144327.931808:0:90212:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2ad3866000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144327.931813:0:90212:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c29c496b000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144327.931817:0:90212:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c29c5777000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144327.931824:0:90212:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c29c5775000 cace81e7-a6f2-4d37-b197-caf34583781c 192.168.203.4@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 107374182416 stale:0 00000020:00080000:2.0:1783144327.931828:0:90212:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c29c3f13380) has exports, disconnecting them 00000020:00080000:2.0:1783144327.931833:0:90212:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2aefddf800), last request at 1783144312 00000020:00000080:2.0:1783144327.931839:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047c91 00000100:00080000:2.0:1783144327.931845:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c2aefddf000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783144327.931867:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2aefddf800): rc 0 00000020:00000080:2.0:1783144327.931869:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2aefddf800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1783144327.931879:0:90212:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2ad3866000), last request at 1783144323 00000020:00000080:2.0:1783144327.931882:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047c8a 00000100:00080000:2.0:1783144327.931886:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c2afa9bb000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783144327.931900:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783144327.931907:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ad3866000): rc 0 00000020:00000080:2.0:1783144327.931910:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ad3866000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783144327.931913:0:90212:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c29c496b000), last request at 1783144323 00000020:00000080:2.0:1783144327.931916:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047c83 00000100:00080000:2.0:1783144327.931927:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c29c496e800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144327.931932:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefddf800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1783144327.931939:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c496b000): rc 0 00000020:00000080:2.0:1783144327.931946:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c29c496b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783144327.931953:0:90212:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c29c5777000), last request at 1783144307 00000020:00000080:2.0:1783144327.931963:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047aed 00000100:00080000:2.0:1783144327.931971:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c2aefdda000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783144327.931981:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144327.931984:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad3866000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144327.932023:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aefddf000 for lustre-MDT0000 00000020:00080000:3.0:1783144327.932030:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c5777000): rc 0 00000020:00000080:3.0:1783144327.932034:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c29c5777000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783144327.932036:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:3.0:1783144327.932043:0:90212:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.4@tcp (ffff9c29c5775000), last request at 1783144326 00000020:00000080:3.0:1783144327.932049:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047ae6 00000020:00010000:3.0:1783144327.932059:0:90212:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c29c5775000: total 1 00000020:00000080:0.0:1783144327.932059:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2afa9bb000 for lustre-MDT0000 00000100:00080000:3.0:1783144327.932066:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c2aee191000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144327.932080:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5777000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144327.932109:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c496e800 for lustre-MDT0000 00000020:00000080:0.0:1783144327.932112:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aefdda000 for lustre-MDT0000 00000020:00080000:3.0:1783144327.932505:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c29c5775000): rc 0 00000004:00000080:3.0:1783144327.932512:0:90212:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc16287aebae0 00000100:00080000:3.0:1783144327.932530:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783144327.932607:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:1.0:1783144327.932831:0:9527:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c29c5775000: total 0 00010000:00010000:0.0:1783144327.932845:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144327.932873:0:9527:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c29c5775000, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1783144327.932897:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423048003 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b14 expref: 8 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.932917:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423047ecf lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aa4 expref: 7 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.932929:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423048049 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b22 expref: 6 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.932942:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423047ec8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a9d expref: 5 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.932968:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423047ed6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aab expref: 4 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.932983:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423047fc4 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aea expref: 3 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.932994:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423047fe0 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 2 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144327.933008:0:9527:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c29c5775000, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1783144327.936154:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144327.936525:0:90212:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783144327.936553:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783144327.936682:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501308800:0@lo:39:umount.0 00000100:00100000:2.0:1783144327.936777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144327.936851:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308800 00000100:00100000:2.0:1783144327.936858:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308800 00000100:00080000:3.0:1783144327.936871:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144327.936875:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968825 gen 3 00000100:00100000:2.0:1783144327.936897:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1783144327.936907:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501308800:12345-0@lo:39:umount.0 00000004:00080000:3.0:1783144327.936922:0:90212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783144327.937158:0:90212:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783144327.937169:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c29c4cb3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783144327.937190:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144327.937193:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968825 gen 3 00000004:00080000:3.0:1783144327.937201:0:90212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783144327.937462:0:90212:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783144327.937470:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c29c496e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783144327.937509:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c29c3f13380) has no exports 00000020:00080000:3.0:1783144327.937702:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c29c3f13380) has no exports 00000020:00000080:2.0:1783144327.938005:0:8447:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b2c 00000100:00080000:2.0:1783144327.938013:0:8447:0:(import.c:65:import_set_state_nolock()) ffff9c2affddc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783144327.938041:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378733 00000100:00100000:2.0:1783144327.938203:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1869759501308800:12345-0@lo:39:umount.0 Request processed in 1297us (1426us total) trans 81604378734 rc 0/0 00000100:00100000:2.0:1783144327.938211:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00010000:00010000:2.0:1783144327.938234:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144327.938243:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501308928:0@lo:9:umount.0 00000100:00100000:2.0:1783144327.938271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144327.938291:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501309056:0@lo:9:umount.0 00000100:00100000:2.0:1783144327.938312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144327.938340:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac317f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783144327.938346:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501308800:0@lo:39:umount.0 00000100:00100000:2.0:1783144327.938363:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501308928 00000100:00100000:2.0:1783144327.938384:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501308928 00000100:00100000:2.0:1783144327.938422:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309056 00000100:00100000:2.0:1783144327.938425:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309056 00000100:00100000:2.0:1783144327.938447:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950 00000100:00100000:2.0:1783144327.938455:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501308928:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783144327.938468:0:26151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b41 00000100:00080000:2.0:1783144327.938475:0:26151:0:(import.c:65:import_set_state_nolock()) ffff9c2affddf800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783144327.938490:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1783144327.938510:0:26151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968826 00000100:00100000:2.0:1783144327.938598:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501308928:12345-0@lo:9:umount.0 Request processed in 144us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144327.938605:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950 00000100:00100000:2.0:1783144327.938618:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4951 00000100:00100000:2.0:1783144327.938624:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501309056:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783144327.938634:0:26151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b56 00000100:00080000:2.0:1783144327.938638:0:26151:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783144327.938660:0:26151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968826 00000100:00100000:2.0:1783144327.938748:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501309056:12345-0@lo:9:umount.0 Request processed in 125us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144327.938755:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4951 00000100:00080000:2.0:1783144327.938775:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144327.938779:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783144327.938791:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783144327.939040:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c4cb3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783144327.939055:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783144327.939057:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144327.939066:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501308928:0@lo:9:umount.0 00000100:00080000:0.0:1783144327.939078:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c496e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783144327.939086:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783144327.939087:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144327.939089:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501309056:0@lo:9:umount.0 00000020:00000080:1.0:1783144328.007132:0:9527:0:(genops.c:906:class_export_put()) final put ffff9c29c5775000/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:0.0:1783144328.007260:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5775000/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-MDT0000 00000020:00000080:0.0:1783144328.007323:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee191000 for lustre-MDT0000 00010000:00010000:0.0:1783144328.007336:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144328.007339:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144328.007343:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783144328.019911:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b02 00000020:00000080:3.0:1783144328.019925:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2af5ddc800/lustre-QMT0000_UUID 00000020:01000000:3.0:1783144328.019944:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783144328.019955:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144328.019966:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783144328.019969:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c29c356cd40) has no exports 00000020:00000080:1.0:1783144328.020264:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5ddc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783144328.020306:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047afb 00000020:00000080:3.0:1783144328.020314:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144328.020369:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144328.020376:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783144328.020379:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c29c5771800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783144328.020382:0:90212:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5771800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783144328.020390:0:90212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1783144328.020490:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783144328.020520:0:90212:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2aee3da240 - data ffff9c2afa7345e8/ffff9c2aee59a800 00000020:01000000:3.0:1783144328.020649:0:90212:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af6ad4420 - data ffff9c2acffb1360/ffff9c29c73cb400 00000100:00080000:0.0:1783144328.051271:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144328.051279:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783144328.051291:0:90212:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c29c60b7100 x1869759501308800/t81604378734(81604378734) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144337 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144328.051310:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783144328.053245:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783144328.053250:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968825 gen 4 00000004:00080000:0.0:1783144328.053266:0:90212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144328.053268:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783144328.053623:0:88867:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783144328.053628:0:88867:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:1.0:1783144328.053636:0:88867:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:0.0:1783144328.056037:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783144328.056044:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968825 gen 4 00000004:00080000:0.0:1783144328.056065:0:90212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144328.056068:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783144328.056558:0:88869:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783144328.056563:0:88869:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:1.0:1783144328.056573:0:88869:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:1.0:1783144328.058084:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047abc 00000020:00000080:1.0:1783144328.058093:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac317e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144328.058823:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac317e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144328.058866:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047ad1 00000020:00000080:1.0:1783144328.058872:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac9c73800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783144328.058914:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783144328.058920:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144328.058930:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783144328.058935:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c29c3f14d40) has no exports 00000004:01000000:1.0:1783144328.059118:0:90212:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783144328.059136:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b4f 00000020:00000080:1.0:1783144328.059141:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.059210:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9c73800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783144328.059272:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783144328.059276:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144328.059284:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783144328.059287:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c2aee593380) has no exports 00000020:00000080:1.0:1783144328.059292:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b48 00000020:00000080:1.0:1783144328.059296:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c29c496f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144328.059318:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1783144328.059827:0:90212:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783144328.059832:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783144328.059835:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968825 gen 5 00000004:00080000:1.0:1783144328.059839:0:90212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783144328.059841:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144328.059879:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144328.059959:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144328.059968:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144328.059973:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b33 00000020:00000080:1.0:1783144328.059977:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.060001:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c496e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783144328.060008:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.060016:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783144328.060021:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783144328.060178:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783144328.060183:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144328.060189:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783144328.060192:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c29c31e0000) has no exports 00000020:00000080:1.0:1783144328.060196:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b25 00000020:00000080:1.0:1783144328.060201:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2aefa79800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144328.060224:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1783144328.060639:0:90212:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783144328.060642:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783144328.060644:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968825 gen 5 00000004:00080000:1.0:1783144328.060648:0:90212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783144328.060650:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144328.060694:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa79800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144328.060848:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144328.060855:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783144328.060863:0:90212:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783144328.060867:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b17 00000020:00000080:1.0:1783144328.060876:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.060892:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c4cb3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783144328.060897:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.060899:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783144328.060903:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783144328.060988:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783144328.060992:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144328.060998:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783144328.061000:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c29c3568000) has no exports 00000020:00000080:1.0:1783144328.061004:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b10 00000020:00000080:1.0:1783144328.061007:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac317e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144328.061022:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783144328.061577:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac317e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144328.063813:0:90212:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783144328.063823:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144328.063826:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783144328.063832:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144328.063871:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144328.063904:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac317f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783144328.063933:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144328.063938:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.063941:0:90212:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783144328.063946:0:90212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144328.064031:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144328.064036:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144328.064039:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c29c4cb6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.064041:0:90212:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c4cb6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783144328.064045:0:90212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144328.064091:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047ad8 00000020:00000080:0.0:1783144328.064096:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac9c70000/lustre-MDD0000_UUID 00000020:01000000:0.0:1783144328.064119:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783144328.064122:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144328.064135:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783144328.064139:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c29c3f10000) has no exports 00000020:00000080:0.0:1783144328.064156:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144328.064160:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783144328.064163:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047adf 00000020:00000080:0.0:1783144328.064167:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac9c76000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783144328.064173:0:90212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2af728f800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783144328.064176:0:90212:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af728f800 3 00000020:01000004:0.0:1783144328.064179:0:90212:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2af728f800 from lustre-MDT0000 00000020:00000080:0.0:1783144328.064195:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144328.064199:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783144328.064202:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac317c000/lustre-MDT0000_UUID 00000020:00000080:0.0:1783144328.064204:0:90212:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac317c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783144328.064209:0:90212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783144328.064235:0:90212:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783144328.064238:0:90212:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783144328.064240:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783144328.064243:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144328.064245:0:90212:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783144328.064253:0:90212:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2ad13c7800 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 192.168.203.4@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144328.064259:0:90212:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c29c5773000 4e9e4714-8000-4c64-bed6-3cadd5fdfc80 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144328.064263:0:90212:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9c2af9c799c0) has exports, disconnecting them 00000020:00080000:0.0:1783144328.064267:0:90212:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.4@tcp (ffff9c2ad13c7800), last request at 1783144308 00000020:00000080:0.0:1783144328.064284:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b9c 00000020:00010000:0.0:1783144328.064288:0:90212:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ad13c7800: total 2 00000100:00080000:0.0:1783144328.064291:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3dad000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144328.064299:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2ad13c7800): rc 0 00000020:00080000:0.0:1783144328.064303:0:90212:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c29c5773000), last request at 1783144307 00000020:00000080:0.0:1783144328.064340:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047a7d 00000020:00010000:0.0:1783144328.064343:0:90212:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c29c5773000: total 2 00000100:00080000:0.0:1783144328.064346:0:90212:0:(import.c:65:import_set_state_nolock()) ffff9c29c5777800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144328.064361:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c5773000): rc 0 00000020:00080000:0.0:1783144328.064365:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9c2af9c799c0) has no exports 00000020:00010000:0.0:1783144328.064374:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ad13c7800: total 2 00010000:00010000:0.0:1783144328.064396:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ad13c7800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1783144328.064421:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7200/0xad8e53a423047c75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a81 expref: 5 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064435:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f6e00/0xad8e53a423047c67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a73 expref: 4 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064445:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423047c6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a7a expref: 3 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064456:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a423047c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41a88 expref: 2 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064463:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ad13c7800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1783144328.064479:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c2ad13c7800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 00000020:00010000:0.0:1783144328.064483:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c29c5773000: total 3 00010000:00010000:0.0:1783144328.064499:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c29c5773000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783144328.064513:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423047c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047c05 expref: 14 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064525:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7600/0xad8e53a423047c1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047c13 expref: 13 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064535:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f7c00/0xad8e53a423047c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047c21 expref: 12 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064544:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423047c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047c2f expref: 11 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064563:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c000/0xad8e53a423047bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047bbf expref: 10 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064576:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c200/0xad8e53a423047c44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047c3d expref: 9 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064585:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47d800/0xad8e53a423047bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047bb1 expref: 8 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064594:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00400/0xad8e53a423047be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047bdb expref: 7 pid: 88857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064605:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01000/0xad8e53a423047c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047c59 expref: 6 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064614:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29ca7f6000/0xad8e53a423047bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047bcd expref: 5 pid: 88855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064624:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423047c52 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047c4b expref: 4 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064635:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47d400/0xad8e53a423047bf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047be9 expref: 3 pid: 88859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064645:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c800/0xad8e53a423047bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423047bf7 expref: 2 pid: 88856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144328.064655:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c29c5773000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1783144328.064667:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c29c5773000/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 00010000:00010000:0.0:1783144328.064672:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144328.064679:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144328.064681:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144328.064773:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144328.064780:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9c70000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783144328.064783:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c29c4cb5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783144328.064785:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c4cb5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783144328.064792:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783144328.064838:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9c76000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783144328.064848:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad13c7800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 for MGS 00000020:00000080:2.0:1783144328.064876:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5773000/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 for MGS 00000020:00000080:2.0:1783144328.064885:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ad3dad000 for MGS 00000020:00000080:2.0:1783144328.064890:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c5777800 for MGS 00000100:00100000:3.0:1783144328.065045:0:88855:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2af63bf400:88855] 0 exiting: rc = 1 00000100:00100000:3.0:1783144328.065156:0:88859:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c29c2635e00:88859] 3 exiting: rc = 0 00000100:00100000:3.0:1783144328.065211:0:88857:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2aeedb3600:88857] 2 exiting: rc = 0 00000100:00100000:0.0:1783144328.066819:0:88856:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2af962ba00:88856] 1 exiting: rc = 0 00000100:00100000:2.0:1783144328.066954:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.066967:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.066974:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.066981:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.066987:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.066992:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.066998:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067004:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067010:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067015:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067020:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067026:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067030:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067036:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067041:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067047:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067052:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067057:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067063:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067069:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067075:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067082:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067088:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067094:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067114:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067120:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067126:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067130:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067135:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067140:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067154:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067160:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067166:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067172:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067177:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067183:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067189:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067195:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067200:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067207:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067213:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067218:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067224:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067230:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067235:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067240:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067245:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067251:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067256:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067262:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067267:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067278:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067285:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067292:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067297:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067309:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067319:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067325:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067335:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067341:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067347:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067355:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067365:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783144328.067371:0:90212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783144328.068053:0:90212:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af7999300 - data ffff9c2afa6bba20/ffff9c29c6f8ac00 00000020:01000000:2.0:1783144328.068179:0:90212:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2ade054660 - data ffff9c2acfccae58/ffff9c2ad3fecc00 00000020:00000080:2.0:1783144328.068599:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047a76 00000020:00000080:2.0:1783144328.068607:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d51800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783144328.068621:0:90212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2af728f800 from MGS, refs=2 00000020:01000004:2.0:1783144328.068625:0:90212:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af728f800 2 00000020:01000004:2.0:1783144328.068628:0:90212:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2af728f800 from MGS 00000020:00000080:2.0:1783144328.068646:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144328.068651:0:90212:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783144328.068654:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d53000/MGS 00000020:00000080:2.0:1783144328.068657:0:90212:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d53000/MGS for MGS 00000020:01000000:2.0:1783144328.068662:0:90212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1783144328.068711:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d51800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783144328.068807:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783144328.068811:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144328.068828:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783144328.068836:0:90212:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c29c3efd800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783144328.068842:0:90212:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c2ad08db380) has exports, disconnecting them 00000020:00080000:2.0:1783144328.068850:0:90212:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c29c3efd800), last request at 1783144307 00000020:00000080:2.0:1783144328.068854:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047b8e 00000020:00080000:2.0:1783144328.068862:0:90212:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c3efd800): rc 0 00000020:00000080:2.0:1783144328.068867:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c29c3efd800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783144328.069701:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c3efd800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783144328.072929:0:90212:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783144328.072936:0:90212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144328.072940:0:90212:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783144328.072947:0:90212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144328.073137:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144328.073148:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783144328.073155:0:90212:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2af728f800 1 00000020:00000080:1.0:1783144328.073161:0:90212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047a68 00000020:00000080:1.0:1783144328.073168:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d52000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144328.073256:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ad06c4000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783144328.073263:0:35504:0:(genops.c:906:class_export_put()) final put ffff9c2ad13c3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783144328.073266:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad13c3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783144328.073274:0:35504:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1783144328.073376:0:90212:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783144328.073381:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144328.073384:0:90212:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783144328.073388:0:90212:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c29c3f119c0) has no exports 00000020:00000080:0.0:1783144328.073710:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d52000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144328.106322:0:90212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144328.106335:0:90212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783144328.106340:0:90212:0:(genops.c:906:class_export_put()) final put ffff9c2af728f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144328.106346:0:90212:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783144328.106357:0:90212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783144328.106544:0:90212:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9c2af7288000 00000020:02000400:1.0:1783144328.106615:0:90212:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783144328.142127:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144328.206839:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144328.206858:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501309312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144328.206859:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501309440:0@lo:400:kworker.0 00000100:00100000:0.0:1783144328.206862:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501309568:0@lo:400:kworker.0 00000100:00100000:3.0:1783144328.206908:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501309696:0@lo:400:kworker.0 00000100:00100000:1.0:1783144328.206940:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144328.206941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144328.206971:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309312 00000100:00100000:3.0:1783144328.206978:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309312 00000100:00100000:0.0:1783144328.206985:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309440 00000100:00100000:0.0:1783144328.206991:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309440 00000100:00100000:2.0:1783144328.206995:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501309824:0@lo:400:kworker.0 00000100:00100000:1.0:1783144328.206995:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501309952:0@lo:400:kworker.0 00000100:00100000:3.0:1783144328.207020:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1783144328.207028:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1869759501309312:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1783144328.207038:0:8446:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144328.207039:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144328.207040:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144328.207049:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1783144328.207061:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501309440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144328.207088:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1869759501309312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (148us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144328.207088:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309824 00000100:00100000:2.0:1783144328.207092:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309824 00000100:00100000:3.0:1783144328.207095:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:1.0:1783144328.207114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144328.207127:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:3.0:1783144328.207132:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1869759501309824:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783144328.207137:0:8446:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783144328.207140:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309952 00000100:00100000:2.0:1783144328.207143:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309952 00000100:00100000:2.0:1783144328.207178:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1783144328.207186:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501309952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144328.207288:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501309440:12345-0@lo:400:kworker.0 Request processed in 229us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144328.207293:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501310208:0@lo:400:kworker.0 00000100:00100000:0.0:1783144328.207300:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1783144328.207316:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309696 00000100:00100000:0.0:1783144328.207320:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309696 00000100:00100000:1.0:1783144328.207328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144328.207350:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144328.207356:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501310080:0@lo:400:kworker.0 00000100:00100000:1.0:1783144328.207376:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144328.207398:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310208 00000100:00100000:1.0:1783144328.207401:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310208 00000100:00100000:1.0:1783144328.207421:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1783144328.207425:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869759501310208:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783144328.207430:0:66114:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144328.207456:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869759501310208:12345-0@lo:400:kworker.0 Request processed in 29us (130us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144328.207462:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00080000:1.0:1783144328.207492:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783144328.207497:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783144328.207500:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783144328.207505:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144328.207508:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2847 00000100:00080000:1.0:1783144328.207513:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144328.207533:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e8ce00 x1869759501310336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144328.207552:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501310208:0@lo:400:kworker.0 00000100:00100000:3.0:1783144328.207939:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1869759501309824:12345-0@lo:400:kworker.0 Request processed in 804us (900us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783144328.207948:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1783144328.207951:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501309952:12345-0@lo:400:kworker.0 Request processed in 765us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144328.207962:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1783144328.207990:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310080 00000100:00100000:2.0:1783144328.207994:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310080 00000100:00100000:2.0:1783144328.208024:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1783144328.208033:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501310080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144328.208075:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501310080:12345-0@lo:400:kworker.0 Request processed in 44us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144328.208082:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1783144328.208136:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501310080:0@lo:400:kworker.0 00000100:00080000:2.0:1783144328.208159:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783144328.208162:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783144328.208165:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783144328.208241:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144328.208245:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2847 00000100:00080000:2.0:1783144328.208249:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144328.208265:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca2b8380 x1869759501310464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144328.208276:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501309824:0@lo:400:kworker.0 00000100:02020000:2.0:1783144328.208288:0:3650:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783144328.208291:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783144328.208294:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c2af7208000 already not connected (conn 41, was 40): CONNECTING 00000100:00100000:0.0:1783144328.210194:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1783144328.210206:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501309696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144328.210264:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501309696:12345-0@lo:400:kworker.0 Request processed in 61us (3151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144328.210270:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00080000:0.0:1783144328.210294:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144328.210301:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501309696:0@lo:400:kworker.0 00000100:00080000:0.0:1783144328.210305:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144328.210308:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144328.210343:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501310336:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783144328.210355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144328.210378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144328.210388:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501309184:0@lo:400:kworker.0 00000100:00100000:2.0:1783144328.210400:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309568 00000100:00100000:2.0:1783144328.210406:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309568 00000100:00100000:0.0:1783144328.210408:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501310464:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783144328.210429:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144328.210440:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310336 00000100:00100000:0.0:1783144328.210441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144328.210446:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310336 00000100:00100000:1.0:1783144328.210470:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310464 00000100:00100000:2.0:1783144328.210473:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309184 00000100:00100000:1.0:1783144328.210476:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310464 00000100:00100000:2.0:1783144328.210478:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309184 00000100:00100000:0.0:1783144328.210488:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1783144328.210495:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869759501309568:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783144328.210503:0:66947:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144328.210507:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1783144328.210512:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1783144328.210517:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501310464:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783144328.210522:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501310336:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1783144328.210535:0:23926:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1783144328.210539:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144328.210544:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869759501309568:12345-0@lo:400:kworker.0 Request processed in 45us (187us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144328.210552:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1783144328.210570:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1783144328.210578:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501310464:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 59us (134us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144328.210579:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869759501309184:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783144328.210593:0:66947:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783144328.210594:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501310336:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 70us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144328.210594:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1783144328.210607:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1783144328.210629:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1869759501309184:12345-0@lo:400:kworker.0 Request processed in 51us (200us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144328.210637:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1783144328.210638:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501309952:0@lo:400:kworker.0 00000100:00100000:1.0:1783144328.210656:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501309440:0@lo:400:kworker.0 00000100:00080000:0.0:1783144328.210677:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144328.210683:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144328.210687:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501310336:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1783144328.210699:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144328.210703:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1783144328.210707:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1783144328.210708:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501310464:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783144328.210713:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783144328.210717:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783144328.210741:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144328.210746:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2847 00000100:00080000:1.0:1783144328.210751:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144328.210769:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e8d500 x1869759501310592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144328.210793:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501309568:0@lo:400:kworker.0 00000100:00080000:1.0:1783144328.210804:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783144328.210806:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783144328.210810:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783144328.210817:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144328.210821:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2847 00000100:00080000:1.0:1783144328.210825:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144328.210836:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e8f480 x1869759501310720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144328.210847:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501309184:0@lo:400:kworker.0 00000100:00100000:0.0:1783144328.210857:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501310592:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783144328.210928:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144328.210952:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501310720:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783144328.210972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144328.211037:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310592 00000100:00100000:2.0:1783144328.211041:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310592 00000100:00100000:2.0:1783144328.211061:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310720 00000100:00100000:2.0:1783144328.211065:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310720 00000100:00100000:2.0:1783144328.211081:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1783144328.211086:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501310592:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1783144328.211108:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144328.211141:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1783144328.211149:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501310720:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783144328.211161:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144328.211189:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501310720:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (216us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144328.211195:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1783144328.211200:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501310592:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 57us (215us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144328.211209:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00080000:2.0:1783144328.211238:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144328.211243:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144328.211246:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501310592:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1783144328.211254:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144328.211258:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144328.211268:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501310720:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783144328.804420:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144328.804460:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144328.804475:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481675136 00000100:00100000:1.0:1783144328.804490:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481675136 00000100:00100000:1.0:1783144328.804542:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1142 00000100:00100000:1.0:1783144328.804554:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1869759481675136:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144328.804554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00080000:1.0:1783144328.804566:0:66112:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000400:00000100:0.0:1783144328.804580:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481675008 offset 0 length 224: 4 00000100:00100000:0.0:1783144328.804604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144328.804631:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1869759481675136:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (218us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144328.804640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144328.804644:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1142 00000100:00100000:1.0:1783144328.804662:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481675264 00000100:00100000:1.0:1783144328.804666:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481675264 00000100:00100000:1.0:1783144328.804706:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 792 00000100:00100000:1.0:1783144328.804715:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481675264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144328.804880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144328.804975:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481675392 00000100:00100000:2.0:1783144328.804979:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481675392 00000100:00100000:2.0:1783144328.805011:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481675520 00000100:00100000:2.0:1783144328.805014:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481675520 00000100:00100000:1.0:1783144328.805038:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481675264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144328.805039:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2014 00000100:00100000:1.0:1783144328.805054:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 792 00000100:00100000:2.0:1783144328.805056:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:2404:x1869759481675392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144328.805091:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:2404:x1869759481675392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144328.805107:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2014 00000100:00080000:1.0:1783144328.805110:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144328.805120:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144328.805122:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144328.805133:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2015 00000100:00100000:2.0:1783144328.805144:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481675520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144328.805171:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481675520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144328.805178:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2015 00000100:00100000:1.0:1783144328.805240:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481675648 00000100:00100000:1.0:1783144328.805245:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481675648 00002000:00100000:1.0:1783144328.805274:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9c29c9e8b480 x1869759481675648/t0(0) o4->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:439/0 lens 488/0 e 0 to 0 dl 1783144339 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144328.805285:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e8b480 with x1869759481675648 ext(1048576->2097151) 00002000:00010000:1.0:1783144328.805291:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e8b480 00000100:00100000:0.0:1783144328.805305:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481675776 00000100:00100000:0.0:1783144328.805310:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481675776 00000100:00100000:1.0:1783144328.805314:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 750 00000100:00100000:1.0:1783144328.805324:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481675648:12345-192.168.203.4@tcp:4:md5sum.0 00000100:00100000:0.0:1783144328.805344:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4952 00000100:00100000:0.0:1783144328.805353:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481675776:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:1.0:1783144328.807176:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144328.807197:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481675904 00000100:00100000:1.0:1783144328.807202:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481675904 00000100:00100000:1.0:1783144328.807227:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1143 00000100:00100000:1.0:1783144328.807233:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1869759481675904:12345-192.168.203.4@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1783144328.807250:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144328.807284:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1869759481675904:12345-192.168.203.4@tcp:38:ptlrpcd_00_01.0 Request processed in 49us (110us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144328.807292:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1143 00000001:00100000:0.0:1783144328.808110:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144328.808115:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2affdde000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783144328.808140:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968826 is committed 00000020:00000080:2.0:1783144328.808174:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2affdde000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783144328.808222:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2affddf800 for lustre-OST0000 00000100:00100000:0.0:1783144328.808227:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481675776:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 2872us (3344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144328.808239:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4952 00000100:00100000:2.0:1783144328.822191:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481675648:12345-192.168.203.4@tcp:4:md5sum.0 Request processed in 16861us (17634us total) trans 4294968827 rc 0/0 00000100:00100000:2.0:1783144328.822204:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 750 00002000:00100000:2.0:1783144328.822217:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9c29c9e8b480 x1869759481675648/t4294968827(0) o4->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:439/0 lens 488/448 e 0 to 0 dl 1783144339 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144328.822226:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e8b480 with x1869759481675648 ext(1048576->2097151) 00002000:00010000:2.0:1783144328.822241:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e8b480 00010000:00010000:0.0:1783144329.166107:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144330.189969:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144330.766039:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501310848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144330.766133:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144330.766248:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310848 00000100:00100000:1.0:1783144330.766282:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501310976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144330.766313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144330.766351:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501310976 00000100:00100000:0.0:1783144330.766362:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310976 00000100:00100000:3.0:1783144330.766375:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501310848 00000100:00100000:0.0:1783144330.766469:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:0.0:1783144330.766479:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501310976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144330.766508:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144330.766516:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:3.0:1783144330.766526:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501310848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144330.766545:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144330.766569:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501310976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144330.766576:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:3.0:1783144330.766590:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501310848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144330.766598:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:0.0:1783144330.766629:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501310976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144330.766710:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501310848:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783144330.766816:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144330.766820:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783144331.213913:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144332.238119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783144332.815160:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144332.815169:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7c000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783144332.815194:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968826 is committed 00000020:00000080:3.0:1783144332.815252:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783144332.815300:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aefa7b000 for lustre-OST0001 00010000:00010000:0.0:1783144333.261842:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783144333.326581:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144333.326599:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144333.326602:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144333.326610:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2862 00000100:00080000:2.0:1783144333.326616:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783144333.326623:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144333.326646:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca2bbb80 x1869759501311232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144333.326658:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501311104:0@lo:400:kworker.0 00000100:00080000:2.0:1783144333.326674:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144333.326679:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144333.326681:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144333.326685:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2862 00000100:00080000:2.0:1783144333.326689:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783144333.326693:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144333.326706:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca2bb480 x1869759501311488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1783144333.326710:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501311104 offset 0 length 224: 4 00000100:00080000:2.0:1783144333.326763:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144333.326767:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144333.326770:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144333.326773:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2862 00000100:00080000:2.0:1783144333.326777:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1783144333.326778:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144333.326785:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501311360:0@lo:400:kworker.0 00000100:00080000:2.0:1783144333.326808:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144333.326818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144333.326826:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca2bad80 x1869759501311744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144333.326850:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501311232:0@lo:38:kworker.0 00000100:00100000:0.0:1783144333.326864:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501311872:0@lo:400:kworker.0 00000100:00080000:2.0:1783144333.326869:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144333.326874:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144333.326876:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144333.326881:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2862 00000100:00080000:2.0:1783144333.326885:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783144333.326890:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144333.326895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144333.326902:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144333.326919:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501311488:0@lo:38:kworker.0 00000100:00100000:2.0:1783144333.326919:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca2b9180 x1869759501312128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144333.326924:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144333.326935:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501311616:0@lo:400:kworker.0 00000100:00100000:3.0:1783144333.326957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144333.326969:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144333.326975:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501312000:0@lo:400:kworker.0 00000100:00100000:3.0:1783144333.326986:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501311744:0@lo:38:kworker.0 00000100:00100000:0.0:1783144333.327003:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501311360 00000100:00100000:0.0:1783144333.327011:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501311360 00000100:00100000:2.0:1783144333.327021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144333.327026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144333.327070:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501312128:0@lo:38:kworker.0 00000100:00100000:2.0:1783144333.327084:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501311872 00000100:00100000:2.0:1783144333.327089:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501311872 00000100:00100000:3.0:1783144333.327095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144333.327127:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501311744 00000100:00100000:3.0:1783144333.327132:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501311744 00000100:00100000:3.0:1783144333.327158:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1783144333.327166:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501311744:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144333.327171:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501311232 00000100:00100000:1.0:1783144333.327175:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501311232 00010000:00020000:3.0:1783144333.327183:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144333.327193:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501311488 00000100:00100000:1.0:1783144333.327195:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501311488 00000100:00100000:1.0:1783144333.327209:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501311616 00000100:00100000:1.0:1783144333.327212:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501311616 00000100:00100000:3.0:1783144333.327220:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501311744:12345-0@lo:38:kworker.0 Request processed in 54us (198us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144333.327227:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00080000:3.0:1783144333.327258:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144333.327263:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144333.327266:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501311744:0@lo:38:kworker.0 00000100:00100000:3.0:1783144333.327298:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501312128 00000100:00100000:3.0:1783144333.327301:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501312128 00000100:00100000:3.0:1783144333.327316:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1783144333.327320:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501311232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144333.327330:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144333.327358:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501311232:12345-0@lo:38:kworker.0 Request processed in 36us (467us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144333.327363:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1783144333.327375:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1783144333.327379:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501311488:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144333.327386:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144333.327411:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501311488:12345-0@lo:38:kworker.0 Request processed in 30us (455us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144333.327416:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1783144333.327660:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1783144333.327666:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501311360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144333.327710:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501311360:12345-0@lo:400:kworker.0 Request processed in 44us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144333.327718:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1783144333.327739:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501312000 00000100:00100000:2.0:1783144333.327745:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501312000 00000100:00100000:2.0:1783144333.327770:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:2.0:1783144333.327777:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501311872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144333.327814:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1783144333.327820:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501311872:12345-0@lo:400:kworker.0 Request processed in 42us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144333.327822:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501312128:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144333.327836:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00010000:00020000:3.0:1783144333.327842:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144333.327860:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1783144333.327871:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501312000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144333.327879:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501312128:12345-0@lo:38:kworker.0 Request processed in 56us (783us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144333.327887:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1783144333.327912:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501312000:12345-0@lo:400:kworker.0 Request processed in 43us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144333.327925:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00080000:3.0:1783144333.327928:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144333.327935:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144333.327940:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501312128:0@lo:38:kworker.0 00000100:00080000:3.0:1783144333.327955:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144333.327959:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144333.327964:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501311232:0@lo:38:kworker.0 00000100:00080000:3.0:1783144333.327978:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144333.327984:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144333.327988:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501311488:0@lo:38:kworker.0 00000100:00100000:2.0:1783144333.328020:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501312000:0@lo:400:kworker.0 00000100:00100000:2.0:1783144333.328171:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501311360:0@lo:400:kworker.0 00000100:00100000:2.0:1783144333.328217:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501311872:0@lo:400:kworker.0 00000100:00080000:2.0:1783144333.328238:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144333.328241:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144333.328243:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144333.328350:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00080000:2.0:1783144333.328361:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144333.328361:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501311616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144333.328415:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501311616:12345-0@lo:400:kworker.0 Request processed in 57us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144333.328424:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1783144333.328451:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501311616:0@lo:400:kworker.0 00000001:00100000:0.0:1783144333.842973:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783144333.843051:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378734 is committed 00000020:00000080:0.0:1783144333.843067:0:75517:0:(genops.c:906:class_export_put()) final put ffff9c2affdd8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783144333.843224:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2affdd8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1783144333.843317:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2affddc000 for lustre-MDT0001 00000100:00100000:1.0:1783144333.922695:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144333.922795:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000400:00000100:1.0:1783144333.922814:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481676032 offset 0 length 224: 4 00000100:00100000:1.0:1783144333.922830:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144333.922854:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144333.922876:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481676544 00000100:00100000:1.0:1783144333.922884:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481676544 00000100:00100000:0.0:1783144333.922902:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481676416 00000100:00100000:0.0:1783144333.922908:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481676416 00000100:00100000:1.0:1783144333.922956:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2018 00000100:00100000:1.0:1783144333.922966:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+7:2405:x1869759481676544:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144333.923030:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+7:2405:x1869759481676544:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144333.923042:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2018 00000100:00100000:1.0:1783144333.923067:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2019 00000100:00100000:1.0:1783144333.923074:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+8:2405:x1869759481676416:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144333.923098:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:cace81e7-a6f2-4d37-b197-caf34583781c+8:2405:x1869759481676416:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144333.923120:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2019 00000100:00100000:2.0:1783144333.923929:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481676288 00000100:00100000:2.0:1783144333.923934:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481676288 00000100:00100000:2.0:1783144333.923966:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481676160 00000100:00100000:2.0:1783144333.923969:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481676160 00000100:00100000:2.0:1783144333.923989:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 795 00000100:00100000:2.0:1783144333.923996:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481676288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144333.924031:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481676288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144333.924038:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 795 00000100:00100000:2.0:1783144333.924052:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1147 00000100:00100000:2.0:1783144333.924070:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481676160:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:2.0:1783144333.924087:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144333.924110:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481676160:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 39us (1255us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144333.924123:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1147 00000100:00080000:0.0:1783144333.924388:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783144333.924393:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144333.924395:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783144334.286627:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783144334.352197:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968827 is committed 00010000:00010000:2.0:1783144335.310773:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144335.885902:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501312256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144335.885975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144335.886151:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144335.886170:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501312256 00000100:00100000:0.0:1783144335.886179:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501312256 00000100:00100000:0.0:1783144335.886308:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:0.0:1783144335.886320:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501312256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144335.886353:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144335.886404:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501312256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144335.886412:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:0.0:1783144335.886457:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501312256:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783144335.886560:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144335.887908:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501312384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144335.887959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144335.888158:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501312384 00000100:00100000:3.0:1783144335.888164:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501312384 00000100:00100000:3.0:1783144335.888342:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:3.0:1783144335.888352:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501312384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144335.888392:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783144335.888445:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501312384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144335.888451:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00080000:1.0:1783144335.888481:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144335.888533:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501312384:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783144336.334053:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144337.358084:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144338.384363:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144338.445905:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144338.445909:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144338.445913:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144338.445919:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2867 00000100:00080000:1.0:1783144338.445924:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144338.445929:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144338.445941:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144338.445946:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e8e300 x1869759501312640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144338.445958:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501312512:0@lo:400:kworker.0 00000100:00080000:1.0:1783144338.445993:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144338.445998:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144338.446000:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144338.446004:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2867 00000100:00080000:1.0:1783144338.446008:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000400:00000100:3.0:1783144338.446009:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501312512 offset 0 length 224: 4 00000100:00080000:1.0:1783144338.446013:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144338.446036:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e8e680 x1869759501312896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144338.446061:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783144338.446067:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501312640:0@lo:38:kworker.0 00000100:00080000:1.0:1783144338.446067:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144338.446070:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783144338.446110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144338.446131:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501313024:0@lo:400:kworker.0 00000100:00100000:2.0:1783144338.446133:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501312896:0@lo:38:kworker.0 00000100:00100000:2.0:1783144338.446152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144338.446173:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501312768:0@lo:400:kworker.0 00000100:00100000:2.0:1783144338.446185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144338.446201:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501312640 00000100:00100000:0.0:1783144338.446208:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501312640 00000100:00100000:2.0:1783144338.446213:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501312896 00000100:00100000:2.0:1783144338.446216:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501312896 00000100:00100000:2.0:1783144338.446233:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313024 00000100:00100000:2.0:1783144338.446235:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313024 00000100:00100000:0.0:1783144338.446243:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00080000:1.0:1783144338.446248:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2867 00000100:00100000:0.0:1783144338.446252:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501312896:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1783144338.446253:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1783144338.446268:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00080000:1.0:1783144338.446270:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00010000:00020000:0.0:1783144338.446273:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144338.446284:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e8fb80 x1869759501313152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144338.446323:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783144338.446325:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501312896:12345-0@lo:38:kworker.0 Request processed in 73us (169us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783144338.446329:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144338.446334:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144338.446338:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2867 00000100:00080000:1.0:1783144338.446350:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144338.446356:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144338.446362:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501313024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144338.446371:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e8dc00 x1869759501313536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144338.446394:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144338.446402:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501313408:0@lo:400:kworker.0 00000100:00100000:3.0:1783144338.446412:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501313024:12345-0@lo:400:kworker.0 Request processed in 55us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144338.446428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144338.446446:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144338.446449:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501313280:0@lo:400:kworker.0 00000100:00100000:1.0:1783144338.446461:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144338.446488:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313408 00000100:00100000:1.0:1783144338.446490:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313408 00000100:00100000:1.0:1783144338.446512:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313280 00000100:00100000:1.0:1783144338.446514:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313280 00000100:00100000:1.0:1783144338.446526:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1783144338.446530:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501313408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144338.446553:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501313408:12345-0@lo:400:kworker.0 Request processed in 23us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144338.446557:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1783144338.446574:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1783144338.446578:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501313280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144338.446596:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501313280:12345-0@lo:400:kworker.0 Request processed in 18us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144338.446599:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00080000:1.0:1783144338.446614:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144338.446615:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144338.446630:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501313280:0@lo:400:kworker.0 00000100:00100000:1.0:1783144338.446636:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501313408:0@lo:400:kworker.0 00000100:00100000:2.0:1783144338.447523:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1783144338.447529:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501312640:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144338.447529:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00010000:00020000:2.0:1783144338.447541:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144338.447552:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1783144338.447576:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501312640:12345-0@lo:38:kworker.0 Request processed in 46us (1465us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144338.447576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144338.447583:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1783144338.447587:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501312768 00000100:00100000:1.0:1783144338.447594:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501312768 00000100:00100000:3.0:1783144338.447612:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501313152:0@lo:38:kworker.0 00000100:00100000:2.0:1783144338.447617:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501313024:0@lo:400:kworker.0 00000100:00080000:0.0:1783144338.447621:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144338.447637:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1783144338.447650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144338.447654:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501312768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144338.447698:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501312768:12345-0@lo:400:kworker.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144338.447705:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1783144338.447750:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501313536:0@lo:38:kworker.0 00000100:00100000:3.0:1783144338.447774:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144338.447806:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144338.447812:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144338.447818:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501312640:0@lo:38:kworker.0 00000100:00100000:1.0:1783144338.447819:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501312768:0@lo:400:kworker.0 00000100:00080000:3.0:1783144338.447835:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144338.447839:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144338.447843:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501312896:0@lo:38:kworker.0 00000100:00100000:2.0:1783144338.447904:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313152 00000100:00100000:2.0:1783144338.447908:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313152 00000100:00100000:2.0:1783144338.447965:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:2.0:1783144338.447979:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501313152:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144338.447983:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313536 00000100:00100000:0.0:1783144338.447988:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313536 00010000:00020000:2.0:1783144338.447992:0:8447:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144338.448014:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1783144338.448020:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501313536:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783144338.448040:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144338.448043:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501313152:12345-0@lo:38:kworker.0 Request processed in 62us (393us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144338.448052:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00080000:1.0:1783144338.448068:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783144338.448074:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501313536:12345-0@lo:38:kworker.0 Request processed in 52us (298us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783144338.448075:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144338.448083:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501313152:0@lo:38:kworker.0 00000100:00100000:0.0:1783144338.448090:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00080000:1.0:1783144338.448102:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144338.448108:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144338.448112:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501313536:0@lo:38:kworker.0 00000100:00100000:1.0:1783144339.044066:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144339.044140:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144339.045612:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481676800 00000100:00100000:0.0:1783144339.045622:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481676800 00000100:00100000:3.0:1783144339.045659:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481676928 00000100:00100000:0.0:1783144339.045674:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1151 00000100:00100000:3.0:1783144339.045677:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481676928 00000100:00100000:0.0:1783144339.045685:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481676800:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:0.0:1783144339.045718:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144339.045797:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481676800:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 113us (1738us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144339.045804:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1151 00000100:00100000:0.0:1783144339.045826:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 798 00000100:00100000:0.0:1783144339.045832:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481676928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144339.045865:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481676928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 33us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144339.045871:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 798 00000100:00080000:0.0:1783144339.045891:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144339.047154:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000400:00000100:1.0:1783144339.047184:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481676672 offset 0 length 224: 4 00000100:00100000:0.0:1783144339.047388:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481677184 00000100:00100000:0.0:1783144339.047393:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481677184 00000100:00100000:0.0:1783144339.047448:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2022 00000100:00100000:0.0:1783144339.047457:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:cace81e7-a6f2-4d37-b197-caf34583781c+7:2405:x1869759481677184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144339.047505:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:cace81e7-a6f2-4d37-b197-caf34583781c+7:2405:x1869759481677184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144339.047512:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2022 00000100:00100000:1.0:1783144339.047999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00080000:2.0:1783144339.048213:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144339.048268:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481677056 00000100:00100000:0.0:1783144339.048273:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481677056 00000100:00100000:0.0:1783144339.048372:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2023 00000100:00100000:0.0:1783144339.048381:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481677056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144339.048425:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2405:x1869759481677056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144339.048432:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2023 00000100:00080000:2.0:1783144339.048672:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783144339.406900:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144340.430391:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144341.005969:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501313792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144341.005970:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501313664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144341.006054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144341.006106:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313792 00000100:00100000:0.0:1783144341.006115:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313792 00000100:00100000:0.0:1783144341.006181:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:0.0:1783144341.006191:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501313792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144341.006219:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783144341.006282:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144341.006291:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501313792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144341.006312:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:3.0:1783144341.006320:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313664 00000100:00100000:1.0:1783144341.006429:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501313792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144341.006488:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313664 00000100:00100000:3.0:1783144341.006523:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:3.0:1783144341.006530:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501313664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144341.006546:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144341.006587:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501313664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144341.006593:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:0.0:1783144341.006762:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501313664:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783144341.006863:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144341.006867:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783144341.454222:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144342.478892:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783144343.387265:0:90829:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783144343.387283:0:90829:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783144343.387284:0:90829:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783144343.387409:0:90829:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c2aefa79000 00000020:01000004:2.0:1783144343.387429:0:90829:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783144343.387445:0:90829:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783144343.387462:0:90829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2af9c799c0) 00000020:00000080:2.0:1783144343.387484:0:90829:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783144343.444063:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783144343.445842:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783144343.449489:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783144343.453139:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783144343.453413:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783144343.453602:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783144343.453849:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783144343.454019:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783144343.454239:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783144343.454450:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783144343.454651:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783144343.454811:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.455191:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.455592:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.455811:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.455979:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.456152:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.456606:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.456817:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.457000:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.457153:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.457391:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.457575:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.457836:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.458037:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.458359:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.458565:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.458762:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.458999:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.459190:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.459568:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.459774:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783144343.460000:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.460491:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.460747:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783144343.461462:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783144343.461843:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783144343.462132:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783144343.462345:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.462552:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.462809:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.463156:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783144343.463306:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.463432:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.463607:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783144343.463768:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.463932:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783144343.465258:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.465539:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.465693:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.466359:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.466640:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144343.466902:0:90829:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1783144343.467407:0:90829:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783144343.467613:0:90829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783144343.467619:0:90829:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783144343.467627:0:90829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048073 00000020:01000004:3.0:1783144343.467632:0:90829:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783144343.467641:0:90829:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783144343.467645:0:90829:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2aefa79000 from MGS 00000020:01000004:3.0:1783144343.467647:0:90829:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783144343.467654:0:90829:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c2aee590000) 00000020:00000080:3.0:1783144343.467662:0:90829:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783144343.467765:0:90829:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aefa79000 from MGS, refs=2 00080000:01000000:3.0:1783144343.467770:0:90829:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783144343.467775:0:90829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048081 00010000:00010000:3.0:1783144343.467891:0:90829:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783144343.470647:0:90829:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783144343.472925:0:90834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783144343.472971:0:90829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783144343.473024:0:90829:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783144343.475126:0:90829:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783144343.475367:0:90829:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783144343.475882:0:90829:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783144343.475887:0:90829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783144343.476389:0:90829:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783144343.476396:0:90829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783144343.476753:0:90829:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783144343.476759:0:90829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783144343.477300:0:90829:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783144343.477320:0:90829:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783144343.477321:0:90829:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783144343.477325:0:90829:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1783144343.477330:0:90829:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783144343.477335:0:90829:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783144343.477339:0:90829:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783144343.477341:0:90829:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783144343.477348:0:90829:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c29ca2b9f80 x1869759501311104/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144349 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144343.477366:0:90829:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c29c9e8f800 x1869759501312512/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783144343.477385:0:90829:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783144343.477388:0:90829:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783144343.477389:0:90829:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783144343.477393:0:90829:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1783144343.477404:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501311104:0@lo:400:kworker.0 00000100:00100000:2.0:1783144343.477454:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501312512:0@lo:400:kworker.0 10000000:01000000:3.0:1783144343.477486:0:90829:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1783144343.477502:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477512:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477518:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1783144343.477531:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.477541:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7800/0xad8e53a423047c4b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.477558:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047bb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477575:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047bb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477580:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.477595:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.477600:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01200/0xad8e53a423047bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047bb8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.477614:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047bd4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477629:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047bd4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477636:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.477644:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.477648:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1200/0xad8e53a423047bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047bd4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.477662:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047bfe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477669:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047bfe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477675:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.477681:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.477685:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01400/0xad8e53a423047bf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047bfe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.477704:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047c0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477710:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047c0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477715:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.477880:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.477885:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00600/0xad8e53a423047c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047c0c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.477894:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047c28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477900:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047c28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477904:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.477917:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.477921:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d200/0xad8e53a423047c21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047c28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.477930:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477938:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477943:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.477960:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.477964:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a423047c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.477974:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047c60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.477985:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047c60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.477999:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.478002:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.478005:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6200/0xad8e53a423047c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047c60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.478016:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047bc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.478024:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047bc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.478029:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.478039:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.478042:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6c00/0xad8e53a423047bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047bc6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.478054:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047be2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.478061:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047be2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.478075:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.478082:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.478088:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a423047bdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047be2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.478099:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047bf0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.478105:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047bf0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.478111:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144343.478118:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.478122:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423047be9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047bf0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.478131:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047c1a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.478138:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047c1a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.478143:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144343.478149:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.478154:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423047c13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047c1a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.478164:0:90829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423047c44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.478180:0:90829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423047c44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.478186:0:90829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144343.478192:0:90829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144343.478197:0:90829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a423047c3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423047c44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783144343.478211:0:90829:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2ac6d92000 already not connected (conn 53, was 0): DISCONN 00000100:00080000:3.0:1783144343.478216:0:90829:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144343.478220:0:90829:0:(import.c:512:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 2841 00000100:00080000:3.0:1783144343.478225:0:90829:0:(import.c:626:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c2ac6d92000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144343.478247:0:90829:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca609c00 x1869759501313920/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144343.478264:0:90829:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1783144343.478838:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501313920:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783144343.478889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.478968:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501313920 00000100:00100000:3.0:1783144343.478974:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501313920 00000100:00100000:3.0:1783144343.479009:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783144343.479016:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1869759501313920:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783144343.479035:0:90835:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo t0 exp 0000000000000000 cur 2877 last 0 00000020:00000080:3.0:1783144343.479056:0:90835:0:(genops.c:1406:class_connect()) connect: client 4e9e4714-8000-4c64-bed6-3cadd5fdfc80, cookie 0xad8e53a423048088 00000100:00080000:3.0:1783144343.479154:0:90835:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d52000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144343.479207:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3647:x1869759501313920:12345-0@lo:250:mount.lustre.0 Request processed in 189us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.479217:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783144343.479235:0:3647:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 26 00000100:00080000:0.0:1783144343.479244:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1783144343.479251:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783144343.479254:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783144343.479257:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783144343.479259:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783144343.479289:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783144343.479302:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501313920:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1783144343.479319:0:35504:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.104@tcp 10000000:01000000:3.0:1783144343.479336:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1783144343.479339:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783144343.479341:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783144343.479343:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144343.479344:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144343.479346:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144343.479348:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144343.479349:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783144343.479351:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144343.479352:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783144343.479383:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783144343.479389:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1783144343.479391:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783144343.479392:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783144343.479393:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144343.479393:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144343.479394:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144343.479395:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144343.479396:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783144343.479397:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144343.479398:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783144343.479408:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783144343.479410:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1783144343.479412:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783144343.479412:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783144343.479413:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144343.479414:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144343.479415:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144343.479416:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144343.479417:0:35504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144343.479418:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144343.479419:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783144343.479432:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1783144343.479450:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501314304:0@lo:253:kworker.0 00000100:00100000:2.0:1783144343.479473:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501314048:0@lo:253:kworker.0 00000100:00100000:3.0:1783144343.479482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144343.479515:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144343.479544:0:90829:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000100:00100000:2.0:1783144343.479547:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:01000004:1.0:1783144343.479554:0:90829:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:2.0:1783144343.479555:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501314176:0@lo:253:kworker.0 00000020:01000004:1.0:1783144343.479586:0:90829:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000100:00100000:2.0:1783144343.479589:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783144343.479592:0:90829:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:0.0:1783144343.479650:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314304 00000100:00100000:0.0:1783144343.479656:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314304 00000040:01000000:1.0:1783144343.479670:0:90829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000100:00100000:0.0:1783144343.479690:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314048 00000020:01000004:1.0:1783144343.479692:0:90829:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000100:00100000:0.0:1783144343.479694:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314048 00000020:01000004:1.0:1783144343.479700:0:90829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783144343.479702:0:90829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144343.479702:0:90829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144343.479703:0:90829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144343.479704:0:90829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144343.479706:0:90829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144343.479707:0:90829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144343.479709:0:90829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144343.479710:0:90829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:0.0:1783144343.479711:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314176 00000020:01000004:1.0:1783144343.479712:0:90829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783144343.479717:0:90829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000100:00100000:0.0:1783144343.479717:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314176 00000020:01000004:1.0:1783144343.479766:0:90829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783144343.479768:0:90829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144343.479769:0:90829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144343.479770:0:90829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144343.479771:0:90829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144343.479773:0:90829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144343.479774:0:90829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144343.479775:0:90829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144343.479777:0:90829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144343.479778:0:90829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783144343.479790:0:90829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783144343.479800:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783144343.479824:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783144343.479833:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3648:x1869759501314304:12345-0@lo:253:kworker.0 00000100:00100000:1.0:1783144343.479838:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.479850:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad4c42000 going to sleep for 11 seconds 20000000:01000000:0.0:1783144343.479857:0:90837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1783144343.479909:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314432 00000100:00100000:3.0:1783144343.479912:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314432 00000100:00100000:3.0:1783144343.479926:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783144343.479937:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3650:x1869759501314048:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783144343.479954:0:90835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:0.0:1783144343.480133:0:90838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783144343.480206:0:90837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 112 20000000:01000000:1.0:1783144343.484085:0:90839:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783144343.484092:0:90839:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783144343.484096:0:90839:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783144343.484098:0:90839:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783144343.484392:0:90839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783144343.484561:0:90837:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783144343.484580:0:90837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783144343.485899:0:90837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783144343.485910:0:90837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783144343.485938:0:90835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783144343.485939:0:90838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783144343.485944:0:90838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783144343.485964:0:90838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.485977:0:90838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144343.486003:0:90838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000059475s 00010000:00010000:0.0:1783144343.486009:0:90838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486017:0:90838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486024:0:90838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486031:0:90838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486038:0:90838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144343.486043:0:90838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486051:0:90838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486064:0:90838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486072:0:90838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.486078:0:90838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304808f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144343.486258:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3648:x1869759501314304:12345-0@lo:253:kworker.0 Request processed in 6423us (6773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.486273:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1783144343.486276:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783144343.486279:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783144343.486280:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144343.486281:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144343.486282:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144343.486284:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144343.486285:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144343.486286:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144343.486287:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783144343.486291:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501314304:0@lo:253:kworker.0 00000100:00100000:2.0:1783144343.486312:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783144343.486323:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3650:x1869759501314176:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783144343.486405:0:90837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783144343.488064:0:90835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783144343.488108:0:90837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783144343.488368:0:90835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783144343.488389:0:90838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783144343.488400:0:90838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783144343.488414:0:90838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488426:0:90838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144343.488433:0:90838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000059475s 00010000:00010000:0.0:1783144343.488447:0:90838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488455:0:90838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488461:0:90838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488467:0:90838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488472:0:90838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144343.488476:0:90838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488484:0:90838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488494:0:90838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488501:0:90838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.488517:0:90838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3c000/0xad8e53a423048096 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144343.490365:0:90837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783144343.490384:0:90837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783144343.490468:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3650:x1869759501314048:12345-0@lo:253:kworker.0 Request processed in 10525us (10946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.490479:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:1.0:1783144343.490482:0:90838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783144343.490487:0:90838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783144343.490504:0:90838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144343.490513:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783144343.490517:0:90838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144343.490522:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:90829:x1869759501314432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144343.490545:0:90838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000059475s 00010000:00010000:1.0:1783144343.490550:0:90838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144343.490554:0:90835:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783144343.490556:0:90835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00010000:00010000:1.0:1783144343.490557:0:90838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144343.490559:0:90835:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1783144343.490564:0:90835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00010000:00010000:1.0:1783144343.490568:0:90838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.490576:0:90838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.490581:0:90838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144343.490585:0:90838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.490592:0:90838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.490602:0:90838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.490609:0:90838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.490615:0:90838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8800/0xad8e53a42304809d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783144343.490755:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783144343.490757:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783144343.490758:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144343.490759:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144343.490760:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144343.490761:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144343.490761:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783144343.490762:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144343.490763:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783144343.490766:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501314048:0@lo:253:kworker.0 00000100:00100000:2.0:1783144343.490783:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:3650:x1869759501314176:12345-0@lo:253:kworker.0 Request processed in 4453us (11185us total) trans 0 rc 0/0 00000020:01000004:3.0:1783144343.490784:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783144343.490787:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783144343.490789:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144343.490791:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144343.490793:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144343.490794:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144343.490795:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783144343.490797:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144343.490798:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783144343.490799:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783144343.490801:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501314176:0@lo:253:kworker.0 00000100:00100000:0.0:1783144343.490932:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:90829:x1869759501314432:12345-0@lo:253:mount.lustre.0 Request processed in 412us (11097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.490937:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783144343.491001:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314432:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783144343.491019:0:90829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783144343.491021:0:90829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783144343.491022:0:90829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144343.491024:0:90829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144343.491025:0:90829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144343.491026:0:90829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144343.491027:0:90829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144343.491028:0:90829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144343.491030:0:90829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144343.491031:0:90829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144343.491032:0:90829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783144343.491046:0:90829:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2aefa79000 from lustre-MDT0000 10000000:01000000:1.0:1783144343.491073:0:90829:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783144343.491076:0:90829:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783144343.491090:0:90829:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2aefa79000 10000000:01000000:1.0:1783144343.491094:0:90829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783144343.491098:0:90829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2aefa79000 10000000:01000000:1.0:1783144343.491101:0:90829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783144343.491104:0:90829:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2aefa79000 from 1 10000000:01000000:1.0:1783144343.491107:0:90829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783144343.491130:0:90829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.491139:0:90829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.491147:0:90829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.491163:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144343.491194:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.491230:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144343.491231:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314560 00000100:00100000:3.0:1783144343.491244:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314560 00000100:00100000:3.0:1783144343.491331:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783144343.491385:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:90829:x1869759501314560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144343.491391:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144343.491400:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98f800/0xad8e53a4230480ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230480a4 expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.491412:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98f800/0xad8e53a4230480ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230480a4 expref: 6 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.491418:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98f800/0xad8e53a4230480ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230480a4 expref: 6 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.491422:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f800, rc 0) 00000100:00100000:1.0:1783144343.491495:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144343.491496:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:90829:x1869759501314560:12345-0@lo:101:mount.lustre.0 Request processed in 157us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.491500:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783144343.491518:0:90829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.491528:0:90829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144343.491540:0:90829:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783144343.491586:0:90829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.491594:0:90829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144343.491600:0:90829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783144343.491603:0:90829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783144343.491607:0:90829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2aefa79000 10000000:01000000:1.0:1783144343.491610:0:90829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783144343.491612:0:90829:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783144343.491614:0:90829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783144343.491627:0:90829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.491634:0:90829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.491641:0:90829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.491651:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144343.491682:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.491705:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.491763:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314688 00000100:00100000:0.0:1783144343.491767:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314688 00000100:00100000:0.0:1783144343.491802:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783144343.491810:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:90829:x1869759501314688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144343.491818:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144343.491827:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3d800/0xad8e53a4230480b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230480b2 expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.491841:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3d800/0xad8e53a4230480b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230480b2 expref: 7 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.491849:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3d800/0xad8e53a4230480b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230480b2 expref: 7 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.491861:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d800, rc 0) 00000100:00100000:0.0:1783144343.491890:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:90829:x1869759501314688:12345-0@lo:101:mount.lustre.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.491896:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783144343.491963:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144343.491973:0:90829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.491980:0:90829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.492033:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144343.492056:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.492084:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144343.492130:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314816 00000100:00100000:3.0:1783144343.492135:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314816 00000100:00100000:3.0:1783144343.492163:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783144343.492170:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:90829:x1869759501314816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144343.492313:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90829:x1869759501314816:12345-0@lo:501:mount.lustre.0 Request processed in 143us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.492320:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783144343.492483:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144343.492509:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144343.492544:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.492592:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.492621:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501314944 00000100:00100000:0.0:1783144343.492625:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501314944 00000100:00100000:0.0:1783144343.492683:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783144343.492690:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90829:x1869759501314944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144343.494188:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90829:x1869759501314944:12345-0@lo:503:mount.lustre.0 Request processed in 1496us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.494197:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783144343.494300:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501314944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144343.494623:0:90840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90840:1869759501315072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144343.494651:0:90840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.494701:0:90840:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.494869:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315072 00000100:00100000:0.0:1783144343.494874:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315072 00000100:00100000:0.0:1783144343.494903:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783144343.494910:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90840:x1869759501315072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144343.495983:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90840:x1869759501315072:12345-0@lo:502:llog_process_th.0 Request processed in 1070us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.496002:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783144343.496039:0:90840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90840:1869759501315072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144343.496065:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144343.496075:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.496078:0:90840:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783144343.496083:0:90840:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783144343.496092:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144343.496105:0:90840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c29c31e3380) 00000020:00000080:1.0:1783144343.496124:0:90840:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1783144343.496130:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783144343.496195:0:90840:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783144343.496201:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a4230480c7 00000020:00000080:1.0:1783144343.496405:0:90840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783144343.496409:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144343.496413:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.496414:0:90840:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783144343.496417:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144343.496420:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.496422:0:90840:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783144343.496425:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144343.496431:0:90840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c29c31e4d40) 00000020:00000080:1.0:1783144343.496453:0:90840:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1783144343.496458:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783144343.496460:0:90840:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783144343.496462:0:90840:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783144343.496468:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783144343.496509:0:90840:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aefa79000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783144343.496521:0:90840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c29c31e0000) 00000020:00000080:1.0:1783144343.496533:0:90840:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1783144343.496588:0:90840:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783144343.496594:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a4230480dc 00000020:00000080:1.0:1783144343.496715:0:90840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783144343.496744:0:90840:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783144343.496753:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad8e53a4230480e3 00080000:01000000:1.0:1783144343.496759:0:90840:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783144343.496763:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a4230480ea 00010000:00010000:2.0:1783144343.502133:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144343.541824:0:90840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1783144343.541942:0:90840:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: cace81e7-a6f2-4d37-b197-caf34583781c idx: 0 lr: 103079215115 srv lr: 107374182400 lx: 0 gen 22 00000001:00080000:1.0:1783144343.541982:0:90840:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 21 00000001:00000004:1.0:1783144343.542019:0:90840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:1.0:1783144343.542108:0:90840:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1783144343.542156:0:90840:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2ac11ca180: xid 1869759481669888, transno 107374182407, client gen 22, slot idx 0 00000001:00080000:1.0:1783144343.542165:0:90840:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2ac11ca900: xid 1869759481669632, transno 107374182406, client gen 22, slot idx 1 00000020:00000080:1.0:1783144343.542575:0:90840:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c2af9f14d40) 00000020:00000080:1.0:1783144343.542593:0:90840:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1783144343.542654:0:90840:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783144343.542660:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048106 00000020:00000080:3.0:1783144343.543142:0:90840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783144343.549181:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad8e53a42304810d 00000020:00000080:0.0:1783144343.550323:0:90840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783144343.550335:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144343.550341:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.550343:0:90840:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783144343.550348:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783144343.550350:0:90840:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783144343.550352:0:90840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783144343.550359:0:90840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783144343.550361:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783144343.550363:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.550365:0:90840:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783144343.550367:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144343.550371:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.550373:0:90840:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783144343.550376:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783144343.550416:0:90840:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783144343.550428:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144343.550431:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.550432:0:90840:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783144343.550446:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144343.550449:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.550450:0:90840:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783144343.550453:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783144343.550458:0:90840:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:0.0:1783144343.550479:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144343.550492:0:90840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c2ad08db380) 00000020:00000080:0.0:1783144343.550508:0:90840:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783144343.550512:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783144343.550564:0:90840:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783144343.550568:0:90840:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783144343.550573:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a42304811b 00010000:00080000:0.0:1783144343.550600:0:90840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2af728f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1783144343.552109:0:90840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1783144343.553494:0:90840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144343.553508:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783144343.553539:0:90840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783144343.553559:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048122 00000100:00080000:1.0:1783144343.553568:0:90840:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783144343.553574:0:90840:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2af728f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144343.553604:0:90840:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60b4e00 x1869759501315200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144343.553631:0:90840:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1783144343.553718:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144343.553741:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.553742:0:90840:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783144343.553745:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783144343.553748:0:90840:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1783144343.553749:0:90840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144343.553751:0:90840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144343.553752:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783144343.553754:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.553756:0:90840:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783144343.553758:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783144343.553762:0:90840:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783144343.553765:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.553771:0:90840:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783144343.553775:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783144343.553778:0:90840:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1783144343.553798:0:90840:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783144343.553800:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144343.553811:0:90840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c2af9f10000) 00000020:00000080:1.0:1783144343.553825:0:90840:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783144343.553828:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783144343.553877:0:90840:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783144343.553886:0:90840:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783144343.553891:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048130 00010000:00080000:1.0:1783144343.553920:0:90840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ae4b29800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144343.554070:0:90840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1783144343.554400:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501315200:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783144343.554467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.554591:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315200 00000100:00100000:1.0:1783144343.554597:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315200 00000100:00100000:1.0:1783144343.554628:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1783144343.554634:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501315200:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783144343.554653:0:78024:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2877 last 0 00000020:00000080:1.0:1783144343.554674:0:78024:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048137 00000004:00100000:1.0:1783144343.554685:0:78024:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783144343.554778:0:78024:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144343.554819:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501315200:12345-0@lo:38:llog_process_th.0 Request processed in 185us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144343.554824:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1783144343.554890:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783144343.554895:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1783144343.554900:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783144343.554903:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783144343.554905:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af728f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783144343.554912:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501315200:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783144343.554952:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144343.554957:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501315328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144343.554973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144343.555024:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315328 00000100:00100000:2.0:1783144343.555030:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315328 00000100:00100000:2.0:1783144343.555067:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:2.0:1783144343.555074:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501315328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783144343.555094:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144343.555142:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501315328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.555149:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:0.0:1783144343.555227:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501315328:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1783144343.555357:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144343.555360:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144343.555362:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144343.555369:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2872 00000100:00080000:3.0:1783144343.555372:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783144343.555375:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144343.555388:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca609180 x1869759501315456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144343.555425:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501315456:0@lo:38:kworker.0 00000100:00080000:3.0:1783144343.555429:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144343.555432:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144343.555434:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144343.555437:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2872 00000100:00080000:3.0:1783144343.555440:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783144343.555443:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144343.555454:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca60b800 x1869759501315712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144343.555470:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144343.555473:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144343.555475:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144343.555478:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2872 00000100:00080000:3.0:1783144343.555480:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783144343.555483:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144343.555493:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca60a300 x1869759501315968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144343.555510:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501315584:0@lo:400:kworker.0 00000100:00080000:3.0:1783144343.555518:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144343.555521:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144343.555522:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144343.555530:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2872 00000100:00080000:3.0:1783144343.555533:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783144343.555537:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144343.555539:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.555549:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca60a680 x1869759501316352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144343.555559:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144343.555565:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501315840:0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.555595:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.555629:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315584 00000100:00100000:0.0:1783144343.555632:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315584 00000100:00100000:0.0:1783144343.555660:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315840 00000100:00100000:0.0:1783144343.555663:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315840 00000100:00100000:0.0:1783144343.555682:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1783144343.555688:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501315584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.555745:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501315584:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.555752:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1783144343.555763:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1783144343.555769:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501315840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.555793:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501315840:12345-0@lo:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.555798:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1783144343.555815:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501316096:0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.555836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.555850:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144343.555855:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501316224:0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.555872:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.555891:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316096 00000100:00100000:0.0:1783144343.555894:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316096 00000100:00100000:0.0:1783144343.555914:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316224 00000100:00100000:0.0:1783144343.555916:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316224 00000100:00100000:0.0:1783144343.555931:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1783144343.555936:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501316096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.555964:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501316096:12345-0@lo:400:kworker.0 Request processed in 28us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.555975:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1783144343.555999:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1783144343.556006:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501316224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.556031:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501316224:12345-0@lo:400:kworker.0 Request processed in 26us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.556037:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1783144343.556063:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501315840:0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.556072:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501315584:0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.556094:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501316224:0@lo:400:kworker.0 00000100:00100000:0.0:1783144343.556102:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501316096:0@lo:400:kworker.0 00000100:00100000:2.0:1783144343.556273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144343.556291:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501315712:0@lo:38:kworker.0 00000100:00100000:2.0:1783144343.556309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144343.556322:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501315968:0@lo:38:kworker.0 00000100:00100000:2.0:1783144343.556348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144343.556362:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501316352:0@lo:38:kworker.0 00000100:00100000:2.0:1783144343.556378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144343.556399:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144343.556402:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144343.556404:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144343.556416:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315456 00000100:00100000:2.0:1783144343.556419:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315456 00000100:00100000:1.0:1783144343.556516:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316352 00000100:00100000:1.0:1783144343.556520:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316352 00000100:00100000:1.0:1783144343.556533:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1783144343.556538:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501315456:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144343.556577:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501315456:12345-0@lo:38:kworker.0 Request processed in 38us (304us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144343.556589:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1783144343.556600:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1783144343.556604:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501316352:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144343.556630:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501316352:12345-0@lo:38:kworker.0 Request processed in 25us (251us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144343.556635:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1783144343.556667:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315712 00000100:00100000:2.0:1783144343.556672:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315712 00000100:00100000:2.0:1783144343.556741:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1783144343.556746:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501315712:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144343.556776:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501315712:12345-0@lo:38:kworker.0 Request processed in 29us (466us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783144343.556781:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000040:01000000:0.0:1783144343.556887:0:90840:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783144343.556910:0:90840:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783144343.556973:0:90840:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:2.0:1783144343.557172:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501315968 00000100:00100000:2.0:1783144343.557176:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501315968 00000100:00100000:2.0:1783144343.557237:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1783144343.557244:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501315968:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144343.557279:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501315968:12345-0@lo:38:kworker.0 Request processed in 35us (930us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783144343.557287:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00080000:2.0:1783144343.557358:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144343.557363:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144343.557366:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501315712:0@lo:38:kworker.0 00000100:00080000:2.0:1783144343.557374:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144343.557377:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144343.557379:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501315968:0@lo:38:kworker.0 00000100:00080000:2.0:1783144343.557393:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144343.557397:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144343.557399:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501316352:0@lo:38:kworker.0 00000100:00080000:2.0:1783144343.557406:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144343.557409:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783144343.557412:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501315456:0@lo:38:kworker.0 00000040:00080000:0.0:1783144343.558166:0:90840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783144343.558837:0:90840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:0.0:1783144343.563489:0:90840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:0.0:1783144343.564476:0:90846:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:0.0:1783144343.564481:0:90846:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1783144343.564816:0:90846:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:0.0:1783144343.564843:0:90846:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1783144343.564980:0:90846:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:0.0:1783144343.564983:0:90846:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783144343.565103:0:90840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144343.565114:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783144343.565150:0:90840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783144343.565172:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304813e 00000100:00080000:2.0:1783144343.565181:0:90840:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783144343.565187:0:90840:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2ae4b29800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144343.565219:0:90840:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca2b8380 x1869759501316480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144343.565243:0:90840:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783144343.565302:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144343.565306:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144343.565308:0:90840:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783144343.565311:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783144343.565313:0:90840:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1783144343.565315:0:90840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783144343.565316:0:90840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783144343.565318:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783144343.565320:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144343.565322:0:90840:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783144343.565325:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783144343.565330:0:90840:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783144343.565333:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144343.565339:0:90840:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783144343.565343:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783144343.565347:0:90840:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:2.0:1783144343.565370:0:90840:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:0.0:1783144343.565370:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501316480:0@lo:8:llog_process_th.0 00000020:00000080:2.0:1783144343.565375:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783144343.565387:0:90840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c2af9c7cd40) 00000020:00000080:2.0:1783144343.565402:0:90840:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1783144343.565408:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1783144343.565446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783144343.565471:0:90840:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783144343.565478:0:90840:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783144343.565483:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a42304814c 00010000:00080000:2.0:1783144343.565526:0:90840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ae4b24800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00000100:00100000:3.0:1783144343.565552:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316480 00000100:00100000:3.0:1783144343.565561:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316480 00000100:00100000:3.0:1783144343.565632:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4953 00000100:00100000:3.0:1783144343.565641:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3647:x1869759501316480:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783144343.565678:0:26145:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2877 last 0 00000020:00000080:3.0:1783144343.565704:0:26145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048153 00002000:00100000:3.0:1783144343.565715:0:26145:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c29c722d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783144343.565719:0:26145:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783144343.565751:0:26145:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:2.0:1783144343.565788:0:90840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00002000:00080000:3.0:1783144343.565820:0:26145:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783144343.565843:0:26145:0:(import.c:65:import_set_state_nolock()) ffff9c2ac4df1800 : changing import state from RECOVER to FULL 00000040:01000000:2.0:1783144343.565862:0:90840:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783144343.565876:0:90840:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783144343.565895:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501316480:12345-0@lo:8:llog_process_th.0 Request processed in 253us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.565903:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4953 00000100:00100000:0.0:1783144343.565927:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783144343.565943:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783144343.565951:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783144343.565955:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783144343.565958:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b29800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783144343.566171:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144343.566182:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501316608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144343.566218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.566257:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316608 00000100:00100000:1.0:1783144343.566267:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316608 00000100:00080000:2.0:1783144343.566293:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1783144343.566305:0:90840:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1783144343.566317:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:1.0:1783144343.566327:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501316608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144343.566348:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144343.566388:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501316608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144343.566394:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00100000:1.0:1783144343.566429:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501316608:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1783144343.566481:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783144343.566488:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501316480:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1783144343.566521:0:90846:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783144343.566559:0:90846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2877919836438ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783144343.566565:0:90846:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:2.0:1783144343.567353:0:90840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783144343.567376:0:90840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:2.0:1783144343.567499:0:90840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:2.0:1783144343.568064:0:90848:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:2.0:1783144343.568069:0:90848:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1783144343.568109:0:90830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1783144343.568181:0:90848:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1783144343.568196:0:90848:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1783144343.568309:0:90848:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:2.0:1783144343.568312:0:90848:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783144343.568811:0:90840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144343.568823:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783144343.568856:0:90840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783144343.568877:0:90840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304815a 00000100:00080000:0.0:1783144343.568885:0:90840:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144343.568890:0:90840:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2ae4b24800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144343.568915:0:90840:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c9e88a80 x1869759501316736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144343.568944:0:90840:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783144343.569019:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1783144343.569022:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501316736:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1783144343.569025:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.569029:0:90840:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783144343.569033:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144343.569038:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.569040:0:90840:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783144343.569044:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783144343.569046:0:90840:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783144343.569049:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144343.569052:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.569054:0:90840:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783144343.569056:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144343.569061:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.569062:0:90840:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783144343.569067:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783144343.569079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.569105:0:90840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90840:1869759501316864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144343.569135:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316736 00000100:00100000:2.0:1783144343.569140:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316736 00000100:00100000:0.0:1783144343.569159:0:90840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.569177:0:90840:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47000 going to sleep for 11 seconds 00000100:00100000:2.0:1783144343.569183:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4954 00000100:00100000:2.0:1783144343.569192:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1869759501316736:12345-0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783144343.569205:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316864 00000100:00100000:3.0:1783144343.569210:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316864 00010000:00080000:2.0:1783144343.569215:0:26150:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2877 last 0 00000020:00000080:2.0:1783144343.569241:0:26150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048161 00002000:00100000:2.0:1783144343.569254:0:26150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2ae4b26000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1783144343.569255:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00002000:00080000:2.0:1783144343.569261:0:26150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783144343.569264:0:26150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1783144343.569339:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90840:x1869759501316864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144343.569427:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90840:x1869759501316864:12345-0@lo:502:llog_process_th.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144343.569481:0:90840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90840:1869759501316864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144343.569505:0:90840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144343.569509:0:90840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.569511:0:90840:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783144343.569514:0:90840:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1783144343.569644:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000000:3.0:1783144343.569674:0:90829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783144343.569690:0:90829:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783144343.569711:0:90829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.569742:0:90829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.569751:0:90829:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2aefa79000 from 1 10000000:01000000:3.0:1783144343.569753:0:90829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144343.569778:0:90829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.569786:0:90829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.569796:0:90829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144343.569810:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501316992:0@lo:101:mount.lustre.0 00002000:00080000:2.0:1783144343.569811:0:26150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783144343.569834:0:26150:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b26800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144343.569847:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.569880:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.569882:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501316992 00000100:00100000:2.0:1783144343.569884:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501316736:12345-0@lo:8:llog_process_th.0 Request processed in 690us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.569886:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501316992 00000100:00100000:2.0:1783144343.569895:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4954 00000100:00100000:0.0:1783144343.569921:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783144343.569930:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:90829:x1869759501316992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144343.569939:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144343.569951:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048168 expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.569960:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783144343.569965:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:0.0:1783144343.569969:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048168 expref: 9 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783144343.569971:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00010000:0.0:1783144343.569978:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048168 expref: 9 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783144343.569980:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783144343.569982:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b24800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1783144343.569998:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3c000, rc 0) 00000004:00080000:1.0:1783144343.570004:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783144343.570009:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501316736:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783144343.570031:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:90829:x1869759501316992:12345-0@lo:101:mount.lustre.0 Request processed in 102us (184us total) trans 0 rc 0/0 00000004:00080000:2.0:1783144343.570032:0:90848:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783144343.570040:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:2.0:1783144343.570067:0:90848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2877923344387ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783144343.570073:0:90848:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783144343.570217:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501316992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144343.570229:0:90829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.570248:0:90829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144343.570366:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501317120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144343.570396:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.570598:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501317120 00000100:00100000:1.0:1783144343.570602:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501317120 00000100:00100000:1.0:1783144343.570646:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:1.0:1783144343.570653:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501317120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783144343.570669:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144343.570705:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501317120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144343.570712:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00080000:2.0:1783144343.570764:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144343.570795:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501317120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144343.571238:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783144343.572070:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.572136:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.572189:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501317248 00000100:00100000:0.0:1783144343.572195:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501317248 00000100:00100000:0.0:1783144343.572312:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783144343.572323:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:90829:x1869759501317248:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783144343.572339:0:90835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783144343.572355:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783144343.572360:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783144343.572363:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783144343.572369:0:90835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:0.0:1783144343.572555:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:90829:x1869759501317248:12345-0@lo:256:mount.lustre.0 Request processed in 234us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.572563:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1783144343.572711:0:90830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783144343.572823:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317248:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783144343.573433:0:90829:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783144343.573490:0:90829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.573500:0:90829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144343.573509:0:90829:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2aefa79000 from 1 10000000:01000000:1.0:1783144343.573511:0:90829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783144343.573538:0:90829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.573547:0:90829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.573565:0:90829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.573582:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144343.573615:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.573690:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144343.573822:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501317376 00000100:00100000:3.0:1783144343.573828:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501317376 00000100:00100000:3.0:1783144343.573898:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783144343.573907:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:90829:x1869759501317376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144343.573918:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144343.573930:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98ea00/0xad8e53a42304817d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048176 expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.573948:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98ea00/0xad8e53a42304817d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048176 expref: 10 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.573958:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98ea00/0xad8e53a42304817d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048176 expref: 10 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.573965:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ea00, rc 0) 00000100:00100000:3.0:1783144343.574010:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90829:x1869759501317376:12345-0@lo:101:mount.lustre.0 Request processed in 104us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.574016:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783144343.574077:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144343.574089:0:90829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.574096:0:90829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.574148:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144343.574173:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.574250:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.574278:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501317504 00000100:00100000:0.0:1783144343.574282:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501317504 00000100:00100000:0.0:1783144343.574302:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783144343.574308:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90829:x1869759501317504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144343.574469:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90829:x1869759501317504:12345-0@lo:501:mount.lustre.0 Request processed in 160us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.574476:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783144343.574960:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144343.575001:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144343.575041:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.575069:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144343.575113:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501317632 00000100:00100000:3.0:1783144343.575118:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501317632 00000100:00100000:3.0:1783144343.575187:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783144343.575198:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90829:x1869759501317632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144343.575273:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90829:x1869759501317632:12345-0@lo:503:mount.lustre.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.575279:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783144343.575330:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501317632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144343.575689:0:90850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90850:1869759501317760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144343.575718:0:90850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144343.575818:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501317760 00000100:00100000:0.0:1783144343.575820:0:90850:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd000 going to sleep for 11 seconds 00000100:00100000:2.0:1783144343.575824:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501317760 00000100:00100000:2.0:1783144343.575850:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783144343.575857:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90850:x1869759501317760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144343.576937:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90850:x1869759501317760:12345-0@lo:502:llog_process_th.0 Request processed in 1076us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.576945:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783144343.577033:0:90850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90850:1869759501317760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144343.577053:0:90850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144343.577061:0:90850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.577064:0:90850:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783144343.577069:0:90850:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2aefa79000 00000020:00000080:0.0:1783144343.577071:0:90850:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783144343.577077:0:90850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144343.577078:0:90850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.577079:0:90850:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783144343.577081:0:90850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144343.577082:0:90850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144343.577083:0:90850:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783144343.577085:0:90850:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2aefa79000 00000020:00000080:0.0:1783144343.577086:0:90850:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783144343.577154:0:90850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90850:1869759501317888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144343.577189:0:90850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.577222:0:90850:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783144343.577383:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501317888 00000100:00100000:3.0:1783144343.577388:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501317888 00000100:00100000:3.0:1783144343.577422:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783144343.577429:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90850:x1869759501317888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144343.577518:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90850:x1869759501317888:12345-0@lo:502:llog_process_th.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.577525:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783144343.577675:0:90850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90850:1869759501317888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144343.577694:0:90850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144343.577698:0:90850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144343.577704:0:90850:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783144343.577708:0:90850:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783144343.578059:0:90829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783144343.578084:0:90829:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783144343.578145:0:90829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.578157:0:90829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.578207:0:90829:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783144343.578209:0:90829:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2aefa79000 10000000:01000000:3.0:1783144343.578213:0:90829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2aefa79000 10000000:01000000:3.0:1783144343.578217:0:90829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783144343.578222:0:90829:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2aefa79000 from 1 10000000:01000000:3.0:1783144343.578224:0:90829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144343.578250:0:90829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.578950:0:90829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.578968:0:90829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144343.578998:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144343.579047:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.579073:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.579141:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318016 00000100:00100000:0.0:1783144343.579147:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318016 00000100:00100000:0.0:1783144343.579188:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783144343.579196:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:90829:x1869759501318016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144343.579208:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144343.579221:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304818b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048184 expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.579242:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304818b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048184 expref: 11 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.579252:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304818b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048184 expref: 11 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.579272:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d600, rc 0) 00000100:00100000:0.0:1783144343.579309:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90829:x1869759501318016:12345-0@lo:101:mount.lustre.0 Request processed in 114us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.579316:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783144343.579543:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144343.579557:0:90829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.579565:0:90829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144343.579618:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144343.579642:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.579662:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.580126:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318144 00000100:00100000:0.0:1783144343.580132:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318144 00000100:00100000:0.0:1783144343.580166:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783144343.580184:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90829:x1869759501318144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144343.580313:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90829:x1869759501318144:12345-0@lo:501:mount.lustre.0 Request processed in 140us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.580326:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783144343.580519:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144343.580548:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144343.580585:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.580611:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144343.580614:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318272 00000100:00100000:2.0:1783144343.580619:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318272 00000100:00100000:2.0:1783144343.580644:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783144343.580652:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90829:x1869759501318272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144343.580779:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90829:x1869759501318272:12345-0@lo:503:mount.lustre.0 Request processed in 127us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.580786:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783144343.580819:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144343.581264:0:90852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90852:1869759501318400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144343.581297:0:90852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.581320:0:90852:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144343.581341:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318400 00000100:00100000:0.0:1783144343.581346:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318400 00000100:00100000:0.0:1783144343.581380:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783144343.581388:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90852:x1869759501318400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144343.581656:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90852:x1869759501318400:12345-0@lo:502:llog_process_th.0 Request processed in 270us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.581662:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783144343.581698:0:90852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90852:1869759501318400:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783144343.581774:0:90852:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783144343.581787:0:90852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c2aee593380) 00000020:00000080:3.0:1783144343.581923:0:90852:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1783144343.582080:0:90852:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aefa79000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783144343.582084:0:90852:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aefa79000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783144343.582086:0:90852:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefa79000 4 00010000:00080000:3.0:1783144343.582111:0:90852:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac7fb7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1783144343.584079:0:90852:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1783144343.584185:0:90852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783144343.584244:0:90852:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783144343.584256:0:90852:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad8e53a423048199 00000100:00080000:3.0:1783144343.584265:0:90852:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783144343.584271:0:90852:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ac7fb7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144343.584305:0:90852:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca608700 x1869759501318528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144343.584334:0:90852:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783144343.584357:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501318528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144343.584417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.584468:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318528 00000100:00100000:1.0:1783144343.584473:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318528 00000100:00100000:3.0:1783144343.584495:0:90852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90852:1869759501318656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144343.584512:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1783144343.584519:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501318528:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783144343.584540:0:90852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.584558:0:90852:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783144343.584583:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501318528:12345-0@lo:38:llog_process_th.0 Request processed in 62us (165us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144343.584589:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1783144343.584622:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783144343.584629:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144343.584633:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144343.584638:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501318528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783144343.585035:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318656 00000100:00100000:2.0:1783144343.585041:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318656 00000100:00100000:2.0:1783144343.585082:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783144343.585092:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90852:x1869759501318656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144343.585204:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90852:x1869759501318656:12345-0@lo:502:llog_process_th.0 Request processed in 114us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.585211:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783144343.585218:0:90852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90852:1869759501318656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144343.585260:0:90852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90852:1869759501318784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144343.585296:0:90852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144343.585313:0:90852:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac89f50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144343.585327:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318784 00000100:00100000:3.0:1783144343.585331:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318784 00000100:00100000:3.0:1783144343.585366:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783144343.585383:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90852:x1869759501318784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144343.585455:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90852:x1869759501318784:12345-0@lo:502:llog_process_th.0 Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.585462:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783144343.585501:0:90852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90852:1869759501318784:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783144343.585519:0:90852:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783144343.585600:0:90829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783144343.585623:0:90829:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144343.585645:0:90829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.585656:0:90829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144343.585702:0:90829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783144343.585705:0:90829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144343.585706:0:90829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144343.585707:0:90829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144343.585708:0:90829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144343.585710:0:90829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144343.585711:0:90829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144343.585716:0:90829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144343.585718:0:90829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144343.585791:0:90829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783144343.585795:0:90829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783144343.585798:0:90829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783144343.585799:0:90829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144343.585801:0:90829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144343.585801:0:90829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144343.585802:0:90829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144343.585803:0:90829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144343.585804:0:90829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144343.585805:0:90829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144343.585806:0:90829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144343.585807:0:90829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783144343.585821:0:90829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783144343.585839:0:90829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783144343.585880:0:90829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144343.585898:0:90829:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad14fc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144343.586067:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501318912 00000100:00100000:2.0:1783144343.586072:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501318912 00000100:00100000:2.0:1783144343.586102:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783144343.586109:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90829:x1869759501318912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783144343.586128:0:90837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783144343.586141:0:90837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783144343.590005:0:90837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783144343.590025:0:90837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783144343.590096:0:90838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783144343.590108:0:90838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783144343.590137:0:90838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.590155:0:90838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048168 expref: 11 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.590169:0:90838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.590206:0:90838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048168 expref: 11 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.590229:0:90838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048168 expref: 11 pid: 90837 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.590260:0:90838:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90838:1869759501319040:0@lo:104: 00000100:00100000:3.0:1783144343.590342:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:90829:x1869759501318912:12345-0@lo:253:mount.lustre.0 Request processed in 4231us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.590354:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783144343.590374:0:90829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:90829:1869759501318912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783144343.590384:0:90838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1783144343.590391:0:90829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783144343.590396:0:90829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783144343.590399:0:90829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144343.590401:0:90829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144343.590402:0:90829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144343.590404:0:90829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144343.590406:0:90829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144343.590407:0:90829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144343.590413:0:90829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:3.0:1783144343.590416:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000020:01000004:2.0:1783144343.590416:0:90829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144343.590419:0:90829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144343.590425:0:90838:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144343.590433:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319040 00000020:02000000:2.0:1783144343.590437:0:90829:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1783144343.590439:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319040 00000100:00100000:3.0:1783144343.590481:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1783144343.590491:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c36e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:90838:x1869759501319040:12345-0@lo:104: 00010000:00010000:3.0:1783144343.590503:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.590561:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783144343.590567:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c36e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:90838:x1869759501319040:12345-0@lo:104: Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144343.590575:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:3.0:1783144343.590618:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783144343.590621:0:90838:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90838:1869759501319040:0@lo:104: 00010000:00010000:3.0:1783144343.590624:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144343.590637:0:90838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.590641:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:3.0:1783144343.590645:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.590653:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144343.590660:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144343.590666:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144343.590703:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.590710:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144343.590755:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.590760:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501319168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144343.590764:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e800/0xad8e53a423048168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304816f expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144343.590782:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144343.590785:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144343.590787:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144343.590792:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.590904:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319168 00000100:00100000:0.0:1783144343.590909:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319168 00010000:00010000:0.0:1783144343.590926:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048168 expref: 11 pid: 90837 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144343.591283:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:0.0:1783144343.591292:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3648:x1869759501319168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144343.591303:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144343.591308:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048168 expref: 11 pid: 90837 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591317:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048168 expref: 11 pid: 90837 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591329:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3c000/0xad8e53a42304816f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048168 expref: 11 pid: 90837 timeout: 2977 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591341:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591348:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144343.591365:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001260981s 00010000:00010000:0.0:1783144343.591369:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591375:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591380:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591385:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591389:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144343.591392:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591398:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591420:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144343.591430:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144343.591534:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:3648:x1869759501319168:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144343.591543:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00010000:00010000:2.0:1783144343.591580:0:90838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144343.591589:0:90838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144343.591595:0:90838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8000/0xad8e53a4230481a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144343.591621:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501319168:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783144343.596975:0:90829:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:1.0:1783144343.597646:0:90829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783144343.597687:0:90858:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:3.0:1783144343.597691:0:90858:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:1.0:1783144343.598088:0:90859:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783144343.598107:0:90829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783144343.598412:0:90859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783144343.598678:0:90860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90860:1869759501319296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144343.598769:0:90860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144343.598806:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319296 00000100:00100000:0.0:1783144343.598812:0:90860:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:2.0:1783144343.598814:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319296 00000100:00100000:2.0:1783144343.598862:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1783144343.598873:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90860:x1869759501319296:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783144343.598889:0:90829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783144343.598918:0:90829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783144343.598963:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90860:x1869759501319296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.598970:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:0.0:1783144343.599028:0:90860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90860:1869759501319296:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1783144343.599052:0:90860:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783144343.599074:0:90860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90860:1869759501319424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144343.599102:0:90860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.599393:0:90860:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:2.0:1783144343.600227:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319424 00000100:00100000:2.0:1783144343.600232:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319424 00000100:00100000:2.0:1783144343.600257:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:2.0:1783144343.600263:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90860:x1869759501319424:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144343.600355:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90860:x1869759501319424:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.600360:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:0.0:1783144343.600412:0:90860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90860:1869759501319424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144343.600477:0:90860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90860:1869759501319552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144343.600510:0:90860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144343.600535:0:90860:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2180 going to sleep for 11 seconds 00000100:00100000:2.0:1783144343.600559:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319552 00000100:00100000:2.0:1783144343.600564:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319552 00000100:00100000:2.0:1783144343.600587:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:2.0:1783144343.600602:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef46f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90860:x1869759501319552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783144343.600654:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef46f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90860:x1869759501319552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144343.600659:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:0.0:1783144343.600791:0:90860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90860:1869759501319552:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1783144343.600827:0:90860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783144343.605027:0:90829:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783144343.605046:0:90829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783144343.605128:0:90829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783144343.622217:0:90829:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783144343.625917:0:90859:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783144343.625983:0:90859:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1783144343.628352:0:90829:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783144343.628431:0:90829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783144343.628556:0:90829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783144343.628789:0:90860:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783144343.628848:0:90860:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783144343.628854:0:90860:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:1.0:1783144343.629095:0:90829:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:1.0:1783144343.630911:0:90829:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182407 00010000:00080000:1.0:1783144343.631483:0:90861:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90861 00010000:02000000:1.0:1783144343.631498:0:90861:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783144343.631501:0:90861:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783144343.631505:0:90861:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1783144343.631559:0:90829:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783144343.631570:0:90829:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783144343.631584:0:90829:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783144343.631593:0:90829:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783144343.632495:0:90829:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783144343.632897:0:90829:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783144344.163923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144344.163966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144344.164009:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144344.164021:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481677696 00000100:00100000:3.0:1783144344.164034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144344.164035:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481677696 00000100:00100000:1.0:1783144344.164058:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481677568 00000100:00100000:1.0:1783144344.164064:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481677568 00000100:00100000:3.0:1783144344.164068:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144344.164095:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481677952 00000100:00100000:2.0:1783144344.164098:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481677824 00000100:00100000:3.0:1783144344.164100:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481677952 00000100:00100000:2.0:1783144344.164104:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481677824 00000100:00100000:1.0:1783144344.164107:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481677440 00000100:00100000:1.0:1783144344.164113:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481677440 00000100:00100000:3.0:1783144344.164132:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1783144344.164141:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1869759481677952:12345-192.168.203.4@tcp:250:kworker.0 00000100:00100000:1.0:1783144344.164148:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 801 00000100:00100000:2.0:1783144344.164150:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2026 00000100:00100000:1.0:1783144344.164161:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481677568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144344.164164:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481677696:12345-192.168.203.4@tcp:400:kworker.0 00010000:00080000:3.0:1783144344.164171:0:90836:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12@192.168.203.4@tcp t0 exp 0000000000000000 cur 2878 last 0 00000020:00000080:3.0:1783144344.164201:0:90836:0:(genops.c:1406:class_connect()) connect: client 9fffbd4d-6e9f-4786-bbe5-4b99ed941e12, cookie 0xad8e53a4230481a7 00000100:00100000:2.0:1783144344.164234:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481677696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.164259:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2026 00000100:00100000:1.0:1783144344.164260:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481677568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 98us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.164284:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2027 00000100:00100000:1.0:1783144344.164284:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 801 00000100:00100000:2.0:1783144344.164298:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481677824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144344.164311:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1156 00000100:00100000:1.0:1783144344.164318:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481677440:12345-192.168.203.4@tcp:38:kworker.0 00010000:00080000:1.0:1783144344.164337:0:66947:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'cace81e7-a6f2-4d37-b197-caf34583781c' at ffff9c29c340a800, cookie 0xad8e53a4230480f1 00010000:00080000:1.0:1783144344.164342:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp recovering/t107374182408 exp ffff9c29c340a800 cur 2878 last 1783144343 00010000:02000400:1.0:1783144344.164351:0:66947:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00080000:3.0:1783144344.164359:0:90836:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3dad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144344.164392:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:2402:x1869759481677952:12345-192.168.203.4@tcp:250:kworker.0 Request processed in 251us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.164400:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1783144344.164438:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481677824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.164447:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2027 00000100:00080000:3.0:1783144344.164454:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144344.164460:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144344.164463:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783144344.175005:0:66947:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783144344.175031:0:66947:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783144344.175178:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2b017f2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144344.175249:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481677440:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 10926us (11212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144344.175355:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1156 00000100:00100000:3.0:1783144344.177946:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144344.178003:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481670784 00000100:00100000:2.0:1783144344.178011:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481670784 00000100:00100000:2.0:1783144344.178069:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1157 00000100:00100000:2.0:1783144344.178078:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481670784:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00080000:2.0:1783144344.178095:0:66114:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:2.0:1783144344.178114:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481670784:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 38us (173us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144344.178137:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1157 00010000:00080000:0.0:1783144344.178205:0:90861:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1783144344.525816:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783144344.846032:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783144344.846039:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2aefa79000 from 116 10000000:01000000:2.0:1783144344.846044:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783144344.846084:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.846096:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.846107:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.846132:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501319680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.846195:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.846244:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319680 00000100:00100000:2.0:1783144344.846249:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.846252:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319680 00000100:00100000:3.0:1783144344.846313:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783144344.846324:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:6518:x1869759501319680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.846338:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144344.846353:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98e800/0xad8e53a4230481b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230481ae expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.846376:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98e800/0xad8e53a4230481b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230481ae expref: 11 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.846386:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98e800/0xad8e53a4230481b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230481ae expref: 11 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.846393:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e800, rc 0) 00000100:00100000:3.0:1783144344.846434:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501319680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.846442:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783144344.846468:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501319680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.846483:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.846492:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.846538:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501319808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.846569:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.846590:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.846601:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319808 00000100:00100000:3.0:1783144344.846606:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319808 00000100:00100000:3.0:1783144344.846630:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783144344.846640:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501319808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144344.846651:0:90835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783144344.846664:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144344.846667:0:90835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:3.0:1783144344.846781:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501319808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.846790:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783144344.846798:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501319808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783144344.846866:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783144344.846873:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.846882:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144344.846891:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144344.846893:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 52 10000000:01000000:2.0:1783144344.846896:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144344.846912:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.846919:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.846927:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.846940:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501319936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.846972:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.847007:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.847011:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501319936 00000100:00100000:3.0:1783144344.847017:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501319936 00000100:00100000:3.0:1783144344.847050:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783144344.847066:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501319936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.847075:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144344.847084:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98fc00/0xad8e53a4230481c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230481bc expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.847100:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98fc00/0xad8e53a4230481c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230481bc expref: 12 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.847108:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98fc00/0xad8e53a4230481c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230481bc expref: 12 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.847115:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fc00, rc 0) 00000100:00100000:3.0:1783144344.847150:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501319936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.847157:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783144344.847178:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501319936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.847191:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481c3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.847200:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230481c3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.847265:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.847296:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.847323:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.847376:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320064 00000100:00100000:3.0:1783144344.847381:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320064 00000100:00100000:3.0:1783144344.847451:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783144344.847459:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501320064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.847571:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501320064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.847578:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783144344.847636:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.847660:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.847690:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.847702:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.847712:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320192 00000100:00100000:2.0:1783144344.847714:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320192 00000100:00100000:2.0:1783144344.847750:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783144344.847756:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501320192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.847817:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501320192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.847823:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783144344.847857:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144344.848396:0:91030:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783144344.848486:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783144344.848511:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144344.848517:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481c3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.848526:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481c3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144344.848541:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783144344.848543:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2ac91e0000 from 113 10000000:01000000:3.0:1783144344.848545:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144344.848562:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.848570:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.848578:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144344.848593:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.848629:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.848660:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320320 00000100:00100000:3.0:1783144344.848663:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4fa2300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.848664:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320320 00000100:00100000:2.0:1783144344.848690:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783144344.848696:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501320320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.848701:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144344.848709:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47cc00/0xad8e53a4230481d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230481ca expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.848746:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47cc00/0xad8e53a4230481d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230481ca expref: 13 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.848752:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47cc00/0xad8e53a4230481d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230481ca expref: 13 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.848757:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47cc00, rc 0) 00000100:00100000:2.0:1783144344.848783:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501320320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.848788:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783144344.848812:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.848820:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481d1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.848825:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230481d1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.848855:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.848878:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.848889:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.848899:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320448 00000100:00100000:2.0:1783144344.848901:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320448 00000100:00100000:2.0:1783144344.848917:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783144344.848921:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501320448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783144344.848930:0:90835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783144344.848940:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783144344.848945:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1783144344.848948:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1783144344.848950:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1783144344.848952:0:90835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:2.0:1783144344.849030:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501320448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.849037:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783144344.849068:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783144344.849129:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783144344.849135:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481d1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.849143:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481d1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144344.849150:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783144344.849152:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783144344.849155:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783144344.849169:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.849176:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.849183:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.849196:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.849228:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.849252:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.849265:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320576 00000100:00100000:2.0:1783144344.849269:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320576 00000100:00100000:2.0:1783144344.849295:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783144344.849303:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501320576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.849309:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144344.849318:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47d200/0xad8e53a4230481df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230481d8 expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.849332:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47d200/0xad8e53a4230481df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230481d8 expref: 14 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.849340:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47d200/0xad8e53a4230481df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230481d8 expref: 14 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.849347:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d200, rc 0) 00000100:00100000:2.0:1783144344.849374:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501320576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.849378:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783144344.849401:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.849409:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.849414:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230481df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.849442:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.849461:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.849477:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.849485:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320704 00000100:00100000:2.0:1783144344.849487:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320704 00000100:00100000:2.0:1783144344.849502:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783144344.849506:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501320704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.849579:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501320704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.849584:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783144344.849604:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.849622:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.849651:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.849662:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.849671:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320832 00000100:00100000:2.0:1783144344.849673:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320832 00000100:00100000:2.0:1783144344.849688:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783144344.849692:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501320832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.852643:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501320832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2943us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.852658:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783144344.852666:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144344.853467:0:91033:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1783144344.853549:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1783144344.853571:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783144344.853581:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.853591:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144344.853599:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783144344.853608:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2ac91e0000 from 1 10000000:01000000:2.0:1783144344.853610:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783144344.853637:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.853645:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.853654:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.853673:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.853713:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.853778:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.853810:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501320960 00000100:00100000:3.0:1783144344.853818:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501320960 00000100:00100000:3.0:1783144344.853861:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783144344.853871:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501320960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.853883:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144344.853894:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98e200/0xad8e53a4230481ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230481e6 expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.853913:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98e200/0xad8e53a4230481ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230481e6 expref: 15 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.853926:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98e200/0xad8e53a4230481ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230481e6 expref: 15 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.853932:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e200, rc 0) 00000100:00100000:3.0:1783144344.853961:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501320960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.853967:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783144344.853986:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501320960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.854002:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.854012:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230481ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144344.854025:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783144344.854029:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.854036:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144344.854043:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783144344.854045:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2ac91e0000 from 7 10000000:01000000:2.0:1783144344.854053:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783144344.854151:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.854159:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.854167:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.854179:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.854206:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.854236:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321088 00000100:00100000:2.0:1783144344.854239:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.854241:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321088 00000100:00100000:3.0:1783144344.854272:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783144344.854281:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501321088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.854288:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144344.854296:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98e400/0xad8e53a4230481fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230481f4 expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.854310:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98e400/0xad8e53a4230481fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230481f4 expref: 16 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.854319:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98e400/0xad8e53a4230481fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230481f4 expref: 16 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.854326:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e400, rc 0) 00000100:00100000:3.0:1783144344.854368:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501321088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.854374:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783144344.854399:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.854411:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.854419:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230481fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.854465:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.854489:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.854508:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.854526:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321216 00000100:00100000:3.0:1783144344.854529:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321216 00000100:00100000:3.0:1783144344.854556:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783144344.854561:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501321216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.854649:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501321216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.854655:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783144344.855332:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144344.855366:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144344.855408:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144344.855445:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711900 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.855451:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321344 00000100:00100000:2.0:1783144344.855456:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321344 00000100:00100000:2.0:1783144344.855489:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783144344.855496:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501321344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.855572:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501321344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.855587:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783144344.855600:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144344.856535:0:91034:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783144344.856610:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783144344.856634:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783144344.856641:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.856650:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144344.856657:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144344.856660:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 52 10000000:01000000:2.0:1783144344.856662:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144344.856681:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.856689:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.856697:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.856710:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.856799:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.856839:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783144344.856880:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321472 00000100:00100000:1.0:1783144344.856886:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321472 00000100:00100000:1.0:1783144344.856939:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783144344.856949:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501321472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144344.856959:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144344.856976:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9600/0xad8e53a423048209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048202 expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.857006:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9600/0xad8e53a423048209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048202 expref: 17 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.857017:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9600/0xad8e53a423048209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048202 expref: 17 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.857025:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9600, rc 0) 00000100:00100000:1.0:1783144344.857076:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501321472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144344.857085:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783144344.857103:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.857119:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048209 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.857127:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048209 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.857172:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.857199:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.857221:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783144344.857240:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321600 00000100:00100000:1.0:1783144344.857245:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321600 00000100:00100000:1.0:1783144344.857275:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783144344.857283:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501321600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144344.857390:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501321600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144344.857397:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783144344.857923:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.857948:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.857994:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144344.858028:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321728 00000100:00100000:2.0:1783144344.858031:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144344.858033:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321728 00000100:00100000:0.0:1783144344.858070:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783144344.858077:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501321728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144344.858141:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501321728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144344.858146:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783144344.858168:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144344.859612:0:91035:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783144344.859691:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783144344.859714:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144344.859743:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048209 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144344.859753:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048209 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144344.859761:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783144344.859763:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1783144344.859766:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783144344.859790:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144344.859797:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144344.859806:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144344.859821:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144344.859859:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144344.859886:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.859898:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321856 00000100:00100000:2.0:1783144344.859904:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321856 00000100:00100000:2.0:1783144344.859941:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783144344.859949:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501321856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.859959:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144344.859970:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c200/0xad8e53a423048217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048210 expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.860050:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c200/0xad8e53a423048217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048210 expref: 18 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.860062:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c200/0xad8e53a423048217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048210 expref: 18 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.860070:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c200, rc 0) 00000100:00100000:2.0:1783144344.860111:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501321856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.860128:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783144344.860165:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144344.860181:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048217 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144344.860188:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048217 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144344.860224:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144344.860252:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144344.860271:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.860286:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501321984 00000100:00100000:2.0:1783144344.860291:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501321984 00000100:00100000:2.0:1783144344.860319:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783144344.860325:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501321984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.860437:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501321984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.860444:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783144344.860523:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501321984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144344.860547:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144344.860575:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144344.860587:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.860596:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501322112 00000100:00100000:2.0:1783144344.860601:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501322112 00000100:00100000:2.0:1783144344.860627:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783144344.860633:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501322112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.862692:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501322112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2053us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.862703:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783144344.863021:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144344.863798:0:91039:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783144344.863861:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783144344.863888:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783144344.863897:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048217 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.863908:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048217 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144344.863917:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144344.863920:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2b017f2000 from 7 10000000:01000000:3.0:1783144344.863922:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144344.863948:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.863956:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.863965:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144344.863992:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.864038:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.864073:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501322240 00000100:00100000:3.0:1783144344.864077:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.864079:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501322240 00000100:00100000:2.0:1783144344.864117:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783144344.864122:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501322240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.864132:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144344.864140:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048225 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304821e expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.864155:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304821e expref: 19 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.864162:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304821e expref: 19 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.864167:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d800, rc 0) 00000100:00100000:2.0:1783144344.864209:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501322240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.864215:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783144344.864318:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.864330:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048225 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.864339:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048225 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144344.864384:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.864421:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.864438:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.864455:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501322368 00000100:00100000:2.0:1783144344.864460:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501322368 00000100:00100000:2.0:1783144344.864489:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783144344.864496:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501322368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.864586:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501322368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.864593:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783144344.864606:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.864627:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.864664:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.864675:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783144344.864697:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501322496 00000100:00100000:1.0:1783144344.864703:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501322496 00000100:00100000:1.0:1783144344.864757:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783144344.864768:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501322496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144344.864854:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501322496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144344.864872:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783144344.864958:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144344.865597:0:91040:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783144344.865763:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783144344.865784:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783144344.865791:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048225 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.865800:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048225 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144344.865807:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144344.865810:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 52 10000000:01000000:1.0:1783144344.865813:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144344.865830:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.865837:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.865844:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144344.865858:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144344.865885:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144344.865912:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.865916:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501322624 00000100:00100000:2.0:1783144344.865921:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501322624 00000100:00100000:2.0:1783144344.865951:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783144344.865959:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501322624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.865968:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144344.865987:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423048233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304822c expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.866003:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423048233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304822c expref: 20 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.866013:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423048233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304822c expref: 20 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.866019:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47dc00, rc 0) 00000100:00100000:2.0:1783144344.866051:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501322624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.866058:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783144344.866074:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144344.866087:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048233 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.866095:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048233 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144344.866137:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144344.866160:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144344.866176:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.866185:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501322752 00000100:00100000:2.0:1783144344.866190:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501322752 00000100:00100000:2.0:1783144344.866217:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783144344.866223:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501322752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.866302:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501322752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.866308:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783144344.866364:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.866387:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.866419:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.866463:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.866484:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501322880 00000100:00100000:2.0:1783144344.866487:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501322880 00000100:00100000:2.0:1783144344.866508:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783144344.866513:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501322880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.866583:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501322880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.866590:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783144344.866605:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501322880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144344.867343:0:91041:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783144344.867406:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783144344.867420:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144344.867425:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048233 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.867431:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048233 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144344.867436:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783144344.867437:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783144344.867439:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783144344.867450:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.867455:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.867466:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.867475:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.867495:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.867516:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.867527:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323008 00000100:00100000:3.0:1783144344.867531:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323008 00000100:00100000:3.0:1783144344.867555:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783144344.867561:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501323008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.867567:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144344.867574:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98f000/0xad8e53a423048241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304823a expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.867584:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98f000/0xad8e53a423048241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304823a expref: 21 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.867590:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98f000/0xad8e53a423048241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304823a expref: 21 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.867594:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f000, rc 0) 00000100:00100000:3.0:1783144344.867620:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501323008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.867626:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783144344.867631:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.867647:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048241 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.867656:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048241 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.867698:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.867853:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.867877:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323136 00000100:00100000:2.0:1783144344.867880:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.867883:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323136 00000100:00100000:3.0:1783144344.867914:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783144344.867922:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501323136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.868024:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501323136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.868031:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783144344.868109:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.868137:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.868174:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.868189:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.868197:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323264 00000100:00100000:3.0:1783144344.868202:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323264 00000100:00100000:3.0:1783144344.868227:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783144344.868233:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501323264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.868697:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501323264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 463us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.868706:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783144344.868747:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144344.869325:0:91042:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783144344.869385:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783144344.869405:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783144344.869412:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048241 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.869421:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048241 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144344.869429:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144344.869430:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2afaac8800 from 7 10000000:01000000:3.0:1783144344.869433:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144344.869450:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.869457:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.869465:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144344.869477:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.869504:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.869533:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6d1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144344.869609:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323392 00000100:00100000:1.0:1783144344.869616:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323392 00000100:00100000:1.0:1783144344.869653:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783144344.869661:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501323392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144344.869669:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144344.869679:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8200/0xad8e53a42304824f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048248 expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.869693:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8200/0xad8e53a42304824f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048248 expref: 22 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.869699:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8200/0xad8e53a42304824f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048248 expref: 22 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144344.869705:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8200, rc 0) 00000100:00100000:1.0:1783144344.869783:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501323392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144344.869792:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783144344.869802:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.869816:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304824f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.869832:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304824f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144344.869885:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.869909:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.869950:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323520 00000100:00100000:3.0:1783144344.869954:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6d1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.869955:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323520 00000100:00100000:2.0:1783144344.870003:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783144344.870019:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501323520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.870498:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501323520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 487us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.870507:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783144344.870526:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.870554:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.870588:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.870606:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6d1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144344.870628:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323648 00000100:00100000:1.0:1783144344.870633:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323648 00000100:00100000:1.0:1783144344.870662:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783144344.870670:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501323648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144344.870786:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501323648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144344.870799:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783144344.870828:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144344.873151:0:91043:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783144344.873309:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783144344.873330:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783144344.873345:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304824f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.873356:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304824f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144344.873365:0:6518:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1783144344.873368:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9c2ac6dd99c0 from 1 10000000:01000000:3.0:1783144344.873371:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783144344.873400:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.873409:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.873425:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144344.873443:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.873488:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.873520:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6d1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144344.873528:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323776 00000100:00100000:2.0:1783144344.873535:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323776 00000100:00100000:2.0:1783144344.873573:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783144344.873583:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501323776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.873595:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144344.873608:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c800/0xad8e53a42304825d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048256 expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.873629:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c800/0xad8e53a42304825d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048256 expref: 23 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.873639:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c800/0xad8e53a42304825d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048256 expref: 23 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.873646:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c800, rc 0) 00000100:00100000:2.0:1783144344.873681:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501323776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144344.873686:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783144344.873789:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.873802:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304825d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.873812:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304825d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144344.873827:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783144344.873831:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304825d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.873838:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304825d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144344.873845:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783144344.873847:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:3.0:1783144344.873849:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783144344.873862:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.873866:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.873879:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144344.873887:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.873905:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144344.873919:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6d1d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.873931:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501323904 00000100:00100000:3.0:1783144344.873933:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501323904 00000100:00100000:3.0:1783144344.873962:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783144344.873969:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501323904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144344.873976:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144344.873997:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98f200/0xad8e53a42304826b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048264 expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.874011:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98f200/0xad8e53a42304826b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048264 expref: 24 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.874017:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98f200/0xad8e53a42304826b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048264 expref: 24 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144344.874023:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f200, rc 0) 00000100:00100000:3.0:1783144344.874061:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501323904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144344.874068:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783144344.874073:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501323904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144344.874085:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304826b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.874099:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304826b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144344.874142:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501324032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144344.874168:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144344.874190:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144344.874214:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324032 00000100:00100000:3.0:1783144344.874219:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324032 00000100:00100000:3.0:1783144344.874242:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783144344.874249:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c44afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501324032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144344.874318:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c44afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501324032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (149us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144344.874327:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783144344.874332:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501324032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783144344.874356:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783144344.874361:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304826b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144344.874369:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304826b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1783144345.280424:0:91111:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783144345.509082:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144345.509125:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678080 00000100:00100000:3.0:1783144345.509134:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678080 00000100:00100000:3.0:1783144345.509192:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:3.0:1783144345.509202:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+5:42333:x1869759481678080:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144345.509217:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144345.509232:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98f600/0xad8e53a423048272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b29 expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144345.509384:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98f600/0xad8e53a423048272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b29 expref: 6 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144345.509395:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98f600/0xad8e53a423048272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b29 expref: 6 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144345.509404:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f600, rc 0) 00000100:00100000:3.0:1783144345.510841:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481678080:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 1635us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144345.510850:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:3.0:1783144345.514528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144345.514559:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678208 00000100:00100000:3.0:1783144345.514566:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678208 00000100:00100000:3.0:1783144345.514606:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1783144345.514614:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481678208:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144345.514632:0:90835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783144345.514648:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144345.514651:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783144345.514653:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783144345.514655:0:90835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783144345.514657:0:90835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1783144345.516105:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481678208:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 Request processed in 1488us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144345.516117:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1783144345.517861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144345.520050:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678336 00000100:00100000:1.0:1783144345.520059:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678336 00000100:00100000:1.0:1783144345.520104:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:1.0:1783144345.520114:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+6:42333:x1869759481678336:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144345.520129:0:90837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144345.520144:0:90837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8a00/0xad8e53a423048279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b30 expref: -99 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144345.520166:0:90837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8a00/0xad8e53a423048279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b30 expref: 7 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144345.520175:0:90837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8a00/0xad8e53a423048279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b30 expref: 7 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144345.520182:0:90837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8a00, rc 0) 00000100:00100000:1.0:1783144345.520231:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481678336:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 117us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144345.520238:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1783144345.521370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144345.521518:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678464 00000100:00100000:1.0:1783144345.521524:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678464 00000100:00100000:1.0:1783144345.521559:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1783144345.521568:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:42333:x1869759481678464:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144345.521671:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481678464:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144345.521677:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:3.0:1783144345.522485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144345.522539:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678592 00000100:00100000:1.0:1783144345.522544:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678592 00000100:00100000:1.0:1783144345.522577:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1783144345.522583:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481678592:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144345.522660:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481678592:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144345.522667:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1783144345.525367:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144345.525410:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678720 00000100:00100000:1.0:1783144345.525416:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678720 00000100:00100000:1.0:1783144345.525462:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:1.0:1783144345.525471:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:42333:x1869759481678720:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144345.525483:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144345.525508:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8000/0xad8e53a423048280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b37 expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144345.525531:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8000/0xad8e53a423048280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b37 expref: 9 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144345.525543:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8000/0xad8e53a423048280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b37 expref: 9 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144345.525551:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8000, rc 0) 00000100:00100000:1.0:1783144345.525595:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481678720:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 125us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144345.525611:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1783144345.526411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144345.526450:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678848 00000100:00100000:1.0:1783144345.526455:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678848 00000100:00100000:1.0:1783144345.526485:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1783144345.526498:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481678848:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144345.526586:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481678848:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 93us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144345.526593:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1783144345.527742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144345.527782:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481678976 00000100:00100000:0.0:1783144345.527787:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481678976 00000100:00100000:0.0:1783144345.527821:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:0.0:1783144345.527829:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481678976:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144345.527909:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481678976:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144345.527917:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:3.0:1783144345.530232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144345.530265:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481679104 00000100:00100000:3.0:1783144345.530272:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481679104 00000100:00100000:3.0:1783144345.530360:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1783144345.530371:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef84ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:42333:x1869759481679104:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144345.530384:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144345.530399:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423048287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b3e expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144345.530423:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423048287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b3e expref: 10 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144345.530434:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423048287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b3e expref: 10 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144345.530443:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0200, rc 0) 00000100:00100000:3.0:1783144345.530486:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef84ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481679104:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144345.530495:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1783144345.531372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144345.531415:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481679232 00000100:00100000:1.0:1783144345.531420:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481679232 00000100:00100000:1.0:1783144345.531455:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1783144345.531464:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481679232:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144345.531545:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:42333:x1869759481679232:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 83us (175us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783144345.531552:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00010000:00010000:3.0:1783144345.551885:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783144345.665902:0:91163:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783144345.666184:0:91163:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1783144346.083050:0:91213:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783144346.083260:0:91213:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783144346.126915:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501324160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144346.126967:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144346.127078:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324160 00000100:00100000:2.0:1783144346.127085:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324160 00000100:00100000:2.0:1783144346.127134:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:2.0:1783144346.127143:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501324160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144346.127167:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144346.127233:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501324160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144346.127239:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:0.0:1783144346.127580:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501324288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144346.127610:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144346.128028:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324288 00000100:00100000:0.0:1783144346.128033:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324288 00000100:00100000:3.0:1783144346.128044:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501324160:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783144346.128069:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144346.128074:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144346.128080:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:0.0:1783144346.128090:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501324288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144346.128107:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144346.128145:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501324288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144346.128152:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:3.0:1783144346.128184:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501324288:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783144346.573954:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144347.598306:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.622118:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144348.685975:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501324416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144348.686064:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144348.686068:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783144348.686072:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1783144348.686076:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144348.686081:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783144348.686090:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501324544:0@lo:400:kworker.0 00000100:00080000:2.0:1783144348.686092:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144348.686115:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324416 00000100:00100000:2.0:1783144348.686121:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee571500 x1869759501324672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144348.686125:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324416 00000100:00100000:3.0:1783144348.686137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144348.686162:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144348.686166:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144348.686168:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144348.686174:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144348.686188:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee572d80 x1869759501324928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144348.686190:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1783144348.686206:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501324416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783144348.686242:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:1.0:1783144348.686291:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501324416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144348.686298:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1783144348.686347:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501324672:0@lo:38:kworker.0 00000100:00080000:2.0:1783144348.686368:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144348.686372:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144348.686377:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783144348.686377:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144348.686386:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144348.686401:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324544 00000100:00100000:1.0:1783144348.686405:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324544 00000100:00100000:2.0:1783144348.686406:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee572680 x1869759501325184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144348.686442:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144348.686445:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144348.686447:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144348.686454:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144348.686454:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783144348.686467:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501324544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144348.686470:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee573480 x1869759501325568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144348.686504:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1783144348.686504:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501324544:12345-0@lo:400:kworker.0 Request processed in 39us (371us total) trans 0 rc 0/0 00000100:00080000:2.0:1783144348.686512:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783144348.686516:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783144348.686519:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1783144348.686525:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ac7fb7000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144348.686538:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee573800 x1869759501325952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144348.686564:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501325440:0@lo:400:kworker.0 00000100:00100000:2.0:1783144348.686588:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501325056:0@lo:400:kworker.0 00000100:00100000:1.0:1783144348.686598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144348.686626:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325440 00000100:00100000:1.0:1783144348.686630:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325440 00000100:00100000:2.0:1783144348.686637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144348.686690:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1783144348.686697:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501325440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144348.686960:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324672 00000100:00100000:2.0:1783144348.686964:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324672 00000100:00100000:0.0:1783144348.686967:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501325312:0@lo:400:kworker.0 00000100:00100000:3.0:1783144348.686991:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501324544:0@lo:400:kworker.0 00000100:00100000:2.0:1783144348.686991:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325056 00000100:00100000:2.0:1783144348.686996:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325056 00000100:00100000:1.0:1783144348.687010:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501325440:12345-0@lo:400:kworker.0 Request processed in 311us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144348.687010:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144348.687016:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501324800:0@lo:400:kworker.0 00000100:00100000:1.0:1783144348.687023:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:2.0:1783144348.687037:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1783144348.687048:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501325056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144348.687053:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144348.687095:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324800 00000100:00100000:3.0:1783144348.687099:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324800 00000100:00100000:2.0:1783144348.687105:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501325056:12345-0@lo:400:kworker.0 Request processed in 59us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144348.687113:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1783144348.687129:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1783144348.687137:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501324800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144348.687143:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1783144348.687150:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501324672:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144348.687172:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501324800:12345-0@lo:400:kworker.0 Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144348.687178:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00080000:2.0:1783144348.687227:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144348.687232:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144348.687247:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501324928:0@lo:38:kworker.0 00000100:00100000:2.0:1783144348.687283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144348.687313:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501325184:0@lo:38:kworker.0 00000100:00100000:2.0:1783144348.687341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144348.687358:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501325568:0@lo:38:kworker.0 00000100:00100000:2.0:1783144348.687378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144348.687398:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501325952:0@lo:38:kworker.0 00000100:00100000:2.0:1783144348.687425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144348.687446:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325184 00000100:00100000:2.0:1783144348.687449:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325184 00000100:00100000:2.0:1783144348.687463:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:2.0:1783144348.687466:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501325184:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783144348.687478:0:8446:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c29c340c800, cookie 0xad8e53a4230480f8 00010000:00080000:2.0:1783144348.687482:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c29c340c800 cur 2883 last 1783144343 00000004:00100000:2.0:1783144348.687494:0:8446:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783144348.687588:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325312 00000100:00100000:0.0:1783144348.687593:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325312 00000100:00080000:2.0:1783144348.687620:0:8446:0:(import.c:65:import_set_state_nolock()) ffff9c29c4969800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144348.687633:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:0.0:1783144348.687640:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501325312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144348.687677:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501325312:12345-0@lo:400:kworker.0 Request processed in 38us (669us total) trans 0 rc 0/0 00010000:00080000:3.0:1783144348.687688:0:81077:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2883 last 0 00000100:00100000:0.0:1783144348.687688:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00010000:00080000:0.0:1783144348.687709:0:90861:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783144348.687714:0:90861:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 107374182408 00000020:00080000:0.0:1783144348.687718:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.687737:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00000020:00000080:3.0:1783144348.687739:0:81077:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad8e53a42304828e 00010000:00080000:0.0:1783144348.687742:0:90861:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:0.0:1783144348.687744:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000004:00100000:3.0:1783144348.687747:0:81077:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1783144348.687755:0:90861:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481670784 t107374182408 from 192.168.203.4@tcp req@ffff9c29ca609180 x1869759481670784/t0(107374182408) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:455/0 lens 528/0 e 0 to 0 dl 1783144355 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144348.687758:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501325184:12345-0@lo:38:kworker.0 Request processed in 287us (414us total) trans 0 rc 0/0 00000100:00080000:3.0:1783144348.687767:0:81077:0:(import.c:65:import_set_state_nolock()) ffff9c2add5f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144348.687774:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:2.0:1783144348.687805:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501324928 00000100:00100000:3.0:1783144348.687807:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501324672:12345-0@lo:38:kworker.0 Request processed in 656us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144348.687810:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501324928 00000100:00100000:3.0:1783144348.687823:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1783144348.687824:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325568 00000100:00100000:2.0:1783144348.687829:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325568 00000100:00100000:3.0:1783144348.687845:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325952 00000100:00100000:3.0:1783144348.687851:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325952 00000100:00100000:2.0:1783144348.687852:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1783144348.687859:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501324928:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144348.687873:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00010000:00080000:2.0:1783144348.687876:0:66112:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2883 last 0 00000100:00100000:3.0:1783144348.687883:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1869759501325568:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783144348.687899:0:81077:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2883 last 0 00000100:00080000:0.0:1783144348.687900:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1783144348.687913:0:66112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad8e53a423048295 00000100:00100000:0.0:1783144348.687923:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501325312:0@lo:400:kworker.0 00000004:00100000:2.0:1783144348.687928:0:66112:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:3.0:1783144348.687929:0:81077:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad8e53a42304829c 00000004:00100000:3.0:1783144348.687940:0:81077:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783144348.687940:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501324416:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783144348.687962:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c29c496f000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1783144348.687972:0:81077:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144348.687991:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1783144348.687997:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501325952:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783144348.688012:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2883 last 0 00000100:00100000:2.0:1783144348.688016:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869759501324928:12345-0@lo:38:kworker.0 Request processed in 155us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144348.688024:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869759501325568:12345-0@lo:38:kworker.0 Request processed in 140us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144348.688024:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1783144348.688035:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000020:00000080:1.0:1783144348.688039:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad8e53a4230482a3 00000004:00100000:1.0:1783144348.688047:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783144348.688060:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:1.0:1783144348.688063:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2af5ddc800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783144348.688069:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783144348.688072:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1783144348.688076:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00080000:2.0:1783144348.688079:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2af7208000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:2.0:1783144348.688083:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1783144348.688085:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501324800:0@lo:400:kworker.0 00000100:00100000:1.0:1783144348.688097:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501325952:12345-0@lo:38:kworker.0 Request processed in 98us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144348.688098:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501325696:0@lo:400:kworker.0 00000100:00100000:1.0:1783144348.688119:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1783144348.688126:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501325440:0@lo:400:kworker.0 00000100:00100000:3.0:1783144348.688138:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144348.688156:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501325056:0@lo:400:kworker.0 00000100:00100000:2.0:1783144348.688164:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501325824:0@lo:400:kworker.0 00000100:00100000:2.0:1783144348.688189:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144348.688231:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501325184:0@lo:38:kworker.0 00010000:00080000:2.0:1783144348.688243:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aee573480 x1869759501325568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144348.688253:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00010000:00080000:1.0:1783144348.688297:0:91226:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783144348.688309:0:91226:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783144348.688314:0:91226:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000004:00080000:0.0:1783144348.688916:0:90861:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1032us 00000100:00080000:1.0:1783144348.689329:0:91226:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1783144348.689404:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2aee573480 x1869759501325568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144373 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144348.689412:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325696 00000100:00080000:2.0:1783144348.689413:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783144348.689419:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144348.689421:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325696 00000100:00100000:1.0:1783144348.689423:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501325824 00000100:02000000:2.0:1783144348.689424:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783144348.689429:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501325824 00000100:00100000:2.0:1783144348.689435:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501325568:0@lo:38:kworker.0 00010000:00080000:2.0:1783144348.689455:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aee573800 x1869759501325952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144348.689466:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:2.0:1783144348.689472:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00100000:1.0:1783144348.689475:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00080000:2.0:1783144348.689476:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783144348.689478:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783144348.689484:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501325952:0@lo:38:kworker.0 00000100:00100000:1.0:1783144348.689484:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501325824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144348.689490:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00010000:00080000:2.0:1783144348.689503:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aee571500 x1869759501324672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144348.689505:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501325696:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783144348.689521:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00100000:1.0:1783144348.689659:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501325824:12345-0@lo:400:kworker.0 Request processed in 175us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144348.689667:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1783144348.689697:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501325696:12345-0@lo:400:kworker.0 Request processed in 196us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144348.689706:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:1.0:1783144348.689708:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501325824:0@lo:400:kworker.0 00000100:00080000:3.0:1783144348.689745:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144348.689750:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144348.689786:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501325696:0@lo:400:kworker.0 00000100:00080000:2.0:1783144348.690943:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2aee571500 x1869759501324672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144373 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144348.690963:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783144348.690968:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144348.690972:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783144348.691121:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501324672:0@lo:38:kworker.0 00010000:00080000:2.0:1783144348.691145:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aee572d80 x1869759501324928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144348.691157:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:2.0:1783144348.692323:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2aee572d80 x1869759501324928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144373 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144348.692333:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783144348.692337:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144348.692349:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783144348.692354:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501324928:0@lo:38:kworker.0 00000100:00100000:2.0:1783144348.692392:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501326080:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783144348.692445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144348.692862:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326080 00000100:00100000:1.0:1783144348.692869:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326080 00000100:00100000:1.0:1783144348.692958:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:1.0:1783144348.692967:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501326080:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783144348.692984:0:23926:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c29c3dfc700 x1869759501326080/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:459/0 lens 224/0 e 0 to 0 dl 1783144359 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144348.692994:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501326080:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 29us (551us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144348.693000:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00010000:00010000:0.0:1783144348.700157:0:90861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700180:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700195:0:90861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700205:0:90861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700210:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700214:0:90861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700670:0:90861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700679:0:90861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700685:0:90861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700698:0:90861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144348.700703:0:90861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700710:0:90861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700745:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:0.0:1783144348.700749:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144348.700753:0:90861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700761:0:90861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a4230482aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144348.700779:0:90861:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008d8a943 reply state 00000000f12b153c transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700790:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.700796:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29ca14fa00) 00010000:00010000:0.0:1783144348.700798:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144348.700802:0:90861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783144348.700916:0:90861:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783144348.700942:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.700946:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:0.0:1783144348.700963:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.700965:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:0.0:1783144348.704202:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000001:00080000:3.0:1783144348.704210:0:90830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:2.0:1783144348.704246:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.704260:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.704269:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.704275:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144348.704280:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.704288:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.704307:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29ca14fa00) 00010000:00010000:2.0:1783144348.704311:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144348.704315:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.704321:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a4230482b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144348.704694:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481671296 00000100:00100000:1.0:1783144348.704709:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481671296 00000100:00100000:1.0:1783144348.704792:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1162 00000100:00100000:1.0:1783144348.704804:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481671296:12345-192.168.203.4@tcp:36:rm.0 00010000:00080000:1.0:1783144348.704825:0:66112:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182409, replaying 00000100:00100000:1.0:1783144348.704844:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481671296:12345-192.168.203.4@tcp:36:rm.0 Request processed in 44us (654us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144348.704851:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1162 00000020:00080000:0.0:1783144348.704872:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.704877:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182409, next_transno: 107374182409 00010000:00080000:0.0:1783144348.704882:0:90861:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182409) 00000020:00080000:0.0:1783144348.704885:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.704896:0:90861:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481671296 t107374182409 from 192.168.203.4@tcp req@ffff9c29c3cb7800 x1869759481671296/t0(107374182409) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:459/0 lens 512/0 e 0 to 0 dl 1783144359 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783144348.704993:0:90861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705009:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705018:0:90861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705026:0:90861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705033:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705039:0:90861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705120:0:90861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705128:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705135:0:90861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705430:0:90861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705438:0:90861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705445:0:90861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705455:0:90861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3dc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144348.705460:0:90861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705468:0:90861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705479:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:0.0:1783144348.705482:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783144348.705486:0:90861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705492:0:90861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a4230482c6 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705520:0:90861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705527:0:90861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705532:0:90861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705543:0:90861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144348.705547:0:90861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705553:0:90861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705561:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:0.0:1783144348.705563:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144348.705566:0:90861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705571:0:90861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a4230482b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144348.705584:0:90861:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8b62931 reply state 000000004649dc8f transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705594:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.705600:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29ca14fd00) 00010000:00010000:0.0:1783144348.705602:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144348.705605:0:90861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783144348.705685:0:90861:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783144348.705704:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.705707:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000020:00080000:0.0:1783144348.705711:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.705713:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000100:00100000:0.0:1783144348.708466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144348.708576:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672192 00000100:00100000:3.0:1783144348.708592:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672192 00000100:00100000:3.0:1783144348.708689:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1163 00000100:00100000:3.0:1783144348.708701:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481672192:12345-192.168.203.4@tcp:36:dd.0 00010000:00080000:3.0:1783144348.708789:0:81077:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182410, current: 107374182412, replaying 00000100:00100000:3.0:1783144348.708818:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:2402:x1869759481672192:12345-192.168.203.4@tcp:36:dd.0 Request processed in 120us (361us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144348.708828:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1163 00000020:00080000:0.0:1783144348.708847:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.708854:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00010000:00080000:0.0:1783144348.708861:0:90861:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182410, ql: 1, comp: 1, conn: 2, next: 107374182412, next_update 0 last_committed: 107374182408) 00000020:00080000:0.0:1783144348.708867:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.708878:0:90861:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481672192 t107374182412 from 192.168.203.4@tcp req@ffff9c29c3cb5180 x1869759481672192/t0(107374182412) o36->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:459/0 lens 488/0 e 0 to 0 dl 1783144359 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783144348.709198:0:90861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.709210:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.709217:0:90861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144348.709265:0:90861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182412 00000004:00010000:0.0:1783144348.709286:0:90861:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005121e35 reply state 00000000ae5834de transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.709302:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.709309:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:0.0:1783144348.709311:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144348.709314:0:90861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783144348.709416:0:90861:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783144348.709426:0:90861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:0.0:1783144348.709439:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.709442:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000020:00080000:0.0:1783144348.709446:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.709455:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000100:00100000:3.0:1783144348.711771:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144348.711919:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481672576 00000100:00100000:1.0:1783144348.711928:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481672576 00000100:00100000:1.0:1783144348.712096:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1164 00000100:00100000:1.0:1783144348.712110:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:2402:x1869759481672576:12345-192.168.203.4@tcp:101:dd.0 00010000:00080000:1.0:1783144348.712135:0:66143:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182413, current: 107374182413, replaying 00000100:00100000:1.0:1783144348.712165:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:2402:x1869759481672576:12345-192.168.203.4@tcp:101:dd.0 Request processed in 57us (449us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144348.712173:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1164 00000020:00080000:2.0:1783144348.712211:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144348.712220:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182413, next_transno: 107374182413 00010000:00080000:2.0:1783144348.712245:0:90861:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182413) 00000020:00080000:2.0:1783144348.712249:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144348.712261:0:90861:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481672576 t107374182413 from 192.168.203.4@tcp req@ffff9c29ca608a80 x1869759481672576/t0(107374182413) o101->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:459/0 lens 640/0 e 0 to 0 dl 1783144359 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1783144348.712376:0:90861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144348.712399:0:90861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a4230482d4 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41af8 expref: -99 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.712458:0:90861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a4230482db lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.712471:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a4230482db lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.712480:0:90861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a4230482db lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144348.712612:0:90861:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x45d:0x0], count =677 00000004:00080000:2.0:1783144348.712617:0:90861:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x45d:0x0]+677 in llog 00000004:00080000:2.0:1783144348.712656:0:90861:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x702:0x0], index 0: 0 00000004:00080000:2.0:1783144348.712663:0:90861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x703:0x0], index 1: 0 00010000:00010000:2.0:1783144348.712769:0:90861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a4230482db lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 14 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.712779:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:2.0:1783144348.712782:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1783144348.712806:0:90861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a4230482d4 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 14 pid: 90861 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.712834:0:90861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a4230482db lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 13 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.712863:0:90861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:2.0:1783144348.712866:0:90861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1783144348.712869:0:90861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47de00, rc 0) 00010000:00080000:2.0:1783144348.712942:0:90861:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783144348.712988:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144348.712991:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000020:00080000:2.0:1783144348.713001:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144348.713004:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000100:00100000:3.0:1783144348.718509:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144348.718995:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481679488 00000100:00100000:2.0:1783144348.719008:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481679488 00000100:00100000:2.0:1783144348.719074:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 804 00000100:00100000:2.0:1783144348.719086:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+13:2402:x1869759481679488:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783144348.719119:0:66114:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c29ca608000 x1869759481679488/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:459/0 lens 224/0 e 0 to 0 dl 1783144359 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144348.719152:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+13:2402:x1869759481679488:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 Request processed in 69us (657us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144348.719161:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 804 00000020:00080000:0.0:1783144348.719214:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.719220:0:90861:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182414 00010000:00080000:0.0:1783144348.719224:0:90861:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1783144348.719228:0:90861:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144348.719236:0:90861:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1783144348.719240:0:90861:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783144348.719378:0:90861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:3.0:1783144348.721884:0:90830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00100000:3.0:1783144348.721895:0:90830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1783144348.721917:0:90830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182413 is committed 00010000:00010000:1.0:1783144348.721971:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.721987:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.721996:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722002:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3da00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144348.722008:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722164:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722190:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722198:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3da00/0xad8e53a4230482bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144348.722203:0:90861:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:1.0:1783144348.722226:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722235:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722241:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722248:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3ca00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144348.722252:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1783144348.722252:0:90861:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:1.0:1783144348.722262:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1783144348.722271:0:90861:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c29c3dfc700 x1869759501326080/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:459/0 lens 224/0 e 0 to 0 dl 1783144359 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783144348.722338:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:1.0:1783144348.722342:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144348.722347:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.722358:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a4230482cd lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1783144348.722458:0:90861:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.203.4@tcp: req@ffff9c29ca608000 x1869759481679488/t0(0) o400->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:459/0 lens 224/0 e 0 to 0 dl 1783144359 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1783144348.722568:0:90861:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1783144348.724880:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783144348.724896:0:3647:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9c29c60b5180 x1869759501326080/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144364 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144348.724910:0:3647:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c29c60b5180 x1869759501326080/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144364 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144348.724932:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144348.724961:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1783144348.724970:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000af1d580c): req@ffff9c29ca2b9880 x1869759501309312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144344 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144348.725000:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501326080:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783144348.725823:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501326208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144348.725880:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144348.726046:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326208 00000100:00100000:1.0:1783144348.726055:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326208 00000100:00100000:3.0:1783144348.726068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144348.726106:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501309312 00000100:00100000:1.0:1783144348.726110:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501309312 00000100:00100000:1.0:1783144348.726144:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:1.0:1783144348.726154:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501326208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144348.726190:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00000100:00100000:1.0:1783144348.726239:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501326208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144348.726247:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:1.0:1783144348.726410:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1783144348.726421:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501309312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144348.726434:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00000100:00100000:1.0:1783144348.726467:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501309312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144348.727064:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501326208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144348.727671:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1783144348.727746:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501309312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144348.728632:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144348.728789:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481679360 00000100:00100000:3.0:1783144348.728798:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481679360 00000100:00100000:3.0:1783144348.728885:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1165 00000100:00100000:3.0:1783144348.728897:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+7:69701:x1869759481679360:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1783144348.728928:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00000100:00100000:3.0:1783144348.729039:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+7:69701:x1869759481679360:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 144us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144348.729047:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1165 00000100:00100000:3.0:1783144348.731406:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144348.731650:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481679616 00000100:00100000:1.0:1783144348.731660:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481679616 00000100:00100000:1.0:1783144348.731798:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1166 00000100:00100000:1.0:1783144348.731808:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:69701:x1869759481679616:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144348.731844:0:66947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:1.0:1783144348.731924:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:69701:x1869759481679616:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 116us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144348.731966:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1166 00000100:00080000:3.0:1783144348.734755:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144348.734963:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144348.735048:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481679744 00000100:00100000:2.0:1783144348.735060:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481679744 00000100:00100000:2.0:1783144348.735178:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1616 00000100:00100000:2.0:1783144348.735190:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:69701:x1869759481679744:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144348.735238:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144348.735317:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:69701:x1869759481679744:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 129us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144348.735327:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1616 00000100:00080000:3.0:1783144348.735976:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144348.738047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144348.738138:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481679872 00000100:00100000:2.0:1783144348.738148:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481679872 00000100:00100000:2.0:1783144348.738272:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1617 00000100:00100000:2.0:1783144348.738284:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+7:69701:x1869759481679872:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144348.738323:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144348.738402:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+7:69701:x1869759481679872:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144348.738431:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1617 00000100:00080000:3.0:1783144348.738921:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000080:0.0:1783144348.748815:0:90861:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc16281fdfe10 00100000:10000000:0.0:1783144348.748839:0:90861:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1783144348.750421:0:90847:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x702:0x0] 00000100:00100000:1.0:1783144348.750471:0:90847:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90847:1869759501326336:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783144348.750535:0:90847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144348.750568:0:90847:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711480 going to sleep for 11 seconds 00000004:00080000:1.0:1783144348.750596:0:90849:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x703:0x0] 00000100:00100000:3.0:1783144348.750607:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326336 00000100:00100000:1.0:1783144348.750614:0:90849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90849:1869759501326464:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783144348.750634:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326336 00000100:00100000:1.0:1783144348.750640:0:90849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144348.750662:0:90849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144348.750710:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326464 00000100:00100000:3.0:1783144348.750715:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326464 00000100:00100000:2.0:1783144348.751603:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4955 00000100:00100000:2.0:1783144348.751620:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:90847:x1869759501326336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783144348.751650:0:26143:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -31 00002000:02000040:2.0:1783144348.751656:0:26143:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1795 to 0x280000401:1825) 00000100:00100000:1.0:1783144348.752003:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956 00000100:00100000:1.0:1783144348.752015:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:90849:x1869759501326464:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783144348.752096:0:26141:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -30 00002000:02000040:1.0:1783144348.752100:0:26141:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1796 to 0x2c0000401:1825) 00002000:00010000:2.0:1783144348.758299:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.758315:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758334:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.758338:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.758345:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758362:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758373:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758382:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758527:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144348.758644:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.758663:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758672:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.758675:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.758680:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758690:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758698:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.758705:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758785:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144348.758794:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758803:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.758808:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758818:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758839:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758846:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a2b4d2/0xad8e53a4230482e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758867:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.758870:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758876:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.758880:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758898:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758908:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.758915:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.758917:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.758919:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.759023:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144348.759029:0:26143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230482e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.759104:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144348.759624:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.759629:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759635:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.759638:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.759646:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759653:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759658:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759663:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759672:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.759680:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.759689:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.759700:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.759700:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.759705:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759707:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759712:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.759718:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144348.759744:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759753:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759761:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759779:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759789:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759796:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759804:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a2d6424/0xad8e53a4230482f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759810:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.759824:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.759830:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759837:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:2.0:1783144348.759842:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.759842:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759849:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759861:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:0.0:1783144348.759861:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759865:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.759871:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759884:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759884:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759895:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759903:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230482f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759904:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759922:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.759929:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.759935:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.759944:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.759964:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.759965:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759969:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.759981:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.759987:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.759995:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.760000:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760002:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760018:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760019:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ecff3e/0xad8e53a4230482fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760023:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.760039:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760048:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.760049:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760052:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.760056:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.760065:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.760066:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.760073:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760081:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.760086:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760095:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.760104:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.760112:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.760113:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760122:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:0.0:1783144348.760123:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760127:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.760136:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760138:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a423048305 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760156:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.760163:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.760165:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.760167:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.760507:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760511:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760522:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.760541:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.760546:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760554:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.760557:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.760559:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.760563:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760566:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760571:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.760574:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.760578:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760578:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760587:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760596:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760597:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022abdd3d/0xad8e53a42304830c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760605:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760611:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.760613:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.760614:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.760638:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144348.760674:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.760679:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760687:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.760690:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.760694:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760702:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760710:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760716:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760746:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783144348.760779:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144348.760784:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.760784:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.760788:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760791:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.760795:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760796:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:3.0:1783144348.760803:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760803:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.760808:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760813:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760816:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760821:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec91b38/0xad8e53a423048313 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760825:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760832:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760834:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.760837:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760842:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.760849:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.760852:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760860:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760870:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.760873:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.760877:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a42304831a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760878:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760885:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.760888:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.760889:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.760893:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760893:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760900:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.760902:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760903:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760910:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760911:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760920:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760922:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.760931:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a018d4d/0xad8e53a423048321 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760935:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144348.760942:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.760943:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.760945:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.760946:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.760946:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760963:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.760967:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760975:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760986:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.760993:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce66f3bf/0xad8e53a423048328 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761005:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761007:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761009:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144348.761045:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.761055:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761062:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761065:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.761069:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761077:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761082:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761086:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761097:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.761115:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.761119:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761126:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.761129:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.761133:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.761138:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761138:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761145:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761148:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.761152:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761158:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761160:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761165:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf2c490/0xad8e53a42304832f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761173:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761180:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761193:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144348.761200:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.761203:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761210:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.761213:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761221:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761231:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761239:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e0cc7ac/0xad8e53a423048336 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761251:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761259:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761262:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.761291:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144348.761302:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.761307:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.761309:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761310:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761314:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761315:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761318:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.761320:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761322:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761330:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761338:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761346:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761363:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.761385:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.761389:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.761398:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.761403:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761405:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.761409:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761417:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761428:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761436:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd31679/0xad8e53a42304833d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761448:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761449:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761451:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761477:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761480:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.761484:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761500:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761508:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761515:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761534:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.761562:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.761568:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.761572:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.761581:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.761581:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.761588:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761594:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761602:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144348.761605:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761607:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761627:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.761630:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761641:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.761645:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a651e3a/0xad8e53a423048344 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761665:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761680:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.761688:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.761693:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.761693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.761697:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.761700:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761703:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.761708:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.761718:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.761738:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761742:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761747:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761750:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.761753:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761754:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761761:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a88f17eb/0xad8e53a42304834b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761764:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761772:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761775:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761776:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761778:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761779:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761791:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.761798:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.761801:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761808:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.761811:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761819:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.761823:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.761827:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761828:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761838:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761841:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.761843:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8c83e6/0xad8e53a423048352 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761846:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761855:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761856:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761857:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761859:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761863:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761870:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761882:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.761888:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.761892:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761898:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.761902:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761909:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.761916:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.761919:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761920:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761927:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c22cb965/0xad8e53a423048359 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761928:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.761931:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.761935:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761938:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.761939:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761942:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.761945:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.761970:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.761977:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762032:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144348.762068:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.762073:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762081:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.762084:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.762087:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762096:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762104:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762112:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762191:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144348.762196:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762203:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.762206:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762214:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762224:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762232:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bc59ca3/0xad8e53a423048360 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762245:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.762248:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762254:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.762263:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762272:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762283:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.762292:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.762294:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.762297:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.762329:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144348.762333:0:26143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67234de/0xad8e53a423048367 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.762367:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.762370:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762375:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.762377:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.762379:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762385:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762389:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762394:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762465:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:0.0:1783144348.762502:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1783144348.762513:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.762518:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762531:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.762533:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.762537:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762545:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762552:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.762557:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764690:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144348.764703:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.764710:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764750:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.764754:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764776:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764792:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.764793:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.764800:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.764809:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.764817:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.764826:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764836:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b4dc21/0xad8e53a42304836e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.764837:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.764877:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.764884:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764893:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144348.764896:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.764900:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764920:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.764924:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.764934:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.764941:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764947:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.764948:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.764960:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.764963:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764984:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.764989:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.764997:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c8a698d/0xad8e53a423048375 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765004:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765016:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.765023:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765024:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765031:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765039:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765042:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.765047:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765067:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765075:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.765079:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765087:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000067c5261/0xad8e53a42304837c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765091:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.765100:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765107:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765110:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.765111:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765116:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.765117:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.765120:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.765128:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765131:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765132:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765140:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.765143:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.765151:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765164:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765167:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765172:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765192:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765196:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1889725/0xad8e53a423048383 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765219:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.765219:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.765226:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765228:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765237:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.765241:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765249:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.765258:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.765261:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765265:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765276:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3ea22b/0xad8e53a42304838a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765289:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.765292:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:0.0:1783144348.765293:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765295:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.765301:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.765306:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765315:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765322:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765328:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765342:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.765364:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.765370:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765378:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517e00 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:2.0:1783144348.765380:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.765382:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765387:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765396:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765408:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:3.0:1783144348.765409:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765414:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.765423:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765424:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9605370/0xad8e53a423048391 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765448:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765450:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765454:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765457:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.765462:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765476:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765489:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.765497:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.765503:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765511:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.765522:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.765525:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.765534:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765538:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765548:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.765552:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.765554:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765556:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765571:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048210891/0xad8e53a423048398 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765575:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765584:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765590:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765593:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.765594:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765608:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.765616:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.765622:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765630:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.765633:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.765639:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.765640:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765647:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765654:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765660:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.765665:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.765673:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765676:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337141e9/0xad8e53a42304839f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765683:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765693:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765694:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765698:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765700:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.765703:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765736:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783144348.765772:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.765776:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765784:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.765786:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.765789:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765798:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765815:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765818:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.765825:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765826:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765841:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.765842:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.765848:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765853:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.765859:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765861:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144348.765876:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.765885:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.765885:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765886:0:26143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765892:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765898:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.765907:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.765913:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765917:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765917:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a783110f/0xad8e53a4230483a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765937:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765944:0:26143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765947:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d3f290/0xad8e53a4230483ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.765958:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.765964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.765965:0:26143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.765979:0:26143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.765983:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765987:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.765997:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.766012:0:26143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1783144348.766039:0:26143:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1794 00010000:00010000:0.0:1783144348.766069:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.766075:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.766084:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.766087:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.766096:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.766115:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.766122:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c1b7c3/0xad8e53a4230483b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144348.766133:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:90847:x1869759501326336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14515us (15593us total) trans 0 rc 0/0 00010000:00010000:0.0:1783144348.766139:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.766143:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.766146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144348.766147:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4955 00000100:00100000:3.0:1783144348.766186:0:90847:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90847:1869759501326336:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783144348.766213:0:90847:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x702:0x0] 00000100:00100000:3.0:1783144348.766311:0:90847:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90847:1869759501326720:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783144348.766364:0:90847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144348.766382:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144348.766390:0:90847:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cb000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144348.766397:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501326592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144348.766410:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326720 00000100:00100000:3.0:1783144348.766417:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326720 00000100:00100000:0.0:1783144348.766433:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144348.766468:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326592 00000100:00100000:0.0:1783144348.766472:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326592 00000100:00100000:3.0:1783144348.766474:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957 00000100:00100000:3.0:1783144348.766503:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:90847:x1869759501326720:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783144348.766504:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:0.0:1783144348.766515:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501326592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783144348.766531:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00002000:00080000:3.0:1783144348.766542:0:26145:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00000100:00100000:0.0:1783144348.766569:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501326592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144348.766576:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:0.0:1783144348.766613:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501326592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144348.768023:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:90847:x1869759501326720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1522us (1656us total) trans 4294968828 rc 0/0 00000100:00100000:3.0:1783144348.768033:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957 00002000:00010000:1.0:1783144348.768326:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.768334:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.768346:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.768349:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.768353:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.768367:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.768384:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.768391:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144348.768531:0:90847:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90847:1869759501326720:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783144348.768542:0:90847:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00010000:00010000:1.0:1783144348.769118:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.769198:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.769204:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769212:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.769216:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.769220:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769231:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769239:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769246:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769270:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783144348.769322:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.769327:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769335:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.769338:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.769342:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769350:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769358:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769365:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.769384:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783144348.769393:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783144348.769473:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144348.769479:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.769499:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.769504:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.769514:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.769551:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.769557:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.769565:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.769567:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.769569:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.769586:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eaf5f3/0xad8e53a4230483c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.769588:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.769613:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.769615:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.769619:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.769622:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a4230483c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.769650:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.769652:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.769655:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.769681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.770157:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770167:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.770177:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770253:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770268:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770276:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230483bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770293:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.770296:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.770298:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144348.770350:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.770355:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770361:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.770364:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.770367:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770375:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770688:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770697:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770714:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:3.0:1783144348.770759:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1783144348.770778:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.770785:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770794:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.770798:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.770802:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770813:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.770815:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.770824:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770826:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.770843:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.770846:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.770847:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.770865:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770899:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.770932:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.770939:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001446fa58/0xad8e53a4230483d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.770945:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.770960:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144348.770961:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.770965:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.770981:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.770982:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.770983:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:0.0:1783144348.770987:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.770988:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.771000:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771000:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771018:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771022:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1eb006/0xad8e53a4230483d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771035:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.771038:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.771045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.771046:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771056:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771072:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.771084:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.771088:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771094:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.771097:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771103:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.771109:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.771111:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771119:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771120:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce75c51/0xad8e53a4230483de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771140:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:0.0:1783144348.771141:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.771143:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.771144:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.771150:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.771155:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771165:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771174:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771182:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771207:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.771223:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.771227:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771233:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.771236:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771241:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.771245:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.771251:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771259:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771261:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:3.0:1783144348.771270:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d8c8b0/0xad8e53a4230483e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771270:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.771279:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771298:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771301:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.771305:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.771308:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.771311:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771325:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771345:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144348.771368:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.771373:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.771380:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ec00 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:1.0:1783144348.771381:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.771383:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771385:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.771392:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771393:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.771396:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.771400:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771409:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771416:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771423:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771441:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144348.771459:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.771467:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b4ec625/0xad8e53a4230483ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771470:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783144348.771475:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.771478:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771481:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.771483:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.771486:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.771490:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.771490:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.771495:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:0.0:1783144348.771497:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771501:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.771510:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771529:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771532:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771544:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771549:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771551:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771568:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd104b9/0xad8e53a4230483f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771578:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.771580:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.771583:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771587:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.771589:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.771595:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.771595:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771604:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771608:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005fe3543/0xad8e53a4230483fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.771619:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.771625:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771631:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.771634:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.771636:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771640:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.771643:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.771643:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.771647:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.771659:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771664:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771677:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.771704:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.771707:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771712:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.771714:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.771716:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771743:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771752:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771760:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771782:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783144348.771792:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144348.771801:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.771809:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.771813:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.771821:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144348.771822:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771827:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771830:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.771835:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771837:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771837:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.771842:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144348.771850:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab8c17b4/0xad8e53a423048401 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771850:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771853:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.771858:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.771866:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771867:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.771870:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.771873:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.771876:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.771884:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771890:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e58085d/0xad8e53a423048408 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.771915:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.771917:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.771919:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.772043:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772050:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772066:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.772103:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.772108:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772115:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.772122:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.772127:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772136:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772141:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772145:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772155:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144348.772178:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:1.0:1783144348.772181:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144348.772184:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772188:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772198:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.772203:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:0.0:1783144348.772205:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772213:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772219:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.772226:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772227:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772246:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fba7c50/0xad8e53a42304840f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772247:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772264:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772273:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772282:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144348.772287:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772288:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.772317:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.772321:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772325:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.772327:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.772330:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772335:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772339:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772347:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772360:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144348.772367:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144348.772370:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772382:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.772386:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772390:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.772394:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772402:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772412:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772423:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772429:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064c8e8ff/0xad8e53a423048416 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772441:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.772444:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772449:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.772453:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772460:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772468:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772469:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.772477:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027beca45/0xad8e53a423048424 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.772495:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.772496:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.772498:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.772543:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772550:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080845839/0xad8e53a42304841d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772564:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.772566:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.772569:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.772570:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144348.772608:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.772614:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772621:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.772624:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.772627:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772636:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772649:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772656:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772706:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.772766:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.772771:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772779:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.772781:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.772786:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772795:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772803:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.772811:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772899:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144348.772904:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772911:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.772914:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772932:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772943:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772963:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444787ab/0xad8e53a42304842b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772984:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.772988:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.772994:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.772997:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773005:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773017:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.773026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.773033:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.773064:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783144348.773068:0:26141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000203c5214/0xad8e53a423048432 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.773088:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144348.773120:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.773125:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773132:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.773134:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.773138:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773145:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773152:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773159:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773174:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.773199:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.773205:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.773209:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.773220:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144348.773221:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773225:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773247:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773249:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.773257:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.773263:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773264:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773283:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5e155de/0xad8e53a423048439 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773286:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773302:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773305:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.773307:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.773310:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.773313:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773332:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.773370:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.773375:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773382:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:3.0:1783144348.773383:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144348.773386:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.773390:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773393:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773405:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.773409:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773417:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773428:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773435:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009389a432/0xad8e53a423048440 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773453:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773458:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.773461:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.773463:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.773480:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773487:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773506:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144348.773520:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.773524:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773531:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.773534:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773542:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.773546:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.773550:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773553:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773558:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.773560:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcac911f/0xad8e53a423048447 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773561:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.773565:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773573:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.773573:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.773576:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.773581:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773589:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773617:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.773654:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.773658:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773663:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.773665:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.773668:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773673:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773677:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773685:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773699:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783144348.773739:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144348.773745:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773754:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.773758:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.773764:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144348.773767:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773772:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773790:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:3.0:1783144348.773795:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773805:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144348.773807:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c4a0f8/0xad8e53a42304844e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773812:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773828:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773830:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.773836:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773843:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773848:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.773855:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773857:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773877:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773885:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144348.773891:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773901:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f737452e/0xad8e53a423048455 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773901:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.773908:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773919:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.773920:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.773922:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773924:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144348.773925:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.773930:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.773934:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.773942:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.773944:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773945:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.773961:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773967:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773969:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773975:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe79e63/0xad8e53a42304845c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.773977:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773987:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.773989:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.773989:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.773990:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.774002:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144348.774007:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144348.774011:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774018:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.774021:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774028:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774037:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.774040:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.774045:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774053:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.774054:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a423048463 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774056:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.774060:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774066:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.774068:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.774069:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.774069:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774076:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774083:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774102:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144348.774127:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.774130:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774139:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.774141:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.774143:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774149:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774153:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774158:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774169:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783144348.774177:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144348.774183:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774188:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144348.774196:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.774197:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774202:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.774202:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.774210:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774211:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144348.774215:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774224:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774225:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:2.0:1783144348.774227:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774232:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.774239:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774251:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774252:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774255:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774267:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089ebb139/0xad8e53a423048471 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774276:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e0e619/0xad8e53a42304846a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774281:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774285:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.774287:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144348.774293:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.774295:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774303:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.774306:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144348.774309:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144348.774311:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144348.774315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.774322:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144348.774325:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774345:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.774346:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.774358:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774364:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774368:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.774374:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.774378:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774384:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a423048478 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774396:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774405:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.774406:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774415:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144348.774420:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144348.774424:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.774446:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144348.774447:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.774451:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774458:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.774462:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774470:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774480:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144348.774481:0:26141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144348.774486:0:26141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774488:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a42304847f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774493:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=2883s v=(0 0) 00010000:00010000:1.0:1783144348.774496:0:26141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144348.774500:0:26141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774502:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.774503:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.774505:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144348.774508:0:26141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774516:0:26141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774523:0:26141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144348.774538:0:26141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783144348.774562:0:26141:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1795 00010000:00010000:0.0:1783144348.774564:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144348.774567:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774578:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144348.774581:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774588:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774597:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774603:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048486 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144348.774614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.774615:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144348.774617:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144348.774648:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:90849:x1869759501326464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22633us (24005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144348.774656:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956 00000100:00100000:3.0:1783144348.774704:0:90849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90849:1869759501326464:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783144348.774732:0:90849:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x703:0x0] 00000100:00100000:3.0:1783144348.774789:0:90849:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90849:1869759501326976:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783144348.774790:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501326848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144348.774829:0:90849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144348.774840:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144348.774849:0:90849:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144348.774886:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326848 00000100:00100000:2.0:1783144348.774891:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501326976 00000100:00100000:0.0:1783144348.774892:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326848 00000100:00100000:2.0:1783144348.774894:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501326976 00000100:00100000:0.0:1783144348.774926:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:2.0:1783144348.774932:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958 00000100:00100000:0.0:1783144348.774934:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501326848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144348.774938:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:90849:x1869759501326976:12345-0@lo:5:osp-pre-1-0.0 00002000:00000024:0.0:1783144348.774962:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00002000:00080000:2.0:1783144348.774975:0:26150:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00000100:00100000:0.0:1783144348.774998:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501326848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144348.775015:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:3.0:1783144348.775034:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501326848:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783144348.775790:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144348.776203:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:90849:x1869759501326976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1263us (1372us total) trans 4294968827 rc 0/0 00000100:00100000:2.0:1783144348.776211:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958 00000100:00100000:3.0:1783144348.776271:0:90849:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90849:1869759501326976:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783144348.776278:0:90849:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00000100:00100000:3.0:1783144349.283380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144349.283753:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481680000 00000100:00100000:1.0:1783144349.283767:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481680000 00000100:00100000:1.0:1783144349.283822:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:1.0:1783144349.283833:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad14e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2406:x1869759481680000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144349.283907:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad14e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2406:x1869759481680000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144349.283914:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00010000:00010000:3.0:1783144349.646744:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783144349.719150:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783144350.671251:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144351.245885:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144351.245904:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501327104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144351.245974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144351.246016:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501327104 00000100:00100000:1.0:1783144351.246022:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501327104 00000100:00100000:1.0:1783144351.246068:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1783144351.246076:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501327104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144351.246100:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144351.246137:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501327104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144351.246144:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1783144351.246183:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501327104:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783144351.246250:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144351.246343:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144351.248772:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501327232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144351.248821:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144351.248903:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501327232 00000100:00100000:2.0:1783144351.248909:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501327232 00000100:00100000:2.0:1783144351.248961:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:2.0:1783144351.248970:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501327232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144351.248994:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144351.249032:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501327232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144351.249039:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00080000:3.0:1783144351.249090:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144351.249119:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501327232:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1783144351.278849:0:91409:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1783144351.696071:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783144352.050438:0:91457:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783144352.717848:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144353.460404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144353.460531:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481680128 00000100:00100000:0.0:1783144353.460540:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481680128 00000100:00100000:0.0:1783144353.460601:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1167 00000100:00100000:0.0:1783144353.460608:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:70170:x1869759481680128:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144353.460624:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144353.460642:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a42304848d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b45 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.460689:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.460699:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.460705:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783144353.460762:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1783144353.460766:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783144353.460771:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144353.460795:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.460818:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a42304848d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.460840:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.460860:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:0.0:1783144353.460863:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783144353.460867:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3c800, rc 0) 00000100:00100000:0.0:1783144353.460936:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:70170:x1869759481680128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 326us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144353.460943:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1167 00000100:00100000:3.0:1783144353.466584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144353.466866:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481680256 00000100:00100000:1.0:1783144353.466876:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481680256 00000100:00100000:1.0:1783144353.466946:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1168 00000100:00100000:1.0:1783144353.466957:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:70170:x1869759481680256:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144353.466993:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00000100:00100000:1.0:1783144353.467114:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:70170:x1869759481680256:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 158us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.467122:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1168 00000100:00100000:3.0:1783144353.473680:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144353.473760:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481680384 00000100:00100000:2.0:1783144353.473769:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481680384 00000100:00100000:2.0:1783144353.473880:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1169 00000100:00100000:2.0:1783144353.473888:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:70170:x1869759481680384:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144353.473926:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00080000:3.0:1783144353.473946:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144353.473992:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+6:70170:x1869759481680384:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.474019:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1169 00000100:00100000:2.0:1783144353.476226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144353.476632:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481680512 00000100:00100000:1.0:1783144353.476640:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481680512 00000100:00100000:1.0:1783144353.476958:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1622 00000100:00100000:1.0:1783144353.476976:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:70170:x1869759481680512:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144353.477005:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144353.477066:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+6:70170:x1869759481680512:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 92us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.477073:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1622 00000100:00080000:3.0:1783144353.477420:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144353.478577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144353.478646:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481680640 00000100:00100000:2.0:1783144353.478652:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481680640 00000100:00100000:2.0:1783144353.478742:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1623 00000100:00100000:2.0:1783144353.478752:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+7:70170:x1869759481680640:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144353.478771:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144353.478821:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cace81e7-a6f2-4d37-b197-caf34583781c+7:70170:x1869759481680640:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.478828:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1623 00000100:00080000:3.0:1783144353.479030:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144353.499505:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144353.499558:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481680896 00000100:00100000:1.0:1783144353.499567:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481680896 00000100:00100000:1.0:1783144353.499668:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1170 00000100:00100000:1.0:1783144353.499678:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+8:70187:x1869759481680896:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144353.499699:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144353.499718:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304849b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b4c expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499798:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499808:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499816:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499825:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499830:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499848:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499933:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499941:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499948:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499959:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499965:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144353.499969:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499977:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.499988:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:1.0:1783144353.499991:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144353.499997:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500003:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519e00/0xad8e53a4230484a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500020:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500032:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500038:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500043:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144353.500046:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500052:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500060:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2af565c100) 00010000:00010000:1.0:1783144353.500063:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144353.500066:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500072:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a4230484a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500101:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304849b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b4c expref: 9 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500108:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:1.0:1783144353.500110:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783144353.500112:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304849b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b4c expref: 9 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144353.500127:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1518800, rc 0) 00000100:00100000:1.0:1783144353.500173:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+8:70187:x1869759481680896:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 497us (676us total) trans 0 rc 301/301 00000100:00100000:1.0:1783144353.500180:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1170 00000100:00100000:1.0:1783144353.502438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144353.502547:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481681024 00000100:00100000:3.0:1783144353.502556:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481681024 00000100:00100000:3.0:1783144353.502614:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1171 00000100:00100000:3.0:1783144353.502624:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:70187:x1869759481681024:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:3.0:1783144353.502691:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502707:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502827:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502844:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502863:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502871:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502960:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502969:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.502982:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144353.503020:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1783144353.503024:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144353.503036:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503047:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503053:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503060:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503076:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144353.503081:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503097:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503109:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:3.0:1783144353.503112:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144353.503117:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503124:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a4230484b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503136:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503143:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503149:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503154:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144353.503157:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503162:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503169:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2aee3db300) 00010000:00010000:3.0:1783144353.503172:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144353.503175:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503203:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230484b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503218:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503224:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503230:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503235:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144353.503238:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503245:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503253:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:3.0:1783144353.503255:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144353.503258:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144353.503263:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230484be lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144353.503335:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+8:70187:x1869759481681024:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 712us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144353.503343:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1171 00000100:00100000:3.0:1783144353.518712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144353.518818:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481681280 00000100:00100000:2.0:1783144353.518827:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481681280 00000100:00100000:2.0:1783144353.518880:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1172 00000100:00100000:2.0:1783144353.518890:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+8:70189:x1869759481681280:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144353.518908:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144353.518936:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a4230484c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b53 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519003:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519016:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519027:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519162:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519170:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519176:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519247:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519256:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519262:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519268:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144353.519272:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519279:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519290:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:2.0:1783144353.519293:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144353.519297:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519303:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a4230484cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519321:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519327:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519333:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519338:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144353.519341:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519347:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519355:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2ac54e4300) 00010000:00010000:2.0:1783144353.519357:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144353.519360:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519366:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230484d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519394:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a4230484c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b53 expref: 9 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519404:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:2.0:1783144353.519406:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783144353.519415:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a4230484c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b53 expref: 9 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144353.519424:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517400, rc 0) 00000100:00100000:2.0:1783144353.519575:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+8:70189:x1869759481681280:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 686us (871us total) trans 0 rc 301/301 00000100:00100000:2.0:1783144353.519582:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1172 00000100:00100000:2.0:1783144353.524235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144353.524347:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481681408 00000100:00100000:0.0:1783144353.524357:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481681408 00000100:00100000:0.0:1783144353.524406:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1173 00000100:00100000:0.0:1783144353.524414:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:70189:x1869759481681408:12345-192.168.203.4@tcp:34:lfs.0 00010000:00010000:0.0:1783144353.524483:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524498:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524509:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524523:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524530:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524536:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524600:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524621:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524627:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144353.524666:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1783144353.524670:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144353.524681:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524693:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524699:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524706:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524712:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144353.524715:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524757:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524768:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:0.0:1783144353.524771:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144353.524775:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524790:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524803:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524809:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524815:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524819:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3cc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144353.524822:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524828:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524835:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c29ca14f800) 00010000:00010000:0.0:1783144353.524838:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144353.524840:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524846:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524859:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524864:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524873:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524878:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144353.524881:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524886:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524893:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:0.0:1783144353.524895:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144353.524897:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.524903:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484e8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144353.524981:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:70189:x1869759481681408:12345-192.168.203.4@tcp:34:lfs.0 Request processed in 566us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144353.524989:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1173 00000100:00100000:1.0:1783144353.549117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144353.549228:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481681664 00000100:00100000:0.0:1783144353.549238:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481681664 00000100:00100000:0.0:1783144353.549289:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1174 00000100:00100000:0.0:1783144353.549298:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+8:70196:x1869759481681664:12345-192.168.203.4@tcp:101:md5sum.0 00010000:00010000:0.0:1783144353.549318:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144353.549336:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b5a expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549424:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549447:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549457:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549575:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549583:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549590:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549696:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423048504 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549704:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423048504 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549711:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423048504 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144353.549746:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00010000:00010000:0.0:1783144353.549829:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549848:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549853:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549859:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549864:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3cc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144353.549868:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549875:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549887:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:0.0:1783144353.549889:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144353.549893:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549899:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a4230484f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549911:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549926:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549932:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549943:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144353.549946:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549952:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549961:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c29ca14f800) 00010000:00010000:0.0:1783144353.549964:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144353.549967:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.549973:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a4230484fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.550023:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a4230484ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b5a expref: 11 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.550036:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423048504 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b5a expref: 10 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144353.550044:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:0.0:1783144353.550046:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144353.550049:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3de00, rc 0) 00000100:00100000:0.0:1783144353.550185:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:70196:x1869759481681664:12345-192.168.203.4@tcp:101:md5sum.0 Request processed in 887us (1076us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1783144353.550193:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1174 00000100:00100000:3.0:1783144353.557624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144353.557836:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481681792 00000100:00100000:1.0:1783144353.557847:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481681792 00002000:00100000:1.0:1783144353.557891:0:24813:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9c29c3c27b80 x1869759481681792/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:464/0 lens 488/0 e 0 to 0 dl 1783144364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144353.557902:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3c27b80 with x1869759481681792 ext(0->32767) 00002000:00010000:1.0:1783144353.557908:0:24813:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c3c27b80 00000100:00100000:1.0:1783144353.557953:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 751 00000100:00100000:1.0:1783144353.557965:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:2404:x1869759481681792:12345-192.168.203.4@tcp:3:md5sum.0 00000100:00100000:1.0:1783144353.565680:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:2404:x1869759481681792:12345-192.168.203.4@tcp:3:md5sum.0 Request processed in 7708us (8056us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.565694:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 751 00002000:00100000:1.0:1783144353.565705:0:24813:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x702:0x0] (0->32767) req@ffff9c29c3c27b80 x1869759481681792/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:464/0 lens 488/440 e 0 to 0 dl 1783144364 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144353.565714:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3c27b80 with x1869759481681792 ext(0->32767) 00002000:00010000:1.0:1783144353.565745:0:24813:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c3c27b80 00000100:00100000:2.0:1783144353.573367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144353.575086:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144353.575206:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481681920 00000100:00100000:3.0:1783144353.575216:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481681920 00002000:00100000:3.0:1783144353.575253:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9c29c3dfce00 x1869759481681920/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:464/0 lens 488/0 e 0 to 0 dl 1783144364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783144353.575263:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3dfce00 with x1869759481681920 ext(32768->1048575) 00002000:00010000:3.0:1783144353.575268:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c3dfce00 00000100:00100000:3.0:1783144353.575298:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481682048 00000100:00100000:3.0:1783144353.575301:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481682048 00002000:00100000:3.0:1783144353.575320:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9c29c3dff480 x1869759481682048/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:464/0 lens 488/0 e 0 to 0 dl 1783144364 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144353.575323:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 752 00002000:00100000:3.0:1783144353.575332:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3dff480 with x1869759481682048 ext(1048576->2097151) 00002000:00010000:3.0:1783144353.575337:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c3dff480 00000100:00100000:1.0:1783144353.575344:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481681920:12345-192.168.203.4@tcp:3:md5sum.0 00000100:00100000:3.0:1783144353.575359:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 753 00000100:00100000:3.0:1783144353.575370:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481682048:12345-192.168.203.4@tcp:3:md5sum.0 00000100:00100000:1.0:1783144353.577351:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481681920:12345-192.168.203.4@tcp:3:md5sum.0 Request processed in 2007us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.578877:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 752 00002000:00100000:1.0:1783144353.578892:0:24810:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x702:0x0] (32768->1048575) req@ffff9c29c3dfce00 x1869759481681920/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:464/0 lens 488/440 e 0 to 0 dl 1783144364 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144353.578904:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3dfce00 with x1869759481681920 ext(32768->1048575) 00002000:00010000:1.0:1783144353.578911:0:24810:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c29c3dfce00 00000100:00100000:1.0:1783144353.585993:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481682048:12345-192.168.203.4@tcp:3:md5sum.0 Request processed in 10612us (10899us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1783144353.586002:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 753 00002000:00100000:1.0:1783144353.586014:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x702:0x0] (1048576->2097151) req@ffff9c29c3dff480 x1869759481682048/t0(0) o3->cace81e7-a6f2-4d37-b197-caf34583781c@192.168.203.4@tcp:464/0 lens 488/440 e 0 to 0 dl 1783144364 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144353.586024:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3dff480 with x1869759481682048 ext(1048576->2097151) 00002000:00010000:1.0:1783144353.586031:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c3dff480 00000100:00100000:3.0:1783144353.594116:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144353.594764:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481682304 00000100:00100000:2.0:1783144353.594774:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481682304 00000100:00100000:2.0:1783144353.594821:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 225 00000100:00100000:2.0:1783144353.594830:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5c3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:70196:x1869759481682304:12345-192.168.203.4@tcp:35:md5sum.0 00000100:00100000:2.0:1783144353.595245:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5c3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cace81e7-a6f2-4d37-b197-caf34583781c+11:70196:x1869759481682304:12345-192.168.203.4@tcp:35:md5sum.0 Request processed in 414us (1136us total) trans 111669149698 rc 0/0 00000100:00100000:2.0:1783144353.595253:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 225 00010000:00010000:3.0:1783144353.742038:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144353.805956:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501327360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144353.806018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144353.806100:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501327360 00000100:00100000:2.0:1783144353.806104:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501327360 00000100:00100000:2.0:1783144353.806142:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:2.0:1783144353.806148:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501327360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144353.806152:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501327488:0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783144353.806176:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00000100:00100000:3.0:1783144353.806191:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144353.806223:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869759501327360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.806231:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:2.0:1783144353.806275:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501327488 00000100:00100000:2.0:1783144353.806279:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501327488 00000100:00100000:2.0:1783144353.806302:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:2.0:1783144353.806308:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501327488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783144353.806332:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445302272 avail 1299062784 00000100:00100000:2.0:1783144353.806369:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501327488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.806377:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:2.0:1783144353.806399:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501327872:0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.806420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144353.806438:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501327616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144353.806438:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501328384:0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.806475:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144353.806481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144353.806497:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501328128:0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.806511:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501328896:0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.806518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144353.806536:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501327744:0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.806540:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501328640:0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.806552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144353.806589:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144353.806590:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144353.806598:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501327360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144353.806622:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783144353.806630:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501328000:0@lo:400:kworker.0 00000100:00100000:1.0:1783144353.806635:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501328256:0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.806638:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501329152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783144353.806672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144353.806677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144353.807205:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501327616 00000100:00100000:1.0:1783144353.807210:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501327616 00000100:00100000:1.0:1783144353.807304:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329152 00000100:00100000:1.0:1783144353.807308:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329152 00000100:00100000:1.0:1783144353.807582:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1783144353.807592:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501327616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144353.807597:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501328512:0@lo:400:kworker.0 00002000:00000024:1.0:1783144353.807611:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144353.807631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144353.807670:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501327616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.807676:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1783144353.807689:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:1.0:1783144353.807694:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501329152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144353.807703:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144353.807738:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501329152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.807745:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:2.0:1783144353.807798:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501329024:0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.807824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144353.807856:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328384 00000100:00100000:2.0:1783144353.807860:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328384 00000100:00100000:0.0:1783144353.807880:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501327872 00000100:00100000:2.0:1783144353.807890:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328896 00000100:00100000:2.0:1783144353.807900:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328896 00000100:00100000:0.0:1783144353.807938:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501327872 00000100:00100000:2.0:1783144353.807951:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328512 00000100:00100000:2.0:1783144353.807956:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328512 00000100:00100000:0.0:1783144353.807972:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328128 00000100:00100000:0.0:1783144353.807976:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328128 00000100:00100000:2.0:1783144353.807989:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1783144353.807999:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328640 00000100:00100000:2.0:1783144353.808000:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501328384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144353.808003:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328640 00000100:00100000:2.0:1783144353.808046:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501328384:12345-0@lo:400:kworker.0 Request processed in 49us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.808052:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1783144353.808065:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1783144353.808072:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501328896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144353.808084:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:1.0:1783144353.808094:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501328512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.808103:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501328896:12345-0@lo:400:kworker.0 Request processed in 31us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.808110:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1783144353.808131:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501328512:12345-0@lo:400:kworker.0 Request processed in 39us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.808139:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501327744 00000100:00100000:1.0:1783144353.808139:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1783144353.808144:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501327744 00000100:00080000:1.0:1783144353.808162:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783144353.808167:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144353.808170:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144353.808177:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783144353.808186:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501327744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144353.808209:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328000 00000100:00100000:1.0:1783144353.808213:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328000 00000100:00100000:2.0:1783144353.808222:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501327744:12345-0@lo:400:kworker.0 Request processed in 37us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.808246:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329024 00000100:00100000:1.0:1783144353.808249:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329024 00000100:00100000:1.0:1783144353.808260:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1783144353.808266:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501327872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144353.808304:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501327872:12345-0@lo:400:kworker.0 Request processed in 38us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.808309:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1783144353.808329:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1783144353.808340:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501328128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.808387:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501329152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144353.808400:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501327616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144353.808434:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783144353.808439:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501327488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144353.808466:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1783144353.808477:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501328000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.808486:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1783144353.808498:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501329024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.808519:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501328000:12345-0@lo:400:kworker.0 Request processed in 44us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144353.808527:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1783144353.808546:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1783144353.808555:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501328640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.808560:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501329024:12345-0@lo:400:kworker.0 Request processed in 63us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144353.808569:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00080000:0.0:1783144353.808576:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144353.808594:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501328640:12345-0@lo:400:kworker.0 Request processed in 40us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144353.808603:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1783144353.808604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144353.808628:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328256 00000100:00100000:3.0:1783144353.808632:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328256 00000100:00100000:2.0:1783144353.808636:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501328768:0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.808659:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:3.0:1783144353.808666:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501328256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.808674:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144353.808701:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501328256:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144353.808707:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1783144353.808714:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501327744:0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.808740:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501328768 00000100:00100000:3.0:1783144353.808749:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501328768 00000100:00100000:3.0:1783144353.808769:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1783144353.808775:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501328768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.808801:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501328768:12345-0@lo:400:kworker.0 Request processed in 27us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144353.808807:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1783144353.808829:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501328640:0@lo:400:kworker.0 00000100:00080000:0.0:1783144353.809227:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144353.809250:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501328000:0@lo:400:kworker.0 00000100:00100000:0.0:1783144353.809260:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501328512:0@lo:400:kworker.0 00000100:00100000:0.0:1783144353.809274:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501329024:0@lo:400:kworker.0 00000100:00100000:0.0:1783144353.809284:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501327872:0@lo:400:kworker.0 00000100:00100000:0.0:1783144353.809294:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501328384:0@lo:400:kworker.0 00000100:00100000:0.0:1783144353.809574:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501328896:0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.810003:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501328256:0@lo:400:kworker.0 00000100:00100000:2.0:1783144353.810021:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501328768:0@lo:400:kworker.0 00000100:00100000:3.0:1783144353.810060:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501328128:0@lo:400:kworker.0 00000100:00100000:1.0:1783144353.810088:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501328128:12345-0@lo:400:kworker.0 Request processed in 1108us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144353.810097:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1783144354.404362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144354.404406:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144354.404430:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481682560 00000100:00100000:3.0:1783144354.404439:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481682560 00000100:00100000:3.0:1783144354.404493:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 811 00000100:00100000:3.0:1783144354.404504:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+11:2404:x1869759481682560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144354.404570:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+11:2404:x1869759481682560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144354.404575:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 811 00000100:00100000:2.0:1783144354.404699:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481682432 00000100:00100000:2.0:1783144354.404705:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481682432 00000100:00100000:2.0:1783144354.404766:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:2.0:1783144354.404783:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481682432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144354.404814:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481682432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144354.404821:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1783144354.410802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144354.410836:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144354.410862:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144354.410873:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481682688 00000100:00100000:0.0:1783144354.410883:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481682688 00000100:00100000:2.0:1783144354.410945:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481682816 00000100:00100000:0.0:1783144354.410950:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 812 00000100:00100000:2.0:1783144354.410952:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481682816 00000100:00100000:0.0:1783144354.410960:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481682688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144354.410988:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481682944 00000100:00100000:2.0:1783144354.410993:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481682944 00000100:00100000:3.0:1783144354.411004:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2036 00000100:00100000:3.0:1783144354.411015:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481682816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144354.411026:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+6:2403:x1869759481682688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144354.411027:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2037 00000100:00100000:0.0:1783144354.411037:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 812 00000100:00100000:2.0:1783144354.411042:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481682944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144354.411051:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cace81e7-a6f2-4d37-b197-caf34583781c+6:2404:x1869759481682816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 37us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144354.411059:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2036 00000100:00100000:2.0:1783144354.411082:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:cace81e7-a6f2-4d37-b197-caf34583781c+7:2403:x1869759481682944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144354.411092:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2037 00010000:00010000:0.0:1783144354.765877:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783144354.833204:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968828 is committed 00000001:00080000:3.0:1783144354.834397:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968827 is committed 00010000:00010000:0.0:1783144355.790860:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783144355.857201:0:90830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149698 is committed 00000100:00100000:1.0:1783144356.365850:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783144356.365871:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501329280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144356.366417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144356.366478:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329280 00000100:00100000:0.0:1783144356.366491:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329280 00000100:00080000:1.0:1783144356.366551:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144356.366590:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:0.0:1783144356.366604:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501329280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144356.366646:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144356.366811:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144356.366823:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501329408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144356.366854:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.366946:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329408 00000100:00100000:1.0:1783144356.366953:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329408 00000100:00100000:0.0:1783144356.367011:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501329280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 408us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144356.367012:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1783144356.367034:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501329408:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144356.367034:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00002000:00000024:1.0:1783144356.367072:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783144356.367119:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144356.367132:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501329408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144356.367140:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:0.0:1783144356.367193:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501329280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144356.367201:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501329408:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1783144356.552184:0:91652:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 01:52:36 (1783144356) 00000100:00100000:3.0:1783144356.583162:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.583476:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481683200 00000100:00100000:1.0:1783144356.583485:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481683200 00000100:00100000:1.0:1783144356.583558:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1175 00000100:00100000:1.0:1783144356.583570:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+6:70770:x1869759481683200:12345-192.168.203.4@tcp:36:mkdir.0 00000100:00100000:1.0:1783144356.583680:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID:66114:1869759501329536:0@lo:900:mdt00_002.0 00000100:00080000:2.0:1783144356.583739:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144356.583748:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.583786:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.584580:0:66124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329536 00000100:00100000:0.0:1783144356.584586:0:66124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329536 00000100:00100000:0.0:1783144356.584619:0:66124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783144356.584628:0:66124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66114:x1869759501329536:12345-0@lo:900:mdt00_002.0 00000100:00100000:0.0:1783144356.584685:0:66124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66114:x1869759501329536:12345-0@lo:900:mdt00_002.0 Request processed in 59us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144356.584694:0:66124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783144356.584719:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID:66114:1869759501329536:0@lo:900:mdt00_002.0 00000100:00100000:2.0:1783144356.584790:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501329664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.584829:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.584858:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.585305:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329664 00000100:00100000:0.0:1783144356.585311:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329664 00000100:00100000:0.0:1783144356.585394:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:0.0:1783144356.585402:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66114:x1869759501329664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783144356.585461:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66114:x1869759501329664:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144356.585468:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1783144356.585699:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501329664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.586020:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501329792:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.586048:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.586073:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.586128:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329792 00000100:00100000:3.0:1783144356.586133:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329792 00000100:00100000:3.0:1783144356.586157:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:3.0:1783144356.586163:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66114:x1869759501329792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144356.586228:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66114:x1869759501329792:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.586235:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:2.0:1783144356.586578:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501329792:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.586614:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501329920:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.586639:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.586695:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.586806:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501329920 00000100:00100000:3.0:1783144356.586810:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501329920 00000100:00100000:3.0:1783144356.586839:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:3.0:1783144356.586847:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66114:x1869759501329920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144356.586926:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66114:x1869759501329920:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (286us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144356.586934:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:2.0:1783144356.586956:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501329920:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783144356.587004:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.587014:0:66114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.587024:0:66114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144356.587036:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330048:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1783144356.587058:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.587081:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.587156:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501330048 00000100:00100000:3.0:1783144356.587162:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501330048 00000100:00100000:3.0:1783144356.587197:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:3.0:1783144356.587205:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66114:x1869759501330048:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783144356.587215:0:78024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144356.587230:0:78024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048512 expref: -99 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.587253:0:78024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.587264:0:78024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 7 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.587301:0:78024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.587314:0:78024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 8 pid: 66114 timeout: 2990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144356.587325:0:78024:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:78024:1869759501330176:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144356.587382:0:78024:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.589227:0:78024:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:78024:1869759501330176:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144356.589262:0:78024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 7 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.589274:0:78024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:3.0:1783144356.589277:0:78024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144356.589281:0:78024:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 7 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.589291:0:78024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1600, rc 0) 00000100:00100000:3.0:1783144356.589332:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501330048:12345-0@lo:101:mdt00_002.0 Request processed in 2128us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.589339:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:3.0:1783144356.590100:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144356.590141:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481683328 00000100:00100000:3.0:1783144356.590146:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481683328 00000100:00100000:2.0:1783144356.590181:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330048:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783144356.590192:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 9 pid: 66114 timeout: 2990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.590199:0:66114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.590227:0:66114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144356.590361:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2545 00000100:00100000:3.0:1783144356.590373:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:2404:x1869759481683328:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783144356.590386:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144356.590393:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 9 pid: 66114 timeout: 2990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590405:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 9 pid: 66114 timeout: 2990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590423:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048494 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b45 expref: 9 pid: 66114 timeout: 2990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590435:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:3.0:1783144356.590440:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 6 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590449:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 6 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590457:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 6 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590485:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 6 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144356.590499:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1869759501330304:0@lo:105: 00000100:00100000:3.0:1783144356.590540:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144356.590569:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.590587:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501330304 00000100:00100000:3.0:1783144356.590591:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501330304 00000100:00100000:3.0:1783144356.590618:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1783144356.590684:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1869759501330304:12345-0@lo:105: 00010000:00010000:3.0:1783144356.590951:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590961:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590969:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590976:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590983:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.590993:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.591018:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c2ac7516600) 00000100:00100000:3.0:1783144356.591060:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1869759501330304:12345-0@lo:105: Request processed in 435us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.591067:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:2.0:1783144356.591078:0:66114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.591089:0:66114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783144356.591097:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1783144356.591111:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783144356.591140:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.591147:0:66114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.591156:0:66114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144356.591170:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330432:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1783144356.591197:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.591223:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.591251:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501330432 00000100:00100000:3.0:1783144356.591256:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501330432 00000100:00100000:3.0:1783144356.591287:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:3.0:1783144356.591296:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501330432:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783144356.591309:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144356.591325:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423048527 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048520 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.591342:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423048527 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048520 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.591352:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423048527 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048520 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.591358:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2ae00b1000) 00010000:00010000:3.0:1783144356.591361:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144356.591363:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1000, rc 0) 00000100:00100000:3.0:1783144356.591400:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330432:12345-0@lo:101:mdt00_002.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.591407:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1783144356.591434:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330432:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1783144356.591446:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.591456:0:66114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144356.591474:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1783144356.591501:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330560:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.591538:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.591566:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.591649:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501330560 00000100:00100000:3.0:1783144356.591654:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501330560 00000100:00100000:3.0:1783144356.591685:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:3.0:1783144356.591694:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144356.591918:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330560:12345-0@lo:1000:mdt00_002.0 Request processed in 225us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.591925:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:2.0:1783144356.591991:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330560:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783144356.592001:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1869759501330304:0@lo:105: 00010000:00010000:0.0:1783144356.592011:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144356.592026:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330688:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.592047:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144356.592053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cace81e7-a6f2-4d37-b197-caf34583781c+8:2404:x1869759481683328:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1683us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144356.592059:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.592061:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2545 00000100:00100000:3.0:1783144356.592154:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501330688 00000100:00100000:3.0:1783144356.592159:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501330688 00000100:00100000:3.0:1783144356.592196:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:3.0:1783144356.592203:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144356.592603:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330688:12345-0@lo:1000:mdt00_002.0 Request processed in 400us (554us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144356.592611:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1783144356.592663:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330688:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.592971:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330816:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144356.593004:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.593024:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.593038:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501330816 00000100:00100000:0.0:1783144356.593043:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501330816 00000100:00100000:0.0:1783144356.593080:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:0.0:1783144356.593087:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783144356.593154:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330816:12345-0@lo:1000:mdt00_002.0 Request processed in 67us (149us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783144356.593161:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:1.0:1783144356.593175:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330816:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144356.593215:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330944:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144356.593240:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.593262:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.593300:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501330944 00000100:00100000:3.0:1783144356.593304:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501330944 00000100:00100000:3.0:1783144356.593342:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:3.0:1783144356.593350:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144356.593435:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501330944:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.593440:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00100000:1.0:1783144356.593476:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501330944:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144356.593510:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501331072:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144356.593527:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.593564:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.593585:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501331072 00000100:00100000:3.0:1783144356.593588:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501331072 00000100:00100000:3.0:1783144356.593608:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1783144356.593614:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501331072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144356.593701:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501331072:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.593709:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:1.0:1783144356.593811:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501331072:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144356.593852:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501331200:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144356.593873:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.593889:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.593910:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501331200 00000100:00100000:0.0:1783144356.593915:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501331200 00000100:00100000:0.0:1783144356.593946:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:0.0:1783144356.593953:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501331200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783144356.594013:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501331200:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144356.594020:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1783144356.594035:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501331200:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144356.594128:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501331328:0@lo:700:mdt00_002.0 00000100:00100000:1.0:1783144356.594157:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.594217:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.594256:0:66122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501331328 00000100:00100000:0.0:1783144356.594260:0:66122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501331328 00000100:00100000:0.0:1783144356.594316:0:66122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783144356.594324:0:66122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501331328:12345-0@lo:700:mdt00_002.0 00000100:00100000:0.0:1783144356.594372:0:66122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501331328:12345-0@lo:700:mdt00_002.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144356.594379:0:66122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783144356.594427:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501331328:0@lo:700:mdt00_002.0 00000040:00080000:3.0:1783144356.594513:0:66114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783144356.594530:0:66114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].27, 64 off34496 00000004:00080000:3.0:1783144356.594538:0:66114:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2ac91f0e40 with version 5 00000040:00080000:3.0:1783144356.594598:0:66114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783144356.594611:0:66114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].28, 64 off34560 00000004:00080000:3.0:1783144356.594623:0:66114:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2ac91f0f00 with version 6 00000004:00080000:0.0:1783144356.595230:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 5 rpc_version 5 00000020:00100000:0.0:1783144356.595248:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783144356.595257:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2aee573800 x1869759501331584/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144356.595279:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501331584:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783144356.595307:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1783144356.595436:0:66114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783144356.595466:0:66114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].14, 64 off33664 00000040:00080000:3.0:1783144356.595741:0:66114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].1, 1000 off33768 00000040:00080000:3.0:1783144356.595811:0:66114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].1, 1152 off33920 00000004:00080000:3.0:1783144356.595816:0:66114:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2ac4d83240 with version 7 00000100:00100000:0.0:1783144356.595873:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144356.595972:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501331584 00000100:00100000:1.0:1783144356.595976:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501331584 00000100:00100000:1.0:1783144356.596040:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:1.0:1783144356.596049:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501331584:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1783144356.603629:0:90830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00000100:00100000:0.0:1783144356.603943:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501331584:12345-0@lo:1000:osp_up0-1.0 Request processed in 7891us (8629us total) trans 111669149699 rc 0/0 00000100:00100000:0.0:1783144356.603956:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000004:00080000:2.0:1783144356.611975:0:75523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149699 committed transno 111669149699 00000100:00100000:2.0:1783144356.611984:0:75523:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149699 gen 3 00000100:00100000:2.0:1783144356.612005:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501331584:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783144356.612030:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 6 rpc_version 6 00000020:00100000:2.0:1783144356.612055:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783144356.612061:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2aeea40e00 x1869759501331840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144356.612080:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501331840:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144356.612138:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.612174:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3738480 going to sleep for 11 seconds 00000100:00100000:3.0:1783144356.612206:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501331840 00000100:00100000:3.0:1783144356.612213:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501331840 00000100:00100000:3.0:1783144356.612271:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:3.0:1783144356.612280:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501331840:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1783144356.616284:0:90830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149700 is committed 00000100:00100000:2.0:1783144356.616430:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501331840:12345-0@lo:1000:osp_up0-1.0 Request processed in 4148us (4288us total) trans 111669149700 rc 0/0 00000100:00100000:2.0:1783144356.616450:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000004:00080000:0.0:1783144356.616456:0:75523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149700 committed transno 111669149700 00000100:00100000:0.0:1783144356.616462:0:75523:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000100:00100000:0.0:1783144356.616484:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501331840:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1783144356.616507:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 7 rpc_version 7 00000020:00100000:0.0:1783144356.616534:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783144356.616542:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2aee572680 x1869759501332096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144356.616564:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501332096:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783144356.616607:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144356.616634:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783144356.616660:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332096 00000100:00100000:2.0:1783144356.616666:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332096 00000100:00100000:2.0:1783144356.616712:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:2.0:1783144356.616745:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501332096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144356.619770:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75523:x1869759501332096:12345-0@lo:1000:osp_up0-1.0 Request processed in 3044us (3156us total) trans 111669149701 rc 0/0 00000100:00100000:2.0:1783144356.619783:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:0.0:1783144356.619825:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501332096:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783144356.619926:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,1 mode: --/PW res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.619941:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.619961:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144356.619979:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033bd1b21 reply state 00000000fc23f1ef transno 81604378735 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.619990:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.619997:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.620000:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144356.620004:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783144356.620009:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00000004:00080000:1.0:1783144356.620016:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783144356.620024:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.620033:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.620040:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.620067:0:66114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783144356.620072:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783144356.620077:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.620085:0:66114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144356.620171:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+8:70770:x1869759481683200:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 36603us (37017us total) trans 81604378735 rc 0/0 00000100:00100000:1.0:1783144356.620179:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1175 00010000:00010000:2.0:1783144356.620244:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144356.620250:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.620257:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516600 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:2.0:1783144356.620261:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144356.620269:0:9525:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.620296:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.620302:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144356.620329:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.620336:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048512 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048519 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144356.620356:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783144356.620364:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144356.620367:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144356.620369:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144356.620373:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501332224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144356.620410:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.620448:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332224 00000100:00100000:1.0:1783144356.620454:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332224 00000100:00100000:1.0:1783144356.620492:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1783144356.620500:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3648:x1869759501332224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144356.620521:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144356.620534:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048519 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048512 expref: 9 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.620545:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca14f700) 00010000:00010000:1.0:1783144356.620552:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144356.620586:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3648:x1869759501332224:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144356.620592:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1783144356.620713:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501332224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144356.631200:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.631275:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481683456 00000100:00100000:1.0:1783144356.631284:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481683456 00000100:00100000:1.0:1783144356.631428:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1176 00000100:00100000:1.0:1783144356.631439:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+8:70779:x1869759481683456:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144356.631456:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144356.631480:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b61 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.631548:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a42304853c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.631569:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a42304853c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.631581:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a42304853c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144356.631622:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144356.631626:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144356.631644:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a42304853c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.631668:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b61 expref: 10 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.631685:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a42304853c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b61 expref: 9 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.631693:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd096c00) 00010000:00010000:1.0:1783144356.631697:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144356.631700:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1518200, rc 0) 00000100:00100000:1.0:1783144356.631809:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481683456:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 372us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144356.631817:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1176 00000100:00100000:0.0:1783144356.633012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.633054:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481683584 00000100:00100000:1.0:1783144356.633060:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481683584 00000100:00100000:1.0:1783144356.633098:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1177 00000100:00100000:1.0:1783144356.633107:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481683584:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144356.633121:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144356.633142:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b68 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.633203:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.633228:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.633242:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.633255:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.633266:0:66143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423048527 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048520 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.633274:0:66143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.633310:0:66143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423048527 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048520 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144356.633326:0:66143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66143:1869759501332352:0@lo:104: 00000100:00100000:1.0:1783144356.633392:0:66143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.633447:0:66143:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.633552:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332352 00000100:00100000:0.0:1783144356.633558:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332352 00000100:00100000:0.0:1783144356.633611:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1783144356.633620:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:66143:x1869759501332352:12345-0@lo:104: 00010000:00010000:0.0:1783144356.633632:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.633705:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783144356.633712:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:66143:x1869759501332352:12345-0@lo:104: Request processed in 94us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144356.633773:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:0.0:1783144356.633802:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144356.633809:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144356.633811:0:66143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66143:1869759501332352:0@lo:104: 00010000:00010000:0.0:1783144356.633824:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:0.0:1783144356.633830:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.633832:0:66143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144356.633851:0:9527:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.633880:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.633887:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144356.633923:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.633931:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517a00/0xad8e53a423048520 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048527 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144356.633945:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501332480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144356.633981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144356.634026:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332480 00000100:00100000:2.0:1783144356.634030:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332480 00010000:00010000:2.0:1783144356.634048:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423048527 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xad8e53a423048520 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144356.634079:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1783144356.634086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3650:x1869759501332480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144356.634095:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144356.634211:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144356.634213:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144356.634215:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783144356.635851:0:90830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149701 is committed 00010000:00010000:2.0:1783144356.636003:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423048527 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048520 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.636018:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2ae00b1000) 00010000:00010000:2.0:1783144356.636023:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.636033:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.636048:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.636107:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144356.636163:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501332480:12345-0@lo:103:ldlm_bl.0 Request processed in 2077us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144356.636171:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00010000:00010000:1.0:1783144356.636216:0:66143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.636224:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144356.636336:0:66143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66143:1869759501332608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783144356.636359:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501332480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144356.636379:0:66143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144356.636407:0:66143:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6d1d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144356.636421:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332608 00000100:00100000:0.0:1783144356.636427:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332608 00000100:00100000:0.0:1783144356.636464:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:0.0:1783144356.636471:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66143:x1869759501332608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783144356.636540:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66143:x1869759501332608:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144356.636547:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1783144356.636591:0:66143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66143:1869759501332608:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1783144356.637937:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048558 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.637952:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048558 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.637963:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048558 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144356.637987:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048558 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638000:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638007:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638014:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638021:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.638025:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638033:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638053:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd096c00) 00010000:00010000:1.0:1783144356.638056:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.638060:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638066:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518800/0xad8e53a42304854a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638079:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638086:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638092:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638097:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.638100:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638106:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638114:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2ae00b1000) 00010000:00010000:1.0:1783144356.638117:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.638120:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638126:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519600/0xad8e53a423048551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638173:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b68 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638186:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048558 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b68 expref: 10 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.638190:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29ca602400) 00010000:00010000:1.0:1783144356.638192:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783144356.638193:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1519a00, rc 0) 00000100:00100000:1.0:1783144356.638242:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+10:70779:x1869759481683584:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 5136us (5231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144356.638249:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1177 00000100:00100000:3.0:1783144356.642598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144356.642626:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481683712 00000100:00100000:3.0:1783144356.642632:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481683712 00000100:00100000:3.0:1783144356.642673:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1178 00000100:00100000:3.0:1783144356.642682:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+8:70779:x1869759481683712:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144356.642706:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144356.642741:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1200/0xad8e53a42304855f lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b6f expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.642793:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0c00/0xad8e53a423048566 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.642802:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0c00/0xad8e53a423048566 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.642810:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0c00/0xad8e53a423048566 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144356.642848:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783144356.642855:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783144356.642883:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1200/0xad8e53a42304855f lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b6f expref: 10 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.642907:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0c00/0xad8e53a423048566 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b6f expref: 9 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.642914:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:3.0:1783144356.642916:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783144356.642918:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0c00, rc 0) 00000100:00100000:3.0:1783144356.642960:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481683712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 280us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.642965:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1178 00000100:00100000:2.0:1783144356.644315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.644364:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481683840 00000100:00100000:1.0:1783144356.644370:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481683840 00000100:00100000:1.0:1783144356.644415:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1179 00000100:00100000:1.0:1783144356.644424:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481683840:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144356.644437:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144356.644449:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519e00/0xad8e53a42304856d lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b76 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644490:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644501:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644510:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644530:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644537:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644543:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644588:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644595:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644605:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644612:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.644616:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644627:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644638:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.644641:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.644645:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644651:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048574 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644668:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644674:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644680:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644685:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.644688:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644694:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644702:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xf7117594 (ffff9c29ca602c00) 00010000:00010000:1.0:1783144356.644705:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.644708:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 2/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644713:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519200/0xad8e53a42304857b lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644759:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519e00/0xad8e53a42304856d lrc: 1/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b76 expref: 10 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644770:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.644772:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.644782:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519e00/0xad8e53a42304856d lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b76 expref: 10 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.644792:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1519e00, rc 0) 00000100:00100000:1.0:1783144356.644839:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481683840:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 416us (527us total) trans 0 rc 301/301 00000100:00100000:1.0:1783144356.644847:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1179 00000100:00100000:3.0:1783144356.645832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.645904:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481683968 00000100:00100000:1.0:1783144356.645909:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481683968 00000100:00100000:1.0:1783144356.645945:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1180 00000100:00100000:1.0:1783144356.645955:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481683968:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144356.645966:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144356.646040:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518e00/0xad8e53a423048582 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b7d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646077:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646087:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646095:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646105:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646112:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646119:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646144:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646151:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646156:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646162:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646167:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.646171:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646177:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646186:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.646188:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.646191:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646197:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a423048589 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646206:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646211:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646222:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646227:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.646230:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646236:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646244:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xf7117594 (ffff9c29ca602f00) 00010000:00010000:1.0:1783144356.646247:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.646249:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646255:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a423048590 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646276:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518e00/0xad8e53a423048582 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b7d expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646284:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.646286:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.646290:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518e00/0xad8e53a423048582 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b7d expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.646299:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1518e00, rc 0) 00000100:00100000:1.0:1783144356.646331:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481683968:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 379us (499us total) trans 0 rc 301/301 00000100:00100000:1.0:1783144356.646356:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1180 00000100:00100000:2.0:1783144356.647574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144356.647605:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481684096 00000100:00100000:3.0:1783144356.647611:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481684096 00000100:00100000:3.0:1783144356.647643:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1181 00000100:00100000:3.0:1783144356.647651:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+9:70779:x1869759481684096:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144356.647661:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144356.647672:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b84 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.647711:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304859e lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.647741:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304859e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.647754:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304859e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144356.647794:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783144356.647798:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144356.647813:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304859e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.647837:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b84 expref: 11 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.647858:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304859e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b84 expref: 10 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144356.647865:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:3.0:1783144356.647868:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783144356.647870:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0800, rc 0) 00000100:00100000:3.0:1783144356.647924:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cace81e7-a6f2-4d37-b197-caf34583781c+10:70779:x1869759481684096:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 273us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.647932:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1181 00000100:00100000:3.0:1783144356.651542:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.652046:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481684352 00000100:00100000:1.0:1783144356.652055:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481684352 00000100:00100000:1.0:1783144356.652113:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1182 00000100:00100000:1.0:1783144356.652125:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+10:70779:x1869759481684352:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144356.652143:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144356.652163:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41b8b expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144356.652249:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783144356.652343:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b8b expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.652357:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29ca602500) 00010000:00010000:1.0:1783144356.652360:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783144356.652366:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b8b expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.652382:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35000, rc 0) 00000100:00100000:1.0:1783144356.652436:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+11:70779:x1869759481684352:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 314us (899us total) trans 81604378736 rc 301/301 00000100:00100000:1.0:1783144356.652443:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1182 00000100:00100000:2.0:1783144356.655397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.655453:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481684608 00000100:00100000:1.0:1783144356.655463:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481684608 00000100:00100000:1.0:1783144356.655516:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1183 00000100:00100000:1.0:1783144356.655528:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+11:70779:x1869759481684608:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1783144356.655598:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144356.655622:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304859e lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b84 expref: 11 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.655637:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.655643:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144356.655693:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.655707:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.655715:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.655762:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,1 mode: --/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.655770:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.655778:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656257:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656266:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656274:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144356.656296:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4cf4895 reply state 0000000077e72d7a transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656308:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656314:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c29ca602f00) 00010000:00010000:1.0:1783144356.656317:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144356.656320:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783144356.656325:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1783144356.656332:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656338:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 2/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656344:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656349:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.656353:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656360:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656367:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.656369:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.656372:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656387:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34e00/0xad8e53a4230485b3 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144356.656397:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4cf4895 reply state 0000000077e72d7a transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656406:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.656411:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xf7117594 (ffff9c29ca602500) 00010000:00010000:1.0:1783144356.656413:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144356.656415:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783144356.656516:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cace81e7-a6f2-4d37-b197-caf34583781c+12:70779:x1869759481684608:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 990us (1127us total) trans 81604378737 rc 0/0 00000100:00100000:1.0:1783144356.656524:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1183 00000100:00100000:2.0:1783144356.658481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144356.658826:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481684864 00000100:00100000:3.0:1783144356.658835:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481684864 00000100:00100000:3.0:1783144356.658974:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:3.0:1783144356.658987:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+12:70779:x1869759481684864:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1783144356.659226:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cace81e7-a6f2-4d37-b197-caf34583781c+13:70779:x1869759481684864:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 242us (748us total) trans 81604378738 rc 0/0 00000100:00100000:3.0:1783144356.659234:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:3.0:1783144356.678831:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144356.679378:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481684992 00000100:00100000:0.0:1783144356.679387:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481684992 00000100:00100000:0.0:1783144356.679439:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 698 00000100:00100000:0.0:1783144356.679448:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481684992:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144356.679462:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144356.679480:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8a00/0xad8e53a423048279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b30 expref: 10 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.679495:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144356.679547:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:2403:x1869759481684992:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 100us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144356.679555:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 698 00000100:00100000:2.0:1783144356.680154:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144356.680289:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481685120 00000100:00100000:1.0:1783144356.680300:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481685120 00000100:00100000:2.0:1783144356.680333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144356.680376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144356.680474:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481685632 00000100:00100000:3.0:1783144356.680480:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481685632 00000100:00100000:3.0:1783144356.680525:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4959 00000100:00100000:3.0:1783144356.680533:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cace81e7-a6f2-4d37-b197-caf34583781c+7:2402:x1869759481685632:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:3.0:1783144356.680569:0:26139:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047ea5 00000100:00080000:2.0:1783144356.680599:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:3.0:1783144356.680617:0:26139:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2af5c4c800: total 0 00000100:00080000:3.0:1783144356.680622:0:26139:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783144356.681059:0:26139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968827 00000100:00100000:3.0:1783144356.682112:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cace81e7-a6f2-4d37-b197-caf34583781c+5:2402:x1869759481685632:12345-192.168.203.4@tcp:9:umount.0 Request processed in 1576us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.682120:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4959 00000100:00100000:1.0:1783144356.682560:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481685248 00000100:00100000:1.0:1783144356.682566:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481685248 00000100:00100000:1.0:1783144356.682618:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 699 00000100:00100000:1.0:1783144356.682628:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+10:2403:x1869759481685120:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144356.682639:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144356.682655:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8000/0xad8e53a423048280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b37 expref: 10 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.682669:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144356.682703:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+9:2403:x1869759481685120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 77us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144356.682741:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 699 00000100:00100000:1.0:1783144356.682857:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 700 00000100:00100000:1.0:1783144356.682864:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+8:2405:x1869759481685248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144356.682872:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144356.682881:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98f600/0xad8e53a423048272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b29 expref: 8 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.682890:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144356.682921:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:2405:x1869759481685248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 57us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144356.682928:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 700 00000020:00010000:1.0:1783144356.683011:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2af5c4c800: total 0 00010000:00010000:1.0:1783144356.683015:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144356.683055:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2af5c4c800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1783144356.683098:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a423047fe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41aff expref: 4 pid: 26141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.683125:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000282468df/0xad8e53a423047ff5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b0d expref: 3 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.683138:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2af5c4c800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1783144356.683150:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144356.683152:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144356.683154:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144356.686843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144356.686927:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481685888 00000100:00100000:3.0:1783144356.686935:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481685888 00000100:00100000:3.0:1783144356.687043:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4960 00000100:00100000:3.0:1783144356.687054:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+6:2402:x1869759481685888:12345-192.168.203.4@tcp:9:umount.0 00000020:00000080:3.0:1783144356.687081:0:26146:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423047d71 00000020:00010000:3.0:1783144356.687087:0:26146:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2af5c48800: total 0 00000100:00080000:3.0:1783144356.687091:0:26146:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4a800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1783144356.687129:0:6508:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2af5c48800: total 0 00000001:00000004:3.0:1783144356.687133:0:26146:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968828 00010000:00010000:0.0:1783144356.687192:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2af5c48800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1783144356.687226:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1783144356.687230:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb atime from disk: 0 -> 1783144327 00002000:00010000:0.0:1783144356.687233:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x702:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1783144356.687255:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423047fee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b06 expref: 6 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.687280:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2af5c48800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783144356.687294:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144356.687297:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144356.687299:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144356.687311:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:cace81e7-a6f2-4d37-b197-caf34583781c+2:2402:x1869759481685888:12345-192.168.203.4@tcp:9:umount.0 Request processed in 258us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144356.687320:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4960 00000100:00080000:2.0:1783144356.687400:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144356.692138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144356.692249:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481686400 00000100:00100000:3.0:1783144356.692256:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481686400 00000100:00100000:3.0:1783144356.692308:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1184 00000100:00100000:3.0:1783144356.692318:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481686400:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:3.0:1783144356.692358:0:66114:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230480f1 00000020:00010000:3.0:1783144356.692382:0:66114:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c29c340a800: total 0 00000100:00080000:3.0:1783144356.692386:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2b017f2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783144356.692403:0:66114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149701 00000020:00010000:2.0:1783144356.692431:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c29c340a800: total 0 00010000:00010000:2.0:1783144356.692490:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c29c340a800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1783144356.692526:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd096c00) 00010000:00010000:2.0:1783144356.692530:0:9525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144356.692537:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a42304853c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b61 expref: 8 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144356.692556:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cace81e7-a6f2-4d37-b197-caf34583781c+7:2402:x1869759481686400:12345-192.168.203.4@tcp:39:umount.0 Request processed in 238us (425us total) trans 111669149702 rc 0/0 00000100:00100000:3.0:1783144356.692562:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1184 00010000:00010000:2.0:1783144356.692567:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:2.0:1783144356.692572:0:9525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144356.692578:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423048504 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b5a expref: 6 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.692605:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29ca602400) 00010000:00010000:2.0:1783144356.692608:0:9525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783144356.692613:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048558 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b68 expref: 5 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.692635:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:2.0:1783144356.692638:0:9525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1783144356.692643:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a4230482db lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41af8 expref: 4 pid: 90861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144356.692662:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c29c340a800, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1783144356.692677:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144356.692679:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144356.692681:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144356.697587:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144356.697657:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481686656 00000100:00100000:2.0:1783144356.697666:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481686656 00000100:00100000:2.0:1783144356.697766:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1185 00000100:00100000:2.0:1783144356.697779:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+13:2402:x1869759481686656:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:2.0:1783144356.697837:0:66947:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423042e6b 00000020:00010000:2.0:1783144356.697850:0:66947:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2af9eca800: total 0 00000100:00080000:2.0:1783144356.697855:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3dab800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783144356.697909:0:66947:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378738 00010000:00010000:1.0:1783144356.697934:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.697946:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.697954:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.697961:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.697966:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.697974:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.697990:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:1.0:1783144356.697993:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.697999:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698005:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518a00/0xad8e53a42304852e lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698042:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698050:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698054:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144356.698061:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cace81e7-a6f2-4d37-b197-caf34583781c+10:2402:x1869759481686656:12345-192.168.203.4@tcp:39:umount.0 Request processed in 284us (480us total) trans 81604378739 rc 0/0 00000100:00100000:2.0:1783144356.698071:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1185 00010000:00010000:1.0:1783144356.698077:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.698082:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698089:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698100:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xf7117594 (ffff9c29ca602500) 00010000:00010000:1.0:1783144356.698103:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144356.698106:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698113:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35000/0xad8e53a4230485ba lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698129:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698136:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698143:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1783144356.698143:0:9527:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2af9eca800: total 0 00010000:00010000:1.0:1783144356.698152:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144356.698154:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698160:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698181:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c29ca602f00) 00010000:00010000:1.0:1783144356.698184:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144356.698185:0:9527:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2af9eca800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783144356.698188:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.698194:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34200/0xad8e53a4230485c1 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.698206:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd096000) 00010000:00010000:0.0:1783144356.698210:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783144356.698214:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0c00/0xad8e53a423048566 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b6f expref: 8 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144356.698227:0:9527:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2af9eca800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783144356.698234:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144356.698235:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144356.698236:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144356.712194:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144356.712256:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481686912 00000100:00100000:2.0:1783144356.712276:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481686912 00000100:00100000:2.0:1783144356.712332:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1783144356.712341:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+7:2402:x1869759481686912:12345-192.168.203.4@tcp:251:umount.0 00000020:00000080:2.0:1783144356.712382:0:90835:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230481a7 00000020:00010000:2.0:1783144356.712389:0:90835:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ad3daf800: total 0 00000100:00080000:2.0:1783144356.712393:0:90835:0:(import.c:65:import_set_state_nolock()) ffff9c2ad3dad000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783144356.712463:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9fffbd4d-6e9f-4786-bbe5-4b99ed941e12+3:2402:x1869759481686912:12345-192.168.203.4@tcp:251:umount.0 Request processed in 123us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144356.712471:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000020:00010000:1.0:1783144356.712634:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ad3daf800: total 0 00010000:00010000:1.0:1783144356.712638:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144356.712686:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ad3daf800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783144356.712717:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0200/0xad8e53a423048287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41b3e expref: 2 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144356.712762:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ad3daf800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783144356.712775:0:6509:0:(genops.c:906:class_export_put()) final put ffff9c2ad3daf800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 00010000:00010000:1.0:1783144356.712796:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144356.712798:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144356.712800:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144356.712882:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad3daf800/9fffbd4d-6e9f-4786-bbe5-4b99ed941e12 for MGS 00000020:00000080:0.0:1783144356.712923:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ad3dad000 for MGS 00010000:00010000:0.0:1783144356.813873:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144357.192371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.192442:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687040 00000100:00100000:2.0:1783144357.192451:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687040 00000100:00100000:2.0:1783144357.192510:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1783144357.192519:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2402:x1869759481687040:12345-192.168.203.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783144357.192541:0:90837:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:2.0:1783144357.192573:0:90837:0:(genops.c:1406:class_connect()) connect: client a1ed6386-b53d-4b75-b3e0-82656a667de7, cookie 0xad8e53a4230485c8 00000100:00080000:2.0:1783144357.192623:0:90837:0:(import.c:65:import_set_state_nolock()) ffff9c29c5773800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144357.192683:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+5:2402:x1869759481687040:12345-192.168.203.4@tcp:250:mount.lustre.0 Request processed in 167us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144357.192688:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:0.0:1783144357.193828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144357.193872:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687168 00000100:00100000:3.0:1783144357.193878:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687168 00000100:00100000:3.0:1783144357.193939:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:3.0:1783144357.193948:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+5:70802:x1869759481687168:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783144357.193958:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144357.193982:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230485cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ba0 expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144357.194018:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230485cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ba0 expref: 6 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144357.194031:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230485cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ba0 expref: 6 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144357.194047:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1c00, rc 0) 00000100:00100000:3.0:1783144357.194082:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70802:x1869759481687168:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 135us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144357.194086:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:0.0:1783144357.195088:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.195127:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687296 00000100:00100000:2.0:1783144357.195132:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687296 00000100:00100000:2.0:1783144357.195172:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1783144357.195182:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70802:x1869759481687296:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783144357.195266:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70802:x1869759481687296:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 79us (174us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144357.195274:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1783144357.196182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144357.196222:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687424 00000100:00100000:3.0:1783144357.196227:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687424 00000100:00100000:3.0:1783144357.196273:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1783144357.196282:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70802:x1869759481687424:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783144357.196298:0:90836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144357.196310:0:90836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230485d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ba7 expref: -99 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144357.196328:0:90836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230485d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ba7 expref: 7 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144357.196338:0:90836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230485d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ba7 expref: 7 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144357.196346:0:90836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1200, rc 0) 00000100:00100000:3.0:1783144357.196381:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+7:70802:x1869759481687424:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144357.196388:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:0.0:1783144357.198954:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.198995:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687552 00000100:00100000:2.0:1783144357.199002:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687552 00000100:00100000:2.0:1783144357.199041:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:2.0:1783144357.199050:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+7:70802:x1869759481687552:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783144357.199177:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70802:x1869759481687552:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 129us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144357.199186:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:0.0:1783144357.200172:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144357.200225:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687680 00000100:00100000:3.0:1783144357.200230:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687680 00000100:00100000:3.0:1783144357.200267:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1783144357.200274:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70802:x1869759481687680:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783144357.200355:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70802:x1869759481687680:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144357.200362:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:1.0:1783144357.201393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.201443:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687808 00000100:00100000:2.0:1783144357.201448:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687808 00000100:00100000:2.0:1783144357.201486:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:2.0:1783144357.201494:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70821:x1869759481687808:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783144357.201584:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70821:x1869759481687808:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 90us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144357.201592:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1783144357.212661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144357.212819:0:90836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481687936 00000100:00100000:3.0:1783144357.212832:0:90836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481687936 00000100:00100000:3.0:1783144357.212910:0:90836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:3.0:1783144357.212921:0:90836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70821:x1869759481687936:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783144357.213103:0:90836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70821:x1869759481687936:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 183us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144357.213119:0:90836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:0.0:1783144357.215668:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.216161:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688064 00000100:00100000:2.0:1783144357.216174:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688064 00000100:00100000:2.0:1783144357.216255:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:2.0:1783144357.216266:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70821:x1869759481688064:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783144357.216414:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70821:x1869759481688064:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 150us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144357.216423:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:1.0:1783144357.218141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144357.218368:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688192 00000100:00100000:0.0:1783144357.218383:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688192 00000100:00100000:0.0:1783144357.218448:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1783144357.218472:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70802:x1869759481688192:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783144357.218491:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144357.218523:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3da00/0xad8e53a4230485dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41bd8 expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144357.218558:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3da00/0xad8e53a4230485dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41bd8 expref: 9 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144357.218571:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3da00/0xad8e53a4230485dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41bd8 expref: 9 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144357.218582:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3da00, rc 0) 00000100:00100000:0.0:1783144357.218649:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70802:x1869759481688192:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 191us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.218666:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1783144357.220554:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.220611:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688320 00000100:00100000:2.0:1783144357.220619:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688320 00000100:00100000:2.0:1783144357.220679:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:2.0:1783144357.220688:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70802:x1869759481688320:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783144357.220757:0:90837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783144357.220774:0:90837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783144357.220778:0:90837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783144357.220781:0:90837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783144357.220784:0:90837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783144357.220786:0:90837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1783144357.221569:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70802:x1869759481688320:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 879us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144357.221578:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:1.0:1783144357.223322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144357.223385:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688448 00000100:00100000:0.0:1783144357.223389:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688448 00000100:00100000:0.0:1783144357.223423:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:0.0:1783144357.223431:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70802:x1869759481688448:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783144357.223502:0:90835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144357.223520:0:90835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3de00/0xad8e53a4230485e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41bdf expref: -99 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144357.223559:0:90835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3de00/0xad8e53a4230485e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41bdf expref: 10 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144357.223571:0:90835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3de00/0xad8e53a4230485e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41bdf expref: 10 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144357.223579:0:90835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3de00, rc 0) 00000100:00100000:0.0:1783144357.223622:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70802:x1869759481688448:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 192us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.223629:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:0.0:1783144357.224587:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144357.224638:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688576 00000100:00100000:1.0:1783144357.224643:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688576 00000100:00100000:1.0:1783144357.224687:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:1.0:1783144357.224703:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70802:x1869759481688576:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783144357.224827:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70802:x1869759481688576:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 125us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144357.224835:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:2.0:1783144357.226210:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144357.226275:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688704 00000100:00100000:0.0:1783144357.226281:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688704 00000100:00100000:0.0:1783144357.226315:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1783144357.226323:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70802:x1869759481688704:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783144357.226439:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70802:x1869759481688704:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 115us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.226447:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:3.0:1783144357.228609:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144357.228683:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688832 00000100:00100000:1.0:1783144357.228690:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688832 00000100:00100000:1.0:1783144357.228766:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:1.0:1783144357.228776:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70826:x1869759481688832:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783144357.228908:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70826:x1869759481688832:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 133us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144357.228915:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 90 00000100:00100000:1.0:1783144357.230389:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144357.230452:0:90835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481688960 00000100:00100000:0.0:1783144357.230459:0:90835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481688960 00000100:00100000:0.0:1783144357.230504:0:90835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:0.0:1783144357.230513:0:90835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70826:x1869759481688960:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783144357.230627:0:90835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70826:x1869759481688960:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.230635:0:90835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:2.0:1783144357.235960:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144357.236059:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689088 00000100:00100000:0.0:1783144357.236069:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689088 00000100:00100000:0.0:1783144357.236115:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1186 00000100:00100000:0.0:1783144357.236123:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481689088:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783144357.236150:0:66112:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:0.0:1783144357.236194:0:66112:0:(genops.c:1406:class_connect()) connect: client 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef, cookie 0xad8e53a4230485eb 00000004:00100000:0.0:1783144357.236216:0:66112:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783144357.236313:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c2aef585800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144357.236446:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481689088:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 322us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.236455:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1186 00000100:00100000:1.0:1783144357.239854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144357.239885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.239921:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689344 00000100:00100000:2.0:1783144357.239929:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689344 00000100:00100000:1.0:1783144357.239932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.239964:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689600 00000100:00100000:2.0:1783144357.239967:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689600 00000100:00080000:1.0:1783144357.240003:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144357.240064:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689216 00000100:00100000:3.0:1783144357.240071:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689216 00000100:00100000:1.0:1783144357.240073:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1187 00000100:00100000:1.0:1783144357.240082:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481689344:12345-192.168.203.4@tcp:38:mount.lustre.0 00000100:00100000:0.0:1783144357.240088:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1188 00000100:00100000:2.0:1783144357.240099:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1189 00000100:00100000:0.0:1783144357.240100:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70802:x1869759481689600:12345-192.168.203.4@tcp:41:mount.lustre.0 00000100:00100000:2.0:1783144357.240108:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:0:x1869759481689216:12345-192.168.203.4@tcp:41:mount.lustre.0 00010000:00080000:1.0:1783144357.240114:0:66143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp t0 exp 0000000000000000 cur 2891 last 0 00000004:00000024:2.0:1783144357.240129:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000004:00000024:0.0:1783144357.240129:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000020:00000080:1.0:1783144357.240169:0:66143:0:(genops.c:1406:class_connect()) connect: client 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef, cookie 0xad8e53a4230485f2 00000004:00100000:1.0:1783144357.240193:0:66143:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783144357.240249:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:0:x1869759481689216:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 141us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.240249:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70802:x1869759481689600:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 150us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.240259:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1188 00000100:00100000:2.0:1783144357.240266:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1189 00000100:00080000:1.0:1783144357.240289:0:66143:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144357.240321:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481689344:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 238us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144357.240328:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1187 00000100:00100000:1.0:1783144357.243101:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144357.243148:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689728 00000100:00100000:3.0:1783144357.243155:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689728 00000100:00100000:3.0:1783144357.243199:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1190 00000100:00100000:3.0:1783144357.243208:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70802:x1869759481689728:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783144357.243311:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70802:x1869759481689728:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144357.243319:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1190 00000100:00100000:2.0:1783144357.244056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144357.244248:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689472 00000100:00100000:0.0:1783144357.244254:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689472 00000100:00100000:0.0:1783144357.244340:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1191 00000100:00100000:0.0:1783144357.244358:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:0:x1869759481689472:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783144357.244381:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1783144357.244444:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:0:x1869759481689472:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 95us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144357.244452:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1191 00000100:00080000:1.0:1783144357.244455:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144357.244697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.244814:0:66123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481690112 00000100:00100000:2.0:1783144357.244818:0:66123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481690112 00000100:00100000:2.0:1783144357.244849:0:66123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1783144357.244856:0:66123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70802:x1869759481690112:12345-192.168.203.4@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783144357.244900:0:66123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70802:x1869759481690112:12345-192.168.203.4@tcp:900:mount.lustre.0 Request processed in 35us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144357.244914:0:66123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1783144357.245828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144357.245867:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481690240 00000100:00100000:2.0:1783144357.245871:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481690240 00000100:00100000:2.0:1783144357.245908:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:2.0:1783144357.245917:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70802:x1869759481690240:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783144357.245980:0:66116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783144357.246018:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70802:x1869759481690240:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 104us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144357.246023:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 227 00000100:00100000:0.0:1783144357.246345:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144357.246381:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689856 00000100:00100000:1.0:1783144357.246386:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689856 00000100:00100000:1.0:1783144357.246410:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4961 00000100:00100000:1.0:1783144357.246417:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2402:x1869759481689856:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783144357.246436:0:26141:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:1.0:1783144357.246472:0:26141:0:(genops.c:1406:class_connect()) connect: client 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef, cookie 0xad8e53a4230485f9 00002000:00100000:1.0:1783144357.246483:0:26141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef/ffff9c2ac752c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783144357.246494:0:26141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783144357.246549:0:26141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783144357.246573:0:26141:0:(import.c:65:import_set_state_nolock()) ffff9c29c443b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144357.246613:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481689856:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 193us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144357.246621:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4961 00000100:00100000:0.0:1783144357.246627:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144357.246648:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481689984 00000100:00100000:1.0:1783144357.246651:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481689984 00000100:00100000:1.0:1783144357.246674:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4962 00000100:00100000:1.0:1783144357.246678:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2402:x1869759481689984:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783144357.246691:0:26141:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp t0 exp 0000000000000000 cur 2891 last 0 00000020:00000080:1.0:1783144357.246707:0:26141:0:(genops.c:1406:class_connect()) connect: client 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef, cookie 0xad8e53a423048600 00002000:00100000:1.0:1783144357.246711:0:26141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef/ffff9c29c443d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783144357.246716:0:26141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783144357.246762:0:26141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783144357.246782:0:26141:0:(import.c:65:import_set_state_nolock()) ffff9c2af9e45800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144357.246807:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481689984:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 128us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144357.246812:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4962 00010000:00010000:2.0:1783144357.838826:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144358.653117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144358.653267:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481690368 00000100:00100000:0.0:1783144358.653277:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481690368 00000100:00100000:0.0:1783144358.653342:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1192 00000100:00100000:0.0:1783144358.653352:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70869:x1869759481690368:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144358.653369:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144358.653390:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048607 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c10 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144358.653460:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a42304860e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144358.653472:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a42304860e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144358.653482:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a42304860e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144358.653522:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783144358.653524:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144358.653538:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a42304860e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144358.653556:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423048607 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 8 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144358.653567:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a42304860e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 7 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144358.653588:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:0.0:1783144358.653590:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783144358.653592:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3dc00, rc 0) 00000100:00100000:0.0:1783144358.653654:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70869:x1869759481690368:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 304us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144358.653660:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1192 00000100:00100000:0.0:1783144358.660042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144358.660980:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481690496 00000100:00100000:2.0:1783144358.660990:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481690496 00000100:00100000:2.0:1783144358.661051:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1193 00000100:00100000:2.0:1783144358.661061:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70869:x1869759481690496:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144358.661099:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783144358.661215:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70869:x1869759481690496:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 155us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144358.661223:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1193 00000100:00100000:3.0:1783144358.668618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144358.668679:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481690624 00000100:00100000:2.0:1783144358.668690:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481690624 00000100:00080000:1.0:1783144358.668766:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144358.668835:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1628 00000100:00100000:2.0:1783144358.668847:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70869:x1869759481690624:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144358.668893:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144358.668969:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70869:x1869759481690624:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 115us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144358.668991:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1628 00000100:00100000:0.0:1783144358.671680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144358.671803:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481690752 00000100:00100000:1.0:1783144358.671810:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481690752 00000100:00100000:1.0:1783144358.671868:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1629 00000100:00100000:1.0:1783144358.671888:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70869:x1869759481690752:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144358.671914:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144358.671966:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70869:x1869759481690752:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144358.671974:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1629 00000100:00080000:2.0:1783144358.673317:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783144358.861816:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144358.925862:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501332736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144358.925941:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144358.925971:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332736 00000100:00100000:2.0:1783144358.925979:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332736 00000100:00100000:1.0:1783144358.925985:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501333248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144358.926012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144358.926410:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501333248 00000100:00100000:2.0:1783144358.926415:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501333248 00000100:00100000:1.0:1783144358.926428:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501333760:0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.926450:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1783144358.926460:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144358.926464:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501332736:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144358.926487:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501334272:0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.926494:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:3.0:1783144358.926504:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501333248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783144358.926505:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000100:00100000:1.0:1783144358.926512:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1783144358.926522:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:1.0:1783144358.926525:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1783144358.926531:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501333120:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.926562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144358.926572:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759501332736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.926578:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501333248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144358.926585:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1783144358.926588:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501333632:0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.926605:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334272 00000100:00100000:2.0:1783144358.926609:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334272 00000100:00100000:1.0:1783144358.927027:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144358.927044:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501334144:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.927061:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144358.927074:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501334656:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.927090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144358.927118:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501333248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144358.927127:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149701 gen 3 00000004:00080000:1.0:1783144358.927132:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149701 committed transno 111669149701 00000100:00100000:3.0:1783144358.927172:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:1.0:1783144358.927173:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501332736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144358.927194:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:2.0:1783144358.927207:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501334272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.927207:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501332864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144358.927246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144358.927269:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501333376:0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.927276:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501334272:12345-0@lo:400:kworker.0 Request processed in 71us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144358.927284:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1783144358.927297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144358.927322:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501333888:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.927344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144358.927363:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501334400:0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.927371:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501333888 00000100:00100000:2.0:1783144358.927376:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501333888 00000100:00100000:1.0:1783144358.927386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144358.927394:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501333760 00000100:00100000:3.0:1783144358.927398:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501333760 00000100:00100000:1.0:1783144358.927409:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1783144358.927415:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501332992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144358.927422:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334400 00000100:00100000:2.0:1783144358.927427:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334400 00000100:00100000:3.0:1783144358.927433:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501333632 00000100:00100000:3.0:1783144358.927438:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501333632 00000100:00100000:1.0:1783144358.927439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144358.927459:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501333504:0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.927461:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:3.0:1783144358.927462:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334144 00000100:00100000:3.0:1783144358.927466:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334144 00000100:00100000:2.0:1783144358.927474:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501333888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927481:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334656 00000100:00100000:3.0:1783144358.927486:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334656 00000100:00100000:1.0:1783144358.927487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144358.927499:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501333376 00000100:00100000:1.0:1783144358.927500:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501334016:0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927501:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501333376 00000100:00100000:2.0:1783144358.927514:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501333888:12345-0@lo:400:kworker.0 Request processed in 44us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.927517:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501333504 00000100:00100000:3.0:1783144358.927529:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501333504 00000100:00100000:1.0:1783144358.927533:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144358.927534:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:3.0:1783144358.927551:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:1.0:1783144358.927555:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501334528:0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927558:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501333760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.927572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144358.927586:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501333760:12345-0@lo:400:kworker.0 Request processed in 29us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.927592:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1783144358.927605:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1783144358.927610:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501333632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927633:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501333632:12345-0@lo:400:kworker.0 Request processed in 23us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.927638:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1783144358.927648:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1783144358.927653:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927677:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501334144:12345-0@lo:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.927683:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1783144358.927694:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1783144358.927699:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501334656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927738:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501334656:12345-0@lo:400:kworker.0 Request processed in 38us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.927743:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1783144358.927754:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1783144358.927760:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501333376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927784:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501333376:12345-0@lo:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.927797:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1783144358.927808:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1783144358.927813:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501333504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.927842:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501333504:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.927848:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:2.0:1783144358.927895:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334016 00000100:00100000:2.0:1783144358.927900:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334016 00000100:00100000:2.0:1783144358.927932:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1783144358.927940:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501334400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.927975:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501334400:12345-0@lo:400:kworker.0 Request processed in 35us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144358.927982:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1783144358.927994:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:2.0:1783144358.928000:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501334016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.928029:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501334016:12345-0@lo:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144358.928035:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00080000:2.0:1783144358.928049:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144358.928052:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783144358.928054:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144358.928055:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144358.929979:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501333376:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.929992:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501333888:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930001:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968828 gen 2 00000100:00100000:1.0:1783144358.930013:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501334400:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930031:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501333504:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930041:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501334016:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930072:0:90837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501333120 00000100:00100000:1.0:1783144358.930076:0:90837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501333120 00000100:00100000:1.0:1783144358.930116:0:90837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783144358.930123:0:90837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501333120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930165:0:90837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501333120:12345-0@lo:400:kworker.0 Request processed in 42us (3603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144358.930171:0:90837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783144358.930208:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332864 00000100:00100000:1.0:1783144358.930211:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332864 00000100:00100000:1.0:1783144358.930233:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501332992 00000100:00100000:1.0:1783144358.930235:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501332992 00000100:00080000:2.0:1783144358.930269:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144358.930273:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:1.0:1783144358.930280:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501332864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144358.930293:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144358.930336:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501332864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (3089us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144358.930348:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:1.0:1783144358.930361:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:1.0:1783144358.930367:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501332992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144358.930377:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334528 00002000:00000024:1.0:1783144358.930377:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144358.930381:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334528 00000100:00100000:1.0:1783144358.930404:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501332992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.930406:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1783144358.930410:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:3.0:1783144358.930412:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501334528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144358.930443:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501334528:12345-0@lo:400:kworker.0 Request processed in 31us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144358.930449:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1783144358.930457:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501333120:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930469:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501333632:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930480:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501334144:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930490:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501334656:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930501:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501333760:0@lo:400:kworker.0 00000100:00100000:1.0:1783144358.930510:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501334272:0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.930568:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968827 gen 2 00000100:00100000:2.0:1783144358.930581:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501332992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144358.930588:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501334528:0@lo:400:kworker.0 00000100:00100000:2.0:1783144358.930596:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501332864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144359.093948:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144359.094028:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481690880 00000100:00100000:2.0:1783144359.094038:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481690880 00000100:00100000:2.0:1783144359.094141:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1194 00000100:00100000:2.0:1783144359.094158:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70903:x1869759481690880:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:2.0:1783144359.094198:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144359.094220:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c17 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094280:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094294:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094305:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094318:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094325:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094331:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094381:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a42304862a lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094387:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a42304862a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094393:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a42304862a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144359.094426:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a42304862a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094444:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094450:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094456:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094462:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094467:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144359.094471:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094478:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094488:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2af71e9e00) 00010000:00010000:2.0:1783144359.094492:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144359.094496:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094502:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516800/0xad8e53a42304861c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094513:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094519:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094530:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094535:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144359.094538:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094545:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094553:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c29cd29e700) 00010000:00010000:2.0:1783144359.094556:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144359.094559:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094565:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517800/0xad8e53a423048623 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094594:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c17 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094607:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a42304862a lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c17 expref: 8 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.094614:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e300) 00010000:00010000:2.0:1783144359.094616:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783144359.094619:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516a00, rc 0) 00000100:00100000:2.0:1783144359.094681:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481690880:12345-192.168.203.4@tcp:101:cp.0 Request processed in 530us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144359.094698:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1194 00000100:00080000:3.0:1783144359.094943:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144359.098381:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144359.098434:0:66124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691008 00000100:00100000:2.0:1783144359.098443:0:66124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691008 00000100:00100000:2.0:1783144359.098505:0:66124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00080000:3.0:1783144359.098511:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144359.098517:0:66124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0154ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70903:x1869759481691008:12345-192.168.203.4@tcp:900:cp.0 00000100:00100000:2.0:1783144359.098595:0:66124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0154ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70903:x1869759481691008:12345-192.168.203.4@tcp:900:cp.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144359.098602:0:66124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1783144359.102990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144359.103030:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691136 00000100:00100000:2.0:1783144359.103038:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691136 00000100:00100000:2.0:1783144359.103097:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1195 00000100:00100000:2.0:1783144359.103108:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70903:x1869759481691136:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:2.0:1783144359.103126:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144359.103148:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517200/0xad8e53a423048631 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c1e expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.103205:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517000/0xad8e53a423048638 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.103217:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517000/0xad8e53a423048638 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.103228:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517000/0xad8e53a423048638 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144359.103271:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783144359.103275:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783144359.103320:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517200/0xad8e53a423048631 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c1e expref: 8 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.103342:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517000/0xad8e53a423048638 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c1e expref: 7 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144359.103350:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144359.103353:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1783144359.103356:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517000, rc 0) 00000100:00100000:2.0:1783144359.103409:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70903:x1869759481691136:12345-192.168.203.4@tcp:101:cp.0 Request processed in 303us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144359.103416:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1195 00000100:00100000:3.0:1783144359.106214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144359.106317:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691264 00000100:00100000:1.0:1783144359.106325:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691264 00000100:00100000:3.0:1783144359.106489:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1196 00000100:00100000:3.0:1783144359.106503:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70903:x1869759481691264:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:3.0:1783144359.106523:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144359.106540:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1800/0xad8e53a42304863f lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c25 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106600:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106620:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106631:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106647:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106655:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106661:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106770:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0000/0xad8e53a423048654 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106780:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0000/0xad8e53a423048654 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106788:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0000/0xad8e53a423048654 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144359.106822:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1783144359.106825:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144359.106847:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0000/0xad8e53a423048654 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106859:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106886:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106894:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106900:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144359.106904:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106912:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106924:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:3.0:1783144359.106928:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144359.106933:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106939:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048646 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106950:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106956:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106962:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.106967:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144359.106977:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.107166:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.107176:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xf7117594 (ffff9c2ac3bccd00) 00010000:00010000:3.0:1783144359.107179:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144359.107183:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 2/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.107189:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0600/0xad8e53a42304864d lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.107222:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1800/0xad8e53a42304863f lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c25 expref: 9 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.107235:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0000/0xad8e53a423048654 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c25 expref: 8 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.107242:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:3.0:1783144359.107244:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783144359.107247:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0000, rc 0) 00000100:00100000:3.0:1783144359.107310:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481691264:12345-192.168.203.4@tcp:101:cp.0 Request processed in 810us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144359.107318:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1196 00000100:00100000:3.0:1783144359.108712:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144359.108895:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691392 00000100:00100000:1.0:1783144359.108902:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691392 00000100:00100000:1.0:1783144359.108943:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1197 00000100:00100000:1.0:1783144359.108951:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481691392:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:1.0:1783144359.109041:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144359.109055:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35200/0xad8e53a42304865b lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c2c expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109103:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109112:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109118:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109128:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109132:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109137:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109161:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109164:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109168:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109173:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109176:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144359.109183:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109187:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109195:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:1.0:1783144359.109197:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144359.109199:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109203:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f34c00/0xad8e53a423048662 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109212:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109216:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109219:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109222:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144359.109223:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109226:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109230:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xb1bed465 (ffff9c29ca602f00) 00010000:00010000:1.0:1783144359.109232:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144359.109238:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109242:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35a00/0xad8e53a423048669 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109265:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35200/0xad8e53a42304865b lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c2c expref: 9 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109271:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:1.0:1783144359.109273:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144359.109275:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af6f35200/0xad8e53a42304865b lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c2c expref: 9 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144359.109281:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35200, rc 0) 00000100:00100000:1.0:1783144359.109545:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481691392:12345-192.168.203.4@tcp:101:cp.0 Request processed in 593us (834us total) trans 0 rc 301/301 00000100:00100000:1.0:1783144359.109552:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1197 00000100:00100000:1.0:1783144359.112134:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144359.112291:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691520 00000100:00100000:3.0:1783144359.112299:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691520 00000100:00100000:3.0:1783144359.112357:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1198 00000100:00100000:3.0:1783144359.112376:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481691520:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:3.0:1783144359.112396:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144359.112415:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0a00/0xad8e53a423048670 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c33 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112483:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112496:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112507:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112523:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112531:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112539:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112583:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112591:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112598:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112615:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144359.112619:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112627:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112638:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:3.0:1783144359.112641:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144359.112645:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112653:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048677 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112663:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112669:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112676:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112681:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144359.112684:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112690:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112710:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xb1bed465 (ffff9c2ac3bcc700) 00010000:00010000:3.0:1783144359.112712:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144359.112715:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112828:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1a00/0xad8e53a42304867e lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112872:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0a00/0xad8e53a423048670 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c33 expref: 9 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112892:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:3.0:1783144359.112895:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144359.112899:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0a00/0xad8e53a423048670 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c33 expref: 9 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144359.112909:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0a00, rc 0) 00000100:00100000:3.0:1783144359.112966:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481691520:12345-192.168.203.4@tcp:101:cp.0 Request processed in 589us (836us total) trans 0 rc 301/301 00000100:00100000:3.0:1783144359.112974:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1198 00000100:00100000:3.0:1783144359.114326:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144359.114404:0:66121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691648 00000100:00100000:2.0:1783144359.114410:0:66121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691648 00000100:00100000:2.0:1783144359.114503:0:66121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1783144359.114513:0:66121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481691648:12345-192.168.203.4@tcp:700:cp.0 00000020:02000000:2.0:1783144359.114524:0:66121:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:2.0:1783144359.119500:0:66121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481691648:12345-192.168.203.4@tcp:700:cp.0 Request processed in 4982us (5171us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144359.119515:0:66121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00010000:00010000:1.0:1783144359.886231:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783144360.900872:0:91846:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783144360.900936:0:91846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.900951:0:91846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.900958:0:91846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.900984:0:91846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.901015:0:91846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783144360.901021:0:91846:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783144360.901056:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144360.901061:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783144360.901068:0:91846:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783144360.901094:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783144360.901158:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783144360.901160:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501334784:0@lo:39:umount.0 00010000:00010000:0.0:1783144360.901168:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.901177:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fa00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144360.901181:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.901190:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144360.901197:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144360.901203:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783144360.901206:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783144360.901209:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1783144360.901220:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783144360.901234:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.901251:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144360.901271:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.901278:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fa00/0xad8e53a423048184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304818b expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.901289:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144360.901291:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144360.901294:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144360.901304:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501334912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144360.901328:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144360.901516:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334912 00000100:00100000:0.0:1783144360.901523:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334912 00000100:00100000:0.0:1783144360.901572:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1783144360.901582:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501334912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144360.901594:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144360.901607:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3d600/0xad8e53a42304818b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048184 expref: 24 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.901618:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144360.901663:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3651:x1869759501334912:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144360.901671:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501334784 00000100:00100000:0.0:1783144360.901671:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1783144360.901678:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501334784 00000100:00100000:1.0:1783144360.901697:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501334912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144360.901749:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1783144360.901759:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501334784:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783144360.901780:0:66947:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230482a3 00000100:00080000:3.0:1783144360.901788:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2af5ddc800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783144360.901807:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144360.901851:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1869759501334784:12345-0@lo:39:umount.0 Request processed in 94us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144360.901859:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000020:00000080:3.0:1783144360.901880:0:66947:0:(genops.c:906:class_export_put()) final put ffff9c2af5ddc000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1783144360.901882:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783144360.901930:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501334784:0@lo:39:umount.0 00000100:00080000:1.0:1783144360.901966:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144360.901969:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783144360.901973:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144360.901987:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5ddc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144360.902033:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5ddc800 for lustre-MDT0000 00010000:00010000:1.0:1783144360.903373:0:91846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903387:0:91846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903393:0:91846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903399:0:91846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903431:0:91846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144360.903438:0:91846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903444:0:91846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903449:0:91846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903454:0:91846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903653:0:91846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783144360.903662:0:91846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903669:0:91846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903675:0:91846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903680:0:91846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903701:0:91846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783144360.903707:0:91846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.903764:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783144360.903771:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.903790:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144360.903807:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144360.903815:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144360.903817:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144360.903822:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144360.903827:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144360.903843:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144360.903846:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c400 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:1.0:1783144360.903847:0:91846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144360.903847:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:00010000:2.0:1783144360.903852:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903856:0:91846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144360.903859:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903873:0:91846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144360.903875:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144360.903881:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783144360.903884:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783144360.903886:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783144360.903886:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.903888:0:91846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783144360.903893:0:91846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1783144360.903898:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1783144360.903899:0:91846:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1783144360.903905:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144360.903912:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144360.903924:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144360.903930:0:91846:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1783144360.903932:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1783144360.903935:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:2.0:1783144360.903938:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c400/0xad8e53a4230481ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230481b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783144360.903939:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1783144360.903944:0:91846:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1783144360.903952:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144360.903956:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144360.903958:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144360.903964:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:3.0:1783144360.903966:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144360.903968:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144360.903975:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9200 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:3.0:1783144360.903980:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144360.903988:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144360.903991:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144360.904005:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144360.904007:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144360.904012:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783144360.904014:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783144360.904016:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783144360.904033:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144360.904038:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144360.904057:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144360.904064:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a4230480a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230480ab expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144360.904079:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783144360.904082:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783144360.904087:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783144360.904099:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144360.904101:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144360.904103:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144360.904107:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144360.904113:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1783144360.904115:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144360.904125:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144360.904131:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501335424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144360.904135:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a423048176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304817d expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144360.904148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144360.904150:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144360.904153:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144360.904161:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144360.904179:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144360.904220:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501335296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144360.904237:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144360.904265:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335424 00000100:00100000:3.0:1783144360.904270:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335424 00000100:00100000:3.0:1783144360.904304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335296 00000100:00100000:3.0:1783144360.904307:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335296 00000100:00100000:3.0:1783144360.904329:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1783144360.904338:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501335424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144360.904349:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144360.904357:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00010000:00010000:3.0:1783144360.904369:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98ea00/0xad8e53a42304817d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048176 expref: 24 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144360.904370:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501335296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144360.904385:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144360.904387:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144360.904397:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98f800/0xad8e53a4230480ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230480a4 expref: 23 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144360.904421:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144360.904426:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3651:x1869759501335424:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144360.904435:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1783144360.904460:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3651:x1869759501335296:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144360.904468:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1783144360.904474:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501335424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144360.904486:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501335296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144360.904537:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a4230480b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230480b9 expref: -99 pid: 90829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.904547:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144360.904549:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144360.904550:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144360.904561:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501335040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144360.904589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144360.904612:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144360.904617:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501335168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144360.904642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144360.904674:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335040 00000100:00100000:0.0:1783144360.904678:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335040 00000100:00100000:0.0:1783144360.904699:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335168 00000100:00100000:0.0:1783144360.904702:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335168 00000100:00100000:0.0:1783144360.904716:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1783144360.904744:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3648:x1869759501335040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144360.904752:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144360.904762:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3d800/0xad8e53a4230480b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230480b2 expref: 22 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.904771:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144360.904773:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1783144360.904785:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3648:x1869759501335168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144360.904796:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783144360.904800:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3648:x1869759501335040:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144360.904808:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98e800/0xad8e53a4230481b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230481ae expref: 21 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144360.904809:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00010000:00010000:2.0:1783144360.904823:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144360.904839:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501335040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144360.904860:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3648:x1869759501335168:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144360.904862:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501335168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144360.904885:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000004:00000080:1.0:1783144360.907033:0:91846:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00100000:0.0:1783144360.909345:0:90830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00100000:0.0:1783144360.909355:0:90830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00080000:0.0:1783144360.909362:0:90830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149702 is committed 00000020:00000080:0.0:1783144360.909367:0:90830:0:(genops.c:906:class_export_put()) final put ffff9c29c340a800/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:3.0:1783144360.909474:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c340a800/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-MDT0000 00000020:00000080:3.0:1783144360.909552:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2b017f2800 for lustre-MDT0000 00010000:00010000:3.0:1783144360.909832:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783144360.909906:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1783144360.909915:0:91846:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aef583800 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 192.168.203.4@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144360.909922:0:91846:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2add5f2800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144360.909926:0:91846:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c29c496e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144360.909931:0:91846:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2af7288800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144360.909935:0:91846:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c29c340c800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 111669149701 stale:0 00000020:00080000:1.0:1783144360.909940:0:91846:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c29c31e4d40) has exports, disconnecting them 00000020:00080000:1.0:1783144360.909944:0:91846:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.4@tcp (ffff9c2aef583800), last request at 1783144359 00000020:00000080:1.0:1783144360.909952:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230485eb 00000020:00010000:1.0:1783144360.909967:0:91846:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2aef583800: total 0 00000100:00080000:1.0:1783144360.909972:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2aef585800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144360.909987:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2aef583800): rc 0 00000020:00080000:1.0:1783144360.909991:0:91846:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2add5f2800), last request at 1783144348 00000020:00000080:1.0:1783144360.909994:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304829c 00000100:00080000:1.0:1783144360.909997:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da3800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144360.910051:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2add5f2800): rc 0 00000020:00000080:1.0:1783144360.910053:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2add5f2800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1783144360.910067:0:91846:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c29c496e000), last request at 1783144358 00000020:00000080:1.0:1783144360.910070:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048295 00000100:00080000:1.0:1783144360.910074:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c29c496f000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1783144360.910095:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2aef583800: total 1 00000020:00000080:0.0:1783144360.910203:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2add5f2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144360.910239:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af9da3800 for lustre-MDT0000 00010000:00010000:3.0:1783144360.910285:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2aef583800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783144360.910321:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a42304860e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 3 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144360.910348:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a42304862a lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c17 expref: 2 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144360.910364:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2aef583800, canceled 2 locks, left on hash table 0. 00000020:00080000:1.0:1783144360.912690:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c496e000): rc 0 00000020:00000080:1.0:1783144360.912695:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c29c496e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783144360.912709:0:91846:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2af7288800), last request at 1783144358 00000020:00000080:1.0:1783144360.912715:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304828e 00000100:00080000:1.0:1783144360.912739:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2add5f5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144360.912775:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2af7288800): rc 0 00000020:00000080:1.0:1783144360.912777:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2af7288800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1783144360.912781:0:91846:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c29c340c800), last request at 1783144343 00000020:00000080:1.0:1783144360.912784:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230480f8 00000100:00080000:1.0:1783144360.912792:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c29c4969800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144360.912797:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c340c800): rc 0 00000020:00000080:1.0:1783144360.912799:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c29c340c800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1783144360.912805:0:91846:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc1628168fae0 00000100:00080000:1.0:1783144360.912822:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783144360.912825:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1783144360.913074:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144360.913594:0:91846:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783144360.913614:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2af728f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:1.0:1783144360.915065:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c496e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1783144360.915233:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144360.915266:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501335552:0@lo:39:umount.0 00000100:00100000:2.0:1783144360.915340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1783144360.915420:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af7288800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783144360.915453:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c340c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783144360.915477:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c496f000 for lustre-MDT0000 00000020:00000080:1.0:1783144360.915481:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2add5f5000 for lustre-MDT0000 00000020:00000080:1.0:1783144360.915484:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c4969800 for lustre-MDT0000 00000100:00080000:1.0:1783144360.915539:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783144360.915543:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968828 gen 3 00010000:00010000:2.0:1783144360.915791:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783144360.915827:0:91846:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783144360.915891:0:91846:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783144360.915908:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b29800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783144360.915956:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501335680:0@lo:9:umount.0 00000100:00100000:2.0:1783144360.915986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144360.916026:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783144360.916030:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968827 gen 3 00000004:00080000:1.0:1783144360.916044:0:91846:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144360.916052:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335680 00000100:00100000:0.0:1783144360.916065:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335680 00000100:00080000:1.0:1783144360.916110:0:91846:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783144360.916124:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b24800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783144360.916154:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4963 00000100:00100000:0.0:1783144360.916184:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501335680:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783144360.916222:0:26152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048153 00000100:00080000:0.0:1783144360.916232:0:26152:0:(import.c:65:import_set_state_nolock()) ffff9c2ac4df1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783144360.916289:0:26152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968828 00000100:00100000:2.0:1783144360.916338:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501335808:0@lo:9:umount.0 00000100:00100000:2.0:1783144360.916369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144360.916503:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501335680:12345-0@lo:9:umount.0 Request processed in 323us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144360.916510:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4963 00000100:00100000:2.0:1783144360.916573:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335808 00000100:00100000:2.0:1783144360.916583:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335808 00010000:00010000:0.0:1783144360.916583:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144360.916635:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4964 00000100:00100000:2.0:1783144360.916646:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501335808:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783144360.916679:0:8438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048161 00000100:00080000:2.0:1783144360.916687:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b26800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783144360.916738:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968827 00000100:00080000:0.0:1783144360.916812:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b29800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783144360.916826:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783144360.916828:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144360.916833:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501335680:0@lo:9:umount.0 00010000:00010000:0.0:1783144360.916882:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144360.917091:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501335808:12345-0@lo:9:umount.0 Request processed in 446us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144360.917100:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4964 00000100:00080000:0.0:1783144360.917258:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ae4b24800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783144360.917266:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783144360.917271:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144360.917275:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501335808:0@lo:9:umount.0 00000020:00080000:1.0:1783144360.917374:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c29c31e4d40) has no exports 00000020:00080000:1.0:1783144360.917845:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c29c31e4d40) has no exports 00000100:00100000:0.0:1783144360.917969:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335552 00000100:00100000:0.0:1783144360.917977:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335552 00000100:00100000:0.0:1783144360.918025:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:0.0:1783144360.918034:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501335552:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783144360.918089:0:23926:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048137 00000100:00080000:0.0:1783144360.918095:0:23926:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783144360.918116:0:23926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378739 00010000:00010000:2.0:1783144360.918127:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144360.918249:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1869759501335552:12345-0@lo:39:umount.0 Request processed in 215us (2908us total) trans 81604378740 rc 0/0 00000100:00100000:0.0:1783144360.918260:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00080000:2.0:1783144360.918301:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af728f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783144360.918310:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501335552:0@lo:39:umount.0 00000100:00080000:2.0:1783144360.918772:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144360.918785:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1783144360.935120:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c2aef583800/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000020:00000080:0.0:1783144360.935302:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aef583800/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef for lustre-MDT0000 00010000:00010000:2.0:1783144360.935337:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144360.935341:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144360.935344:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144360.935429:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aef585800 for lustre-MDT0000 00000020:00000080:1.0:1783144360.954450:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304810d 00000020:00000080:1.0:1783144360.954467:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c29c6cde000/lustre-QMT0000_UUID 00000020:01000000:1.0:1783144360.954484:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783144360.954581:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c6cde000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783144360.954600:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144360.954610:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783144360.954612:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c2af9f14d40) has no exports 00000020:00000080:0.0:1783144360.955582:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048106 00000020:00000080:0.0:1783144360.955588:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2afab22800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144360.955631:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afab22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783144360.955650:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144360.955659:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783144360.955662:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d65000/lustre-QMT0000_UUID 00000020:00000080:0.0:1783144360.955664:0:91846:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d65000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783144360.955669:0:91846:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783144360.955993:0:91846:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2ad08c3c00 - data ffff9c2afa757af8/ffff9c2afa1f0400 00000020:01000000:2.0:1783144360.956130:0:91846:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af7999b40 - data ffff9c29c1dd9798/ffff9c2ad4c49c00 00000100:00080000:2.0:1783144360.988561:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783144360.988569:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783144360.988582:0:91846:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2affdb6680 x1869759501335552/t81604378740(81604378740) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144370 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144360.988606:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783144360.990034:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783144360.990038:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968828 gen 4 00000004:00080000:2.0:1783144360.990081:0:91846:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144360.990083:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783144360.990394:0:90846:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783144360.990398:0:90846:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:1.0:1783144360.990407:0:90846:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:2.0:1783144360.990909:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783144360.990913:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968827 gen 4 00000004:00080000:2.0:1783144360.991018:0:91846:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144360.991030:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783144360.991482:0:90848:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783144360.991486:0:90848:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:0.0:1783144360.991495:0:90848:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:2.0:1783144360.992508:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230480c7 00000020:00000080:2.0:1783144360.992517:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2af728b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144360.992717:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783144360.993355:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230480dc 00000020:00000080:2.0:1783144360.993361:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c29c3408800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783144360.993408:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783144360.993414:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144360.993424:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783144360.993427:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c29c31e3380) has no exports 00000004:01000000:2.0:1783144360.993615:0:91846:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783144360.993623:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304815a 00000020:00000080:2.0:1783144360.993627:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2afcbbc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144360.993677:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c3408800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783144360.993827:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783144360.993831:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144360.993840:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783144360.993843:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c2af9c7cd40) has no exports 00000020:00000080:2.0:1783144360.993850:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304814c 00000020:00000080:2.0:1783144360.993855:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2aee190800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144360.993894:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afcbbc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1783144360.994449:0:91846:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783144360.994458:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783144360.994462:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968827 gen 5 00000004:00080000:2.0:1783144360.994467:0:91846:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144360.994469:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144360.994498:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee190800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783144360.994580:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144360.994589:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144360.994595:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304813e 00000020:00000080:2.0:1783144360.994599:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ac6d96000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144360.994623:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ae4b24800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783144360.994639:0:52153:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b2f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144360.994642:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783144360.994650:0:52153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783144360.994844:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783144360.994848:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144360.994854:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783144360.994857:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c2af9f10000) has no exports 00000020:00000080:2.0:1783144360.994871:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048130 00000020:00000080:2.0:1783144360.994875:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b2a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144360.994905:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac6d96000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1783144360.995379:0:91846:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783144360.995383:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783144360.995385:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968828 gen 5 00000004:00080000:2.0:1783144360.995388:0:91846:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783144360.995389:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144360.995411:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b2a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783144360.995489:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144360.995496:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1783144360.995506:0:91846:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783144360.995511:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048122 00000020:00000080:2.0:1783144360.995516:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2aee191000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144360.995537:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ae4b29800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783144360.995543:0:52153:0:(genops.c:906:class_export_put()) final put ffff9c2aee197000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144360.995545:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee197000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783144360.995550:0:52153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783144360.995680:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1783144360.995684:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144360.995691:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783144360.995694:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c2ad08db380) has no exports 00000020:00000080:2.0:1783144360.995698:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304811b 00000020:00000080:2.0:1783144360.995702:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2af728b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144360.995776:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee191000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783144360.997038:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144360.997816:0:91846:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783144360.997820:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144360.997823:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783144360.997827:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144360.997900:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144360.997909:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144360.997932:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144360.997936:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144360.997949:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2af728e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144360.997952:0:91846:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783144360.997957:0:91846:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144360.998051:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230480e3 00000020:00000080:0.0:1783144360.998059:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c29c3408000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783144360.998175:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af728f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783144360.998180:0:52153:0:(genops.c:906:class_export_put()) final put ffff9c2aee193800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144360.998183:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aee193800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783144360.998187:0:52153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783144360.998285:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783144360.998290:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144360.998299:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783144360.998310:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c29c31e0000) has no exports 00000020:00000080:0.0:1783144360.998330:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144360.998334:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783144360.998337:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230480ea 00000020:00000080:0.0:1783144360.998341:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c29c340c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144360.998881:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c3408000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783144360.998887:0:52153:0:(genops.c:906:class_export_put()) final put ffff9c2affdd8000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783144360.998889:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2affdd8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783144360.998895:0:52153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1783144360.998913:0:91846:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aefa79000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783144360.998916:0:91846:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefa79000 3 00000020:01000004:0.0:1783144360.998919:0:91846:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2aefa79000 from lustre-MDT0000 00000020:00000080:1.0:1783144360.998932:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c340c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783144360.998996:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144360.999002:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783144360.999005:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2af728e000/lustre-MDT0000_UUID 00000020:00000080:0.0:1783144360.999008:0:91846:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af728e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783144360.999014:0:91846:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783144360.999052:0:91846:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783144360.999055:0:91846:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783144360.999058:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783144360.999061:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144360.999065:0:91846:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783144360.999073:0:91846:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c29c5774800 a1ed6386-b53d-4b75-b3e0-82656a667de7 192.168.203.4@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144360.999080:0:91846:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2ac5d54000 4e9e4714-8000-4c64-bed6-3cadd5fdfc80 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144360.999085:0:91846:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9c2aee590000) has exports, disconnecting them 00000020:00080000:0.0:1783144360.999090:0:91846:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.4@tcp (ffff9c29c5774800), last request at 1783144357 00000020:00000080:0.0:1783144360.999105:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230485c8 00000020:00010000:0.0:1783144360.999110:0:91846:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c29c5774800: total 0 00000100:00080000:0.0:1783144360.999114:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c29c5773800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144360.999125:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c29c5774800): rc 0 00000020:00080000:0.0:1783144360.999139:0:91846:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2ac5d54000), last request at 1783144343 00000020:00000080:0.0:1783144360.999148:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048088 00000020:00010000:0.0:1783144360.999152:0:91846:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ac5d54000: total 0 00000100:00080000:0.0:1783144360.999154:0:91846:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d52000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144360.999163:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac5d54000): rc 0 00000020:00010000:1.0:1783144360.999173:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c29c5774800: total 0 00000020:00080000:0.0:1783144360.999174:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9c2aee590000) has no exports 00000020:00010000:0.0:1783144360.999182:0:9527:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ac5d54000: total 0 00010000:00010000:1.0:1783144360.999199:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c29c5774800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1783144360.999201:0:9527:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ac5d54000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783144360.999227:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98f000/0xad8e53a423048241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304823a expref: 14 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999245:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47cc00/0xad8e53a4230481d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230481ca expref: 13 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.999351:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230485cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ba0 expref: 5 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999352:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47dc00/0xad8e53a423048233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304822c expref: 12 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999365:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98fc00/0xad8e53a4230481c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230481bc expref: 11 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999377:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8200/0xad8e53a42304824f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048248 expref: 10 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999387:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47d200/0xad8e53a4230481df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230481d8 expref: 9 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999397:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c800/0xad8e53a42304825d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048256 expref: 8 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999412:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98e200/0xad8e53a4230481ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230481e6 expref: 7 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999432:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98f200/0xad8e53a42304826b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048264 expref: 6 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.999443:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3de00/0xad8e53a4230485e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41bdf expref: 4 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999444:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98e400/0xad8e53a4230481fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230481f4 expref: 5 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999462:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe9600/0xad8e53a423048209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048202 expref: 4 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.999465:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3da00/0xad8e53a4230485dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41bd8 expref: 3 pid: 90835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999475:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048225 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304821e expref: 3 pid: 90837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.999479:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230485d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ba7 expref: 2 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144360.999487:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c29c5774800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1783144360.999488:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c200/0xad8e53a423048217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048210 expref: 2 pid: 90836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144360.999499:0:9527:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ac5d54000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783144360.999507:0:6509:0:(genops.c:906:class_export_put()) final put ffff9c29c5774800/a1ed6386-b53d-4b75-b3e0-82656a667de7 00010000:00010000:1.0:1783144360.999519:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144360.999519:0:9527:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d54000/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 00010000:00010000:1.0:1783144360.999522:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144360.999525:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144360.999525:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144360.999526:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144360.999530:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783144360.999547:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5774800/a1ed6386-b53d-4b75-b3e0-82656a667de7 for MGS 00000020:00000080:1.0:1783144360.999568:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d54000/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 for MGS 00000020:00000080:1.0:1783144360.999580:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c5773800 for MGS 00000100:00100000:0.0:1783144360.999594:0:90837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2ac6dc6400:90837] 2 exiting: rc = 0 00000100:00100000:3.0:1783144360.999638:0:90836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2ac9d9f000:90836] 1 exiting: rc = 0 00000020:00000080:1.0:1783144360.999659:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac5d52000 for MGS 00000100:00100000:0.0:1783144360.999717:0:90835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2af9e5ce00:90835] 0 exiting: rc = 1 00000100:00100000:1.0:1783144360.999834:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999844:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999853:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999874:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999885:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999892:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999900:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999912:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999923:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999928:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999940:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999947:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999953:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999958:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999963:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999975:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999981:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999986:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999991:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144360.999997:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000002:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000008:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000014:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000019:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000025:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000030:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000034:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000039:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000044:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000048:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000053:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000059:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000064:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000068:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000075:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000080:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000085:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000091:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000096:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000102:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000107:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000113:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000118:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000124:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000129:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000134:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000140:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000146:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000151:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000156:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000178:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000183:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000189:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000194:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000203:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000210:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000218:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000224:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000229:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000236:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000244:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000250:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000256:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783144361.000264:0:91846:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783144361.001319:0:91846:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2aee3da180 - data ffff9c29c1e8b1b0/ffff9c29c4a86800 00000020:01000000:1.0:1783144361.001555:0:91846:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2aee3daba0 - data ffff9c2afa6ae438/ffff9c2aef849c00 00000020:00000080:1.0:1783144361.002464:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048081 00000020:00000080:1.0:1783144361.002473:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d57800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783144361.002601:0:91846:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aefa79000 from MGS, refs=2 00000020:01000004:1.0:1783144361.002605:0:91846:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefa79000 2 00000020:00000080:3.0:1783144361.002607:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d57800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783144361.002608:0:91846:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2aefa79000 from MGS 00000020:00000080:1.0:1783144361.002634:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144361.002645:0:91846:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783144361.002674:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d56000/MGS 00000020:00000080:1.0:1783144361.002677:0:91846:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d56000/MGS for MGS 00000020:01000000:1.0:1783144361.002683:0:91846:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783144361.002805:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783144361.002809:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144361.002824:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783144361.002830:0:91846:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c2ac7fb4800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144361.002836:0:91846:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c2aee593380) has exports, disconnecting them 00000020:00080000:1.0:1783144361.002840:0:91846:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c2ac7fb4800), last request at 1783144343 00000020:00000080:1.0:1783144361.002844:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048199 00000020:00080000:1.0:1783144361.002860:0:91846:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac7fb4800): rc 0 00000020:00000080:1.0:1783144361.002913:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb4800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783144361.003016:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb4800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783144361.004843:0:91846:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783144361.004849:0:91846:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783144361.004853:0:91846:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783144361.004859:0:91846:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783144361.004928:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac7fb7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783144361.005115:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144361.005128:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783144361.005132:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783144361.005135:0:91846:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783144361.005143:0:91846:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783144361.005206:0:91846:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefa79000 1 00000020:00000080:0.0:1783144361.005211:0:91846:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048073 00000020:00000080:0.0:1783144361.005216:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d52800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783144361.005220:0:91846:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783144361.005229:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144361.005232:0:91846:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783144361.005235:0:91846:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c2af9c799c0) has no exports 00000020:00000080:2.0:1783144361.005564:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d52800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144361.031179:0:91846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144361.031191:0:91846:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783144361.031199:0:91846:0:(genops.c:906:class_export_put()) final put ffff9c29c4c09000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144361.031204:0:91846:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c4c09000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783144361.031216:0:91846:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783144361.031361:0:91846:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9c2aefa7e800 00000020:02000400:1.0:1783144361.031424:0:91846:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1783144361.485974:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501335936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144361.486039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144361.486079:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144361.486086:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501336064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144361.486109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144361.486184:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501335936 00000100:00100000:1.0:1783144361.486193:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501335936 00000100:00100000:3.0:1783144361.486202:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336064 00000100:00100000:3.0:1783144361.486209:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336064 00000100:00100000:1.0:1783144361.486263:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:1.0:1783144361.486275:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501335936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144361.486305:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144361.486352:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501335936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144361.486359:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00080000:0.0:1783144361.486397:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144361.486401:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144361.486416:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1783144361.486426:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501336064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144361.486445:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144361.486484:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501336064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144361.486492:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:1.0:1783144361.487855:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501336064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144361.487884:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501335936:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144361.934032:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783144362.514054:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783144362.514068:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c29c722d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783144362.514101:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00100000:1.0:1783144362.514110:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:1.0:1783144362.514117:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2af5c48800/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:2.0:1783144362.514129:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c722d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:0.0:1783144362.514130:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144362.514140:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b26000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783144362.514155:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00100000:0.0:1783144362.514163:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:0.0:1783144362.514166:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2af5c4c800/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00000080:2.0:1783144362.514194:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c48800/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0000 00000020:00000080:2.0:1783144362.514230:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b26000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783144362.514262:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac4df1800 for lustre-OST0000 00000020:00000080:2.0:1783144362.514273:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c4c800/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-OST0001 00000020:00000080:2.0:1783144362.514310:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5c4a800 for lustre-OST0000 00000020:00000080:2.0:1783144362.514317:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ae4b26800 for lustre-OST0001 00000020:00000080:2.0:1783144362.514322:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5c4c000 for lustre-OST0001 00000001:00100000:1.0:1783144362.514569:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783144362.514580:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378740 is committed 00000020:00000080:1.0:1783144362.514584:0:75517:0:(genops.c:906:class_export_put()) final put ffff9c2ac8863800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783144362.514622:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00100000:1.0:1783144362.514627:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cace81e7-a6f2-4d37-b197-caf34583781c 00000001:00080000:1.0:1783144362.514633:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378739 is committed 00000020:00000080:1.0:1783144362.514642:0:75517:0:(genops.c:906:class_export_put()) final put ffff9c2af9eca800/cace81e7-a6f2-4d37-b197-caf34583781c 00000020:00080000:1.0:1783144362.514650:0:75517:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c2ac4d83d80 refcount 2 committed 0 result 0 batchid 77309411385 00000020:00080000:1.0:1783144362.514654:0:75517:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2ac6564300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c2ac4d83240 00000020:00080000:1.0:1783144362.514659:0:75517:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].1 00000020:00080000:1.0:1783144362.514662:0:75517:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2ac6564700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2af9cc8000 00000020:00080000:1.0:1783144362.514666:0:75517:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].1 00000020:00000080:2.0:1783144362.514669:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac8863800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1783144362.514759:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af9eca800/cace81e7-a6f2-4d37-b197-caf34583781c for lustre-MDT0001 00000020:00000080:2.0:1783144362.514796:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af71e2000 for lustre-MDT0001 00000020:00000080:2.0:1783144362.514801:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ad3dab800 for lustre-MDT0001 00000020:00080000:0.0:1783144362.514861:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411385 committed batchid 73014444037 00000020:00080000:0.0:1783144362.514924:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444037 00000100:00100000:1.0:1783144362.596581:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144362.596631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000400:00000100:1.0:1783144362.596651:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481691776 offset 0 length 224: 4 00000100:00100000:1.0:1783144362.596671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144362.596708:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481692160 00000100:00100000:1.0:1783144362.596777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144362.596787:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481692160 00000100:00100000:1.0:1783144362.596821:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481692288 00000100:00100000:1.0:1783144362.596831:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481692288 00000100:00100000:3.0:1783144362.596889:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2042 00000100:00100000:3.0:1783144362.596904:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481692160:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144362.596907:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2043 00000100:00100000:1.0:1783144362.596926:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481692288:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144362.597009:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481692288:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144362.597019:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2043 00000100:00100000:3.0:1783144362.597073:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481692160:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 171us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144362.597095:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2042 00000100:00080000:3.0:1783144362.597124:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144362.597128:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144362.597229:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691904 00000100:00100000:2.0:1783144362.597236:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691904 00000100:00100000:2.0:1783144362.597274:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1200 00000100:00100000:2.0:1783144362.597281:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1869759481691904:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:2.0:1783144362.597289:0:66114:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:2.0:1783144362.597329:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1869759481691904:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 48us (761us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144362.597336:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1200 00000100:00100000:2.0:1783144362.597351:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481692032 00000100:00100000:2.0:1783144362.597354:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481692032 00000100:00100000:2.0:1783144362.597414:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 819 00000100:00100000:2.0:1783144362.597422:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2405:x1869759481692032:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:3.0:1783144362.597437:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144362.597470:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2405:x1869759481692032:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144362.597479:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 819 00000100:00100000:1.0:1783144362.599894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144362.599980:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481692416 00000100:00100000:2.0:1783144362.599988:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481692416 00000100:00100000:2.0:1783144362.600067:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1201 00000100:00100000:2.0:1783144362.600075:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481692416:12345-192.168.203.4@tcp:38:ptlrpcd_01_00.0 00010000:00020000:2.0:1783144362.600102:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144362.600173:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481692416:12345-192.168.203.4@tcp:38:ptlrpcd_01_00.0 Request processed in 96us (286us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144362.600181:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1201 00010000:00010000:2.0:1783144362.957959:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144363.982012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144364.045937:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783144364.045961:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501336192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144364.046037:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144364.046070:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336192 00000100:00100000:3.0:1783144364.046077:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501336320:0@lo:400:kworker.0 00000100:00100000:2.0:1783144364.046079:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336192 00000100:00100000:0.0:1783144364.046099:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501336576:0@lo:400:kworker.0 00000400:00000100:3.0:1783144364.046106:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501336320 offset 0 length 224: 4 00000100:00100000:2.0:1783144364.046130:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1783144364.046140:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3651:x1869759501336192:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144364.046146:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783144364.046154:0:8446:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783144364.046177:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783144364.046186:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501336448:0@lo:400:kworker.0 00000100:00100000:0.0:1783144364.046212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144364.046232:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3651:x1869759501336192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (194us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144364.046240:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1783144364.046246:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336576 00000100:00100000:0.0:1783144364.046251:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336576 00000100:00100000:2.0:1783144364.046271:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336448 00000100:00100000:2.0:1783144364.046277:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336448 00000100:02020000:3.0:1783144364.046352:0:3651:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1783144364.046358:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783144364.046363:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1783144364.046364:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:02000400:3.0:1783144364.046370:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144364.046376:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783144364.046378:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501336576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144364.046421:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501336576:12345-0@lo:400:kworker.0 Request processed in 48us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144364.046453:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1783144364.046461:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1783144364.046463:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869759501336448:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144364.046472:0:66114:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1783144364.046485:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144364.046495:0:3651:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2883 00000100:00080000:3.0:1783144364.046506:0:3651:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144364.046506:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501336704:0@lo:400:kworker.0 00000100:00100000:2.0:1783144364.046520:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869759501336448:12345-0@lo:400:kworker.0 Request processed in 56us (305us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144364.046529:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1783144364.046538:0:3651:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afab10e00 x1869759501337088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144364.046548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144364.046575:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336704 00000100:00100000:0.0:1783144364.046577:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501337344:0@lo:400:kworker.0 00000100:00100000:2.0:1783144364.046581:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336704 00000100:00100000:3.0:1783144364.046616:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501336832:0@lo:400:kworker.0 00000100:00100000:0.0:1783144364.046616:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144364.046622:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1783144364.046627:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501336960:0@lo:400:kworker.0 00000100:00100000:2.0:1783144364.046633:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1869759501336704:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144364.046641:0:66112:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783144364.046656:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337344 00000100:00100000:3.0:1783144364.046663:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144364.046663:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337344 00000100:00100000:1.0:1783144364.046678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144364.046696:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1869759501336704:12345-0@lo:400:kworker.0 Request processed in 63us (148us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144364.046704:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1783144364.046706:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336832 00000100:00100000:0.0:1783144364.046711:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336832 00000100:00100000:1.0:1783144364.046712:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783144364.046756:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1783144364.046762:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501337216:0@lo:400:kworker.0 00000100:00100000:3.0:1783144364.046763:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1869759501337344:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783144364.046775:0:66143:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783144364.046784:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1783144364.046796:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501336832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144364.046809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144364.046814:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c5085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1869759501337344:12345-0@lo:400:kworker.0 Request processed in 48us (199us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783144364.046830:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1783144364.046863:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336960 00000100:00100000:1.0:1783144364.046865:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337216 00000100:00100000:0.0:1783144364.046865:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501336832:12345-0@lo:400:kworker.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144364.046869:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336960 00000100:00100000:1.0:1783144364.046872:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337216 00000100:00100000:3.0:1783144364.046876:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501337088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783144364.046880:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00080000:0.0:1783144364.046907:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144364.046913:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144364.046917:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144364.046918:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1783144364.046921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144364.046928:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1783144364.046933:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501336960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144364.046942:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501337216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144364.046992:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501336832:0@lo:400:kworker.0 00000100:00100000:2.0:1783144364.046999:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501336960:12345-0@lo:400:kworker.0 Request processed in 67us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144364.047000:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501337216:12345-0@lo:400:kworker.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00080000:0.0:1783144364.047007:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1783144364.047014:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00080000:0.0:1783144364.047015:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783144364.047022:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1783144364.047023:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00080000:0.0:1783144364.047031:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144364.047037:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2883 00000100:00100000:3.0:1783144364.047038:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337088 00000100:00080000:0.0:1783144364.047043:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144364.047044:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337088 00000100:00080000:1.0:1783144364.047062:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1783144364.047064:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c50e6a00 x1869759501337472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144364.047067:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1783144364.047069:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501337216:0@lo:400:kworker.0 00000100:02000400:1.0:1783144364.047077:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1783144364.047079:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00080000:1.0:1783144364.047084:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783144364.047089:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501336960:0@lo:400:kworker.0 00000100:00100000:3.0:1783144364.047093:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501337088:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1783144364.047094:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2883 00000100:00080000:1.0:1783144364.047104:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144364.047107:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501336448:0@lo:400:kworker.0 00010000:00020000:3.0:1783144364.047116:0:78024:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144364.047129:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501336576:0@lo:400:kworker.0 00000100:00100000:1.0:1783144364.047136:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60e8000 x1869759501337600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144364.047150:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501337472:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783144364.047154:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501337344:0@lo:400:kworker.0 00000100:00100000:3.0:1783144364.047159:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501337088:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 65us (240us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144364.047168:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00080000:1.0:1783144364.047174:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783144364.047177:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783144364.047181:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783144364.047185:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144364.047189:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2883 00000100:00100000:2.0:1783144364.047194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144364.047198:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144364.047216:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60e9180 x1869759501337728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144364.047227:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501336704:0@lo:400:kworker.0 00000100:00080000:2.0:1783144364.047236:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144364.047242:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144364.047246:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501337088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783144364.047261:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501337600:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783144364.047282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144364.047301:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501337728:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783144364.047319:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144364.047373:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337472 00000100:00100000:0.0:1783144364.047379:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337472 00000100:00100000:3.0:1783144364.047381:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337600 00000100:00100000:3.0:1783144364.047387:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337600 00000100:00100000:0.0:1783144364.047397:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337728 00000100:00100000:0.0:1783144364.047401:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337728 00000100:00100000:3.0:1783144364.047417:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1783144364.047427:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501337472:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783144364.047427:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1783144364.047437:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501337600:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1783144364.047444:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1783144364.047451:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144364.047456:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1783144364.047463:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501337728:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783144364.047475:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144364.047495:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501337472:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 68us (302us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144364.047497:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501337600:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58us (212us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783144364.047502:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783144364.047512:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1783144364.047520:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501337728:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 55us (198us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144364.047525:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1783144364.047534:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00080000:1.0:1783144364.047547:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144364.047552:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501337600:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783144364.047566:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144364.047569:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144364.047572:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501337728:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1783144364.047579:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144364.047582:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144364.047584:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501337472:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1783144365.007004:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144366.030584:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144366.605889:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144366.605898:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144366.605909:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501337984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144366.605913:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501337856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144366.606028:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144366.606163:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144366.606300:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337984 00000100:00100000:3.0:1783144366.606308:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337984 00000100:00100000:3.0:1783144366.606364:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501337856 00000100:00100000:3.0:1783144366.606367:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501337856 00000100:00100000:3.0:1783144366.606393:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1783144366.606406:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:2.0:1783144366.606419:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501337856:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783144366.606427:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144366.606432:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783144366.606449:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144366.606476:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501337984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144366.606504:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144366.606524:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501337856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144366.606531:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:3.0:1783144366.606552:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501337984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144366.606558:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1783144366.606588:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501337984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144366.606663:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501337856:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783144367.054220:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144367.714616:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144367.714707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144367.715119:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144367.715160:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000400:00000100:0.0:1783144367.715178:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481692544 offset 0 length 224: 4 00000100:00100000:0.0:1783144367.715210:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481693056 00000100:00100000:0.0:1783144367.715219:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481693056 00000100:00100000:0.0:1783144367.715281:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481692928 00000100:00100000:0.0:1783144367.715284:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481692928 00000100:00100000:0.0:1783144367.715308:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2046 00000100:00100000:0.0:1783144367.715319:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481693056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144367.715378:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481693056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144367.715386:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2046 00000100:00100000:0.0:1783144367.715400:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2047 00000100:00100000:0.0:1783144367.715407:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481692928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144367.715427:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481692928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 21us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144367.715433:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2047 00000100:00080000:0.0:1783144367.715446:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144367.715450:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144367.715741:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481692672 00000100:00100000:1.0:1783144367.715746:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481692672 00000100:00100000:1.0:1783144367.715807:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481692800 00000100:00100000:1.0:1783144367.715811:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481692800 00000100:00080000:2.0:1783144367.715875:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144367.716012:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 822 00000100:00100000:0.0:1783144367.716021:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481692800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144367.716063:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481692800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144367.716070:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 822 00000100:00100000:0.0:1783144367.716090:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1208 00000100:00100000:0.0:1783144367.716095:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481692672:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:0.0:1783144367.716112:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144367.716135:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481692672:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 38us (1527us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144367.716151:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1208 00010000:00010000:2.0:1783144368.077927:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783144368.658254:0:75517:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411385 batchid updated 00000020:00080000:0.0:1783144368.658466:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411385 00000100:00080000:0.0:1783144368.658584:0:75537:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c29c50e6a00 x1869759501338112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144368.658597:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:2.0:1783144369.101946:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144369.165948:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144369.165956:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144369.165961:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144369.165969:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2898 00000100:00080000:1.0:1783144369.165974:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144369.166004:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144369.166030:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60e8700 x1869759501338368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144369.166067:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144369.166070:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144369.166072:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144369.166080:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2898 00000100:00080000:1.0:1783144369.166083:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144369.166088:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144369.166093:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501338368:0@lo:38:kworker.0 00000100:00100000:1.0:1783144369.166104:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60e9180 x1869759501338624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144369.166124:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144369.166128:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144369.166130:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144369.166133:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2898 00000100:00080000:1.0:1783144369.166136:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144369.166140:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144369.166152:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60eaa00 x1869759501338880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144369.166166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144369.166176:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144369.166180:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144369.166182:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144369.166186:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2898 00000100:00080000:1.0:1783144369.166189:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144369.166199:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144369.166205:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501338624:0@lo:38:kworker.0 00000100:00100000:1.0:1783144369.166213:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4ea5500 x1869759501339264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144369.166230:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144369.166245:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501338880:0@lo:38:kworker.0 00000100:00100000:1.0:1783144369.166256:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501338368 00000100:00100000:1.0:1783144369.166263:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501338368 00000100:00100000:3.0:1783144369.166270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144369.166287:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501339264:0@lo:38:kworker.0 00000100:00100000:1.0:1783144369.166301:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501338624 00000100:00100000:1.0:1783144369.166306:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501338624 00000100:00100000:3.0:1783144369.166311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144369.166343:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501339264 00000100:00100000:1.0:1783144369.166347:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501339264 00000100:00100000:3.0:1783144369.166353:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1783144369.166361:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501338368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144369.166381:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144369.166413:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501338240:0@lo:400:kworker.0 00000100:00100000:3.0:1783144369.166424:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501338368:12345-0@lo:38:kworker.0 Request processed in 60us (258us total) trans 0 rc -19/-19 00000400:00000100:0.0:1783144369.166445:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501338240 offset 0 length 224: 4 00000100:00100000:0.0:1783144369.166491:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501339136:0@lo:400:kworker.0 00000100:00100000:0.0:1783144369.166525:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144369.166548:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783144369.166554:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501339008:0@lo:400:kworker.0 00000100:00100000:0.0:1783144369.166575:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144369.167642:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:1.0:1783144369.167660:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1783144369.167668:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501338624:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144369.167680:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00010000:00020000:1.0:1783144369.167685:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144369.167690:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501339264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144369.167703:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144369.167760:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501339264:12345-0@lo:38:kworker.0 Request processed in 71us (1448us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144369.167766:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501338624:12345-0@lo:38:kworker.0 Request processed in 95us (1535us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144369.167772:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1783144369.167813:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501339136 00000100:00100000:3.0:1783144369.167818:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501339136 00000100:00100000:3.0:1783144369.167857:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501339008 00000100:00100000:3.0:1783144369.167861:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501339008 00000100:00100000:3.0:1783144369.167878:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1783144369.167884:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501339136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144369.167926:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501339136:12345-0@lo:400:kworker.0 Request processed in 42us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144369.167932:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1783144369.167944:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:3.0:1783144369.167950:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501339008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144369.167974:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501339008:12345-0@lo:400:kworker.0 Request processed in 24us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144369.167981:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00080000:3.0:1783144369.168014:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144369.168019:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144369.168023:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501339264:0@lo:38:kworker.0 00000100:00080000:3.0:1783144369.168033:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144369.168035:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144369.168037:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501338624:0@lo:38:kworker.0 00000100:00080000:3.0:1783144369.168042:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144369.168044:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144369.168046:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501338368:0@lo:38:kworker.0 00000100:00100000:3.0:1783144369.168065:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501338752:0@lo:400:kworker.0 00000100:00100000:1.0:1783144369.168071:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1783144369.168089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144369.168121:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501338752 00000100:00100000:3.0:1783144369.168122:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144369.168126:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501338752 00000100:00100000:3.0:1783144369.168131:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501338496:0@lo:400:kworker.0 00000100:00100000:3.0:1783144369.168157:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144369.168163:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1783144369.168174:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501338752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144369.168184:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501338496 00000100:00100000:3.0:1783144369.168189:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501338496 00000100:00100000:3.0:1783144369.168219:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1783144369.168224:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501338752:12345-0@lo:400:kworker.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144369.168229:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501338496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144369.168240:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:3.0:1783144369.168270:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501338496:12345-0@lo:400:kworker.0 Request processed in 43us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144369.168278:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1783144369.168289:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501339008:0@lo:400:kworker.0 00000100:00100000:1.0:1783144369.168305:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501339136:0@lo:400:kworker.0 00000100:00100000:3.0:1783144369.168318:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501338496:0@lo:400:kworker.0 00000100:00100000:3.0:1783144369.168330:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501338752:0@lo:400:kworker.0 00000100:00100000:1.0:1783144369.168348:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501338880 00000100:00100000:1.0:1783144369.168353:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501338880 00000100:00080000:3.0:1783144369.168368:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144369.168373:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144369.168374:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144369.168440:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:1.0:1783144369.168453:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afcbb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501338880:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783144369.168466:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144369.168506:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afcbb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501338880:12345-0@lo:38:kworker.0 Request processed in 52us (2234us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144369.168513:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00080000:3.0:1783144369.168520:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144369.168526:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783144369.168529:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501338880:0@lo:38:kworker.0 00000100:00100000:0.0:1783144369.677834:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:2.0:1783144370.126402:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144370.702275:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:2.0:1783144371.150033:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144371.726655:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00000100:00100000:3.0:1783144371.728423:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501339392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144371.728497:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144371.728546:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144371.728553:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501339520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144371.728576:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144371.728840:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501339392 00000100:00100000:2.0:1783144371.728848:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501339392 00000100:00100000:2.0:1783144371.728915:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501339520 00000100:00100000:2.0:1783144371.728919:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501339520 00000100:00100000:2.0:1783144371.728945:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1783144371.728954:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501339392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144371.728988:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144371.729035:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501339392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144371.729041:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1783144371.729056:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:2.0:1783144371.729063:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501339520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144371.729077:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144371.729103:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501339520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144371.729109:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00080000:3.0:1783144371.729177:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144371.729181:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144371.729211:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501339520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144371.729239:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501339392:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783144372.179018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144372.750126:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00000100:00100000:0.0:1783144372.836833:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144372.836871:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481693440 00000100:00100000:0.0:1783144372.836874:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144372.836881:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481693440 00000400:00000100:0.0:1783144372.836899:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481693184 offset 0 length 224: 4 00000100:00100000:2.0:1783144372.836903:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481693696 00000100:00100000:2.0:1783144372.836909:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481693696 00000100:00100000:0.0:1783144372.836929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144372.836960:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 825 00000100:00100000:2.0:1783144372.836966:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481693568 00000100:00100000:2.0:1783144372.836971:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481693568 00000100:00100000:1.0:1783144372.836976:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2406:x1869759481693440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144372.837009:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2050 00000100:00100000:2.0:1783144372.837018:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481693696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144372.837041:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2051 00000100:00100000:0.0:1783144372.837053:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481693568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144372.837072:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2406:x1869759481693440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144372.837083:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 825 00000100:00100000:0.0:1783144372.837091:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481693568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144372.837101:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2051 00000100:00080000:1.0:1783144372.837111:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144372.837116:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144372.837120:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144372.837240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144372.837362:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481693312 00000100:00100000:2.0:1783144372.837366:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481693696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144372.837368:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481693312 00000100:00100000:2.0:1783144372.837379:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2050 00000100:00100000:1.0:1783144372.837409:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1212 00000100:00100000:1.0:1783144372.837416:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481693312:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:1.0:1783144372.837435:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144372.837477:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481693312:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 60us (239us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144372.837485:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1212 00010000:00010000:2.0:1783144373.197849:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144373.774079:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:3.0:1783144374.226253:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144374.285839:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.285846:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783144374.285847:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501339648:0@lo:400:kworker.0 00000100:00080000:1.0:1783144374.285854:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.285858:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2903 00000100:00080000:1.0:1783144374.285863:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144374.285869:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144374.285888:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4ea5c00 x1869759501339776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1783144374.285894:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501339648 offset 0 length 224: 4 00000100:00080000:1.0:1783144374.285910:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.285914:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144374.285915:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.285918:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2903 00000100:00080000:1.0:1783144374.285921:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144374.285924:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144374.285933:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144374.285934:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2affdb5c00 x1869759501340032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144374.285938:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501339904:0@lo:400:kworker.0 00000100:00080000:1.0:1783144374.285958:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.285962:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144374.285963:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.285967:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2903 00000100:00100000:3.0:1783144374.285968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144374.285969:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144374.285972:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144374.285983:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c50e5180 x1869759501340288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144374.285994:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501339776:0@lo:38:kworker.0 00000100:00080000:1.0:1783144374.286008:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.286011:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1783144374.286014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144374.286018:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.286021:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2903 00000100:00080000:1.0:1783144374.286024:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144374.286027:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144374.286028:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501340032:0@lo:38:kworker.0 00000100:00100000:1.0:1783144374.286039:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afab01180 x1869759501340672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144374.286046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.286060:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144374.286064:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501340288:0@lo:38:kworker.0 00000100:00100000:1.0:1783144374.286066:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501340544:0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.286087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.286089:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.286135:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501340672:0@lo:38:kworker.0 00000100:00100000:3.0:1783144374.286157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.286181:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501340160:0@lo:400:kworker.0 00000100:00100000:0.0:1783144374.286189:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340544 00000100:00100000:0.0:1783144374.286200:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340544 00000100:00100000:3.0:1783144374.286202:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.286218:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144374.286223:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef52dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501340416:0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.286241:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.286247:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340416 00000100:00100000:0.0:1783144374.286250:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340416 00000100:00100000:3.0:1783144374.286264:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501339904 00000100:00100000:3.0:1783144374.286267:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501339904 00000100:00100000:0.0:1783144374.286271:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1783144374.286281:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501340544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.286289:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501339776 00000100:00100000:3.0:1783144374.286292:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501339776 00000100:00100000:3.0:1783144374.286308:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340032 00000100:00100000:3.0:1783144374.286310:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340032 00000100:00100000:0.0:1783144374.286329:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501340544:12345-0@lo:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.286330:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340672 00000100:00100000:3.0:1783144374.286332:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340672 00000100:00100000:0.0:1783144374.286337:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1783144374.286339:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340160 00000100:00100000:3.0:1783144374.286340:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340160 00000100:00100000:0.0:1783144374.286351:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1783144374.286354:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1783144374.286357:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501340416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.286359:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501339904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144374.286388:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501340416:12345-0@lo:400:kworker.0 Request processed in 31us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.286394:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1783144374.286396:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501339904:12345-0@lo:400:kworker.0 Request processed in 37us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.286402:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1783144374.286413:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1783144374.286418:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501340160:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783144374.286419:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783144374.286423:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144374.286425:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144374.286441:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1783144374.286445:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501339776:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144374.286448:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501340160:12345-0@lo:400:kworker.0 Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.286453:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00010000:00020000:0.0:1783144374.286460:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144374.286462:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1783144374.286465:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501340032:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144374.286485:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144374.286491:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501339776:12345-0@lo:38:kworker.0 Request processed in 45us (476us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144374.286497:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1783144374.286504:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501340032:12345-0@lo:38:kworker.0 Request processed in 38us (457us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144374.286509:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1783144374.286513:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501340672:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144374.286514:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00010000:00020000:0.0:1783144374.286522:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144374.286537:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340288 00000100:00100000:3.0:1783144374.286541:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340288 00000100:00100000:0.0:1783144374.286543:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501340672:12345-0@lo:38:kworker.0 Request processed in 29us (385us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144374.286554:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1783144374.286558:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:3.0:1783144374.286562:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501340288:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144374.286571:0:78024:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144374.286584:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef52dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501340416:0@lo:400:kworker.0 00000100:00100000:0.0:1783144374.286594:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501340160:0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.286599:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501340288:12345-0@lo:38:kworker.0 Request processed in 36us (512us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144374.286604:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00080000:0.0:1783144374.286620:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144374.286624:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144374.286627:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501340288:0@lo:38:kworker.0 00000100:00080000:0.0:1783144374.286634:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144374.286637:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144374.286640:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501340672:0@lo:38:kworker.0 00000100:00100000:3.0:1783144374.286644:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501339904:0@lo:400:kworker.0 00000100:00080000:0.0:1783144374.286646:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144374.286649:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144374.286651:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501339776:0@lo:38:kworker.0 00000100:00080000:0.0:1783144374.286658:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144374.286661:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144374.286664:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501340032:0@lo:38:kworker.0 00000100:00100000:1.0:1783144374.286740:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501340544:0@lo:400:kworker.0 00000100:00100000:2.0:1783144374.797806:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00000020:01000004:1.0:1783144374.819428:0:92269:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783144374.819434:0:92269:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783144374.819436:0:92269:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783144374.819547:0:92269:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c2aefdd9000 00000020:01000004:1.0:1783144374.819561:0:92269:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783144374.819574:0:92269:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783144374.819587:0:92269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2af9f10000) 00000020:00000080:1.0:1783144374.819601:0:92269:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783144374.858800:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.860687:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783144374.862465:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.865443:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.865637:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.865870:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.866047:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.866246:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.866428:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.866593:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.866821:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.867088:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.867265:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.867493:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.867663:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.867923:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.868205:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.868413:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.868591:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.868894:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.869152:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.869532:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.869926:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.870400:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.870718:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.871413:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.871860:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.873860:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.874259:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.874494:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.874747:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.874958:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783144374.875175:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.875363:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.875551:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783144374.876328:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783144374.876634:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783144374.876884:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783144374.877121:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.877320:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.877492:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.877705:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783144374.877947:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.878145:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.878321:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783144374.878476:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.878667:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783144374.879760:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.880096:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.880272:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.880566:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.880930:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144374.881118:0:92269:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1783144374.881474:0:92269:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783144374.881691:0:92269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783144374.881699:0:92269:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783144374.881709:0:92269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a42304868c 00000020:01000004:3.0:1783144374.881715:0:92269:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783144374.882100:0:92269:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783144374.882105:0:92269:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2aefdd9000 from MGS 00000020:01000004:3.0:1783144374.882108:0:92269:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783144374.882117:0:92269:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c2aee594d40) 00000020:00000080:3.0:1783144374.882131:0:92269:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783144374.882185:0:92269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aefdd9000 from MGS, refs=2 00080000:01000000:3.0:1783144374.882188:0:92269:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783144374.882192:0:92269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a42304869a 00010000:00010000:3.0:1783144374.882278:0:92269:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783144374.888827:0:92269:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783144374.889623:0:92273:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783144374.889783:0:92269:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783144374.889933:0:92269:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783144374.892286:0:92269:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783144374.892662:0:92269:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783144374.893387:0:92269:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783144374.893394:0:92269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783144374.895317:0:92269:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783144374.895325:0:92269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783144374.895780:0:92269:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783144374.895787:0:92269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783144374.896577:0:92269:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783144374.896598:0:92269:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1783144374.896599:0:92269:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1783144374.896603:0:92269:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1783144374.896609:0:92269:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783144374.896614:0:92269:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783144374.896618:0:92269:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783144374.896620:0:92269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783144374.898028:0:92269:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2aee572d80 x1869759501336320/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144380 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144374.898094:0:92269:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c29c60e9c00 x1869759501338240/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144385 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144374.898109:0:92269:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2ae4ea6680 x1869759501339648/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144390 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783144374.898126:0:92269:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783144374.898128:0:92269:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783144374.898130:0:92269:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783144374.898132:0:92269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1783144374.898158:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501338240:0@lo:400:kworker.0 00000100:00100000:2.0:1783144374.898230:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501339648:0@lo:400:kworker.0 00000100:00100000:1.0:1783144374.898302:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501336320:0@lo:400:kworker.0 10000000:01000000:3.0:1783144374.898350:0:92269:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1783144374.898365:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304825d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898375:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304825d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898381:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1783144374.898395:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898403:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e000/0xad8e53a423048256 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304825d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898417:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230481c3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898423:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230481c3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898429:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898432:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898444:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d600/0xad8e53a4230481bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230481c3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898453:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230481df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898459:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230481df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898465:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898469:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898473:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a4230481d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230481df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898482:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048209 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898489:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048209 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898494:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898497:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898500:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c000/0xad8e53a423048202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048209 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898509:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048217 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898516:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048217 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898532:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898535:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898540:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3ce00/0xad8e53a423048210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048217 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898549:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048233 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898554:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048233 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898559:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898562:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898565:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a42304822c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048233 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898573:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048241 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898580:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048241 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898585:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898588:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898590:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a42304823a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048241 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898598:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304826b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898614:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304826b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898620:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898623:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898631:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98e600/0xad8e53a423048264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304826b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898643:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230481d1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898649:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230481d1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898654:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898657:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898661:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98fe00/0xad8e53a4230481ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230481d1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898671:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230481ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898677:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230481ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898682:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144374.898685:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898689:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ce00/0xad8e53a4230481e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230481ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898708:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230481fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898714:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230481fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898718:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144374.898744:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898748:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a4230481f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230481fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898758:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048225 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898775:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048225 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898780:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144374.898783:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898787:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ee00/0xad8e53a42304821e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048225 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.898795:0:92269:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304824f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144374.898801:0:92269:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304824f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.898805:0:92269:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783144374.898813:0:92269:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783144374.898817:0:92269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afa98ec00/0xad8e53a423048248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304824f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783144374.898832:0:92269:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2ac6d92000 already not connected (conn 54, was 0): DISCONN 00000100:00080000:3.0:1783144374.898836:0:92269:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144374.898841:0:92269:0:(import.c:512:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 2877 00000100:00080000:3.0:1783144374.898847:0:92269:0:(import.c:626:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c2ac6d92000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144374.898871:0:92269:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afab10e00 x1869759501340800/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144374.898890:0:92269:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1783144374.898960:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501340800:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783144374.899021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144374.899110:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340800 00000100:00100000:2.0:1783144374.899116:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340800 00000100:00100000:2.0:1783144374.899154:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783144374.899162:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1869759501340800:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783144374.899183:0:92275:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo t0 exp 0000000000000000 cur 2909 last 0 00000020:00000080:2.0:1783144374.899206:0:92275:0:(genops.c:1406:class_connect()) connect: client 4e9e4714-8000-4c64-bed6-3cadd5fdfc80, cookie 0xad8e53a4230486a1 00000100:00080000:2.0:1783144374.899315:0:92275:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144374.899369:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3647:x1869759501340800:12345-0@lo:250:mount.lustre.0 Request processed in 207us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.899377:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783144374.899405:0:3647:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 27 00000100:00080000:0.0:1783144374.899413:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1783144374.899419:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783144374.899429:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783144374.899433:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783144374.899436:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783144374.899466:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000020:01000000:1.0:1783144374.899514:0:35504:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.104@tcp 10000000:01000000:1.0:1783144374.899529:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783144374.899532:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144374.899539:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144374.899540:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144374.899541:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144374.899542:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144374.899544:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144374.899545:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144374.899569:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144374.899571:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783144374.899604:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783144374.899613:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783144374.899616:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144374.899617:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783144374.899618:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144374.899619:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144374.899620:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144374.899621:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144374.899622:0:35504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144374.899623:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144374.899624:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783144374.899644:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783144374.899674:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501340928:0@lo:253:kworker.0 10000000:01000000:1.0:1783144374.899789:0:35504:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783144374.899792:0:35504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783144374.899793:0:35504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783144374.899794:0:35504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144374.899795:0:35504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144374.899796:0:35504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144374.899797:0:35504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144374.899799:0:35504:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144374.899800:0:35504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144374.899801:0:35504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783144374.899817:0:35504:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1783144374.899844:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501341184:0@lo:253:kworker.0 00000100:00100000:1.0:1783144374.900578:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.900608:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144374.900616:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501341056:0@lo:253:kworker.0 00000100:00100000:0.0:1783144374.900636:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501340800:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783144374.900648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.900682:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341184 00000100:00100000:1.0:1783144374.900692:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341184 00000100:00100000:0.0:1783144374.900696:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341056 00000100:00100000:1.0:1783144374.900740:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783144374.900748:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3651:x1869759501341184:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783144374.900782:0:92275:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783144374.900830:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341056 00000100:00100000:2.0:1783144374.900863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144374.900912:0:92269:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1783144374.900921:0:92269:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783144374.901055:0:92269:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1783144374.901063:0:92269:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783144374.901180:0:92269:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783144374.901212:0:92269:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783144374.901219:0:92269:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783144374.901221:0:92269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783144374.901222:0:92269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144374.901223:0:92269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144374.901224:0:92269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144374.901226:0:92269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144374.901227:0:92269:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144374.901228:0:92269:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783144374.901230:0:92269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144374.901233:0:92269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783144374.901236:0:92269:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783144374.901238:0:92269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783144374.901239:0:92269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783144374.901240:0:92269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783144374.901241:0:92269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783144374.901243:0:92269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783144374.901247:0:92269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783144374.901248:0:92269:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783144374.901249:0:92269:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783144374.901250:0:92269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783144374.901254:0:92269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783144374.901271:0:92269:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783144374.901281:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341312:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783144374.901323:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.901818:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501340928 00000100:00100000:0.0:1783144374.901823:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501340928 00000100:00100000:0.0:1783144374.901850:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783144374.901871:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3651:x1869759501341056:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783144374.901892:0:92277:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1783144374.901925:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3b40 going to sleep for 11 seconds 10000000:01000000:2.0:1783144374.901983:0:92278:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1783144374.901999:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341312 00000100:00100000:1.0:1783144374.902007:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341312 20000000:01000000:0.0:1783144374.902384:0:92275:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 116 20000000:01000000:0.0:1783144374.904296:0:92279:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783144374.904304:0:92279:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783144374.904307:0:92279:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783144374.904311:0:92279:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783144374.904508:0:92279:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1783144374.904633:0:92275:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783144374.904653:0:92275:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783144374.906261:0:92275:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783144374.906276:0:92275:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1783144374.906282:0:92277:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783144374.906447:0:92278:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144374.906457:0:92278:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144374.906478:0:92278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906495:0:92278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144374.906504:0:92278:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000046823s 00010000:00010000:2.0:1783144374.906509:0:92278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906516:0:92278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906523:0:92278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906530:0:92278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906536:0:92278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144374.906541:0:92278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906549:0:92278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906560:0:92278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906567:0:92278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.906584:0:92278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230486a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144374.906751:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3651:x1869759501341184:12345-0@lo:253:kworker.0 Request processed in 5969us (6139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.906761:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1783144374.906788:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783144374.906792:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783144374.906802:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144374.906804:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144374.906805:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144374.906808:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144374.906809:0:3651:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144374.906811:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144374.906814:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144374.906814:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783144374.906821:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501341184:0@lo:253:kworker.0 00000100:00100000:0.0:1783144374.906828:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3649:x1869759501340928:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783144374.906855:0:92275:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783144374.908322:0:92277:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783144374.908334:0:92277:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783144374.908343:0:92275:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783144374.908412:0:92278:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144374.908416:0:92278:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144374.908428:0:92278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908439:0:92278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144374.908446:0:92278:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000046823s 00010000:00010000:2.0:1783144374.908450:0:92278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908456:0:92278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908463:0:92278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908471:0:92278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908477:0:92278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144374.908480:0:92278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908487:0:92278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908507:0:92278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908515:0:92278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.908521:0:92278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516a00/0xad8e53a4230486af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.908683:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3651:x1869759501341056:12345-0@lo:253:kworker.0 Request processed in 6824us (8035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144374.908690:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1783144374.908702:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783144374.908705:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783144374.908706:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144374.908707:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144374.908708:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144374.908710:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144374.908711:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783144374.908713:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144374.908714:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144374.908716:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783144374.908718:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501341056:0@lo:253:kworker.0 00000100:00100000:1.0:1783144374.908746:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:92269:x1869759501341312:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144374.908808:0:92277:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783144374.908811:0:92277:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783144374.908815:0:92277:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1783144374.908820:0:92277:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783144374.910421:0:92275:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783144374.910435:0:92275:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783144374.910459:0:92278:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783144374.910464:0:92278:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783144374.910481:0:92278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910495:0:92278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783144374.910504:0:92278:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000046823s 00010000:00010000:3.0:1783144374.910508:0:92278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910516:0:92278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910524:0:92278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910532:0:92278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910538:0:92278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144374.910542:0:92278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910561:0:92278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910572:0:92278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.910581:0:92278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144374.910590:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:92269:x1869759501341312:12345-0@lo:253:mount.lustre.0 Request processed in 1844us (9261us total) trans 0 rc 0/0 00010000:00010000:3.0:1783144374.910591:0:92278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a4230486b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144374.910610:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783144374.910625:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341312:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783144374.910648:0:92269:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783144374.910650:0:92269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783144374.910652:0:92269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144374.910653:0:92269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144374.910654:0:92269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144374.910655:0:92269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144374.910656:0:92269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144374.910657:0:92269:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144374.910658:0:92269:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144374.910659:0:92269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144374.910661:0:92269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783144374.910676:0:92269:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2aefdd9000 from lustre-MDT0000 10000000:01000000:1.0:1783144374.910704:0:92269:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783144374.910708:0:92269:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783144374.910715:0:92269:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2aefdd9000 10000000:01000000:1.0:1783144374.910718:0:92269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783144374.910749:0:92269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2aefdd9000 10000000:01000000:1.0:1783144374.910752:0:92269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783144374.910756:0:92269:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2aefdd9000 from 1 10000000:01000000:1.0:1783144374.910759:0:92269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783144374.910881:0:92269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.910891:0:92269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.910900:0:92269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.910920:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144374.910961:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.911005:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341440 00000100:00100000:0.0:1783144374.911007:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3649:x1869759501340928:12345-0@lo:253:kworker.0 Request processed in 4180us (10140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.911012:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341440 00000100:00100000:1.0:1783144374.911018:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144374.911024:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783144374.911046:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783144374.911056:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:92269:x1869759501341440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144374.911068:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144374.911081:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a4230486c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230486bd expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.911096:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a4230486c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230486bd expref: 6 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.911105:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a4230486c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230486bd expref: 6 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.911113:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1a00, rc 0) 00000100:00100000:3.0:1783144374.911146:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:92269:x1869759501341440:12345-0@lo:101:mount.lustre.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.911161:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1783144374.911186:0:3649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783144374.911189:0:3649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783144374.911191:0:3649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144374.911193:0:3649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144374.911194:0:3649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144374.911196:0:3649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144374.911197:0:3649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783144374.911198:0:3649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144374.911199:0:3649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783144374.911202:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501340928:0@lo:253:kworker.0 00000100:00100000:1.0:1783144374.911249:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144374.911269:0:92269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.911277:0:92269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144374.911300:0:92269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783144374.911310:0:92269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.911316:0:92269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144374.911322:0:92269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783144374.911326:0:92269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783144374.911330:0:92269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2aefdd9000 10000000:01000000:1.0:1783144374.911333:0:92269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783144374.911335:0:92269:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783144374.911337:0:92269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783144374.911350:0:92269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.911357:0:92269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.911364:0:92269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.911375:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144374.911408:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.911425:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.911690:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341568 00000100:00100000:2.0:1783144374.911701:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341568 00000100:00100000:2.0:1783144374.911818:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783144374.911827:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:92269:x1869759501341568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144374.911835:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144374.911844:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230486cb expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.911860:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230486cb expref: 7 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.911869:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230486cb expref: 7 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.911875:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517e00, rc 0) 00000100:00100000:2.0:1783144374.911918:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:92269:x1869759501341568:12345-0@lo:101:mount.lustre.0 Request processed in 93us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.911926:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783144374.911952:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144374.911965:0:92269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.911974:0:92269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.912021:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144374.912046:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.912070:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144374.912081:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341696 00000100:00100000:3.0:1783144374.912086:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341696 00000100:00100000:3.0:1783144374.912150:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783144374.912158:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:92269:x1869759501341696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144374.912290:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92269:x1869759501341696:12345-0@lo:501:mount.lustre.0 Request processed in 133us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.912295:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783144374.912330:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144374.912358:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144374.912396:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.912533:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341824 00000100:00100000:0.0:1783144374.912539:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341824 00000100:00100000:1.0:1783144374.912541:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144374.912568:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783144374.912576:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92269:x1869759501341824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144374.913159:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92269:x1869759501341824:12345-0@lo:503:mount.lustre.0 Request processed in 582us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.913166:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783144374.913639:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501341824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144374.914363:0:92280:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92280:1869759501341952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144374.914408:0:92280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144374.914462:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501341952 00000100:00100000:2.0:1783144374.914469:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501341952 00000100:00100000:1.0:1783144374.914475:0:92280:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96000 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.914531:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783144374.914540:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92280:x1869759501341952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144374.915395:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92280:x1869759501341952:12345-0@lo:502:llog_process_th.0 Request processed in 854us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.915403:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783144374.915436:0:92280:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92280:1869759501341952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144374.915462:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144374.915473:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.915475:0:92280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783144374.915481:0:92280:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783144374.915490:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144374.915504:0:92280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c2af9f14d40) 00000020:00000080:1.0:1783144374.915524:0:92280:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1783144374.915530:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783144374.915590:0:92280:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783144374.915597:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a4230486e0 00000020:00000080:1.0:1783144374.915869:0:92280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783144374.915873:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144374.915875:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.915876:0:92280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783144374.915878:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144374.915880:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.915881:0:92280:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783144374.915883:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144374.915889:0:92280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c2ac49fb380) 00000020:00000080:1.0:1783144374.915897:0:92280:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1783144374.915900:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783144374.915901:0:92280:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783144374.915903:0:92280:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783144374.915907:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783144374.915937:0:92280:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aefdd9000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783144374.915945:0:92280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c29c236cd40) 00000020:00000080:1.0:1783144374.915950:0:92280:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1783144374.915985:0:92280:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783144374.915988:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a4230486f5 00000020:00000080:1.0:1783144374.916048:0:92280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783144374.916052:0:92280:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783144374.916055:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad8e53a4230486fc 00080000:01000000:1.0:1783144374.916057:0:92280:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783144374.916059:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048703 00010000:00010000:1.0:1783144374.954028:0:92280:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1783144374.954418:0:92280:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149701 lx: 0 gen 21 00000001:00080000:1.0:1783144374.954461:0:92280:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef idx: 2 lr: 0 srv lr: 111669149701 lx: 0 gen 23 00000001:00000004:1.0:1783144374.954493:0:92280:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149701 00000001:00080000:1.0:1783144374.954823:0:92280:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1783144374.954876:0:92280:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2af6fb86c0: xid 1869759501332096, transno 111669149701, client gen 21, slot idx 1 00000001:00080000:1.0:1783144374.954886:0:92280:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2af6fb8480: xid 1869759501331840, transno 111669149700, client gen 21, slot idx 2 00000020:00000080:1.0:1783144374.955355:0:92280:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c29c2368000) 00000020:00000080:1.0:1783144374.955374:0:92280:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1783144374.955441:0:92280:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783144374.955448:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a42304871f 00000020:00000080:1.0:1783144374.955876:0:92280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783144374.958640:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad8e53a423048726 00000020:00000080:1.0:1783144374.958951:0:92280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783144374.958965:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144374.958971:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.958974:0:92280:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783144374.958977:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783144374.958980:0:92280:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1783144374.958982:0:92280:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144374.958984:0:92280:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783144374.958985:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783144374.958989:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.958990:0:92280:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783144374.958994:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144374.958999:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.959000:0:92280:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783144374.959004:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783144374.959092:0:92280:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783144374.959107:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144374.959110:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.959111:0:92280:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783144374.959113:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144374.959116:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144374.959121:0:92280:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783144374.959123:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783144374.959127:0:92280:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:1.0:1783144374.959145:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783144374.959162:0:92280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c29c4ae99c0) 00000020:00000080:1.0:1783144374.959174:0:92280:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783144374.959178:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783144374.959232:0:92280:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783144374.959237:0:92280:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783144374.959242:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048734 00010000:00080000:1.0:1783144374.959267:0:92280:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2afa974800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144374.960624:0:92280:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783144374.961413:0:92280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144374.961423:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783144374.961455:0:92280:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783144374.961478:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304873b 00000100:00080000:3.0:1783144374.961488:0:92280:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783144374.961494:0:92280:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2afa974800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144374.961527:0:92280:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afab10e00 x1869759501342080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144374.961551:0:92280:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783144374.961641:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1783144374.961643:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501342080:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1783144374.961646:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.961651:0:92280:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783144374.961655:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783144374.961658:0:92280:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783144374.961659:0:92280:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144374.961661:0:92280:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144374.961662:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783144374.961666:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.961668:0:92280:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783144374.961671:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783144374.961675:0:92280:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783144374.961695:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.961696:0:92280:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783144374.961701:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783144374.961705:0:92280:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1783144374.961743:0:92280:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783144374.961746:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783144374.961757:0:92280:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c2aee5919c0) 00000020:00000080:3.0:1783144374.961784:0:92280:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783144374.961790:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783144374.961847:0:92280:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783144374.961852:0:92280:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783144374.961857:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048749 00010000:00080000:3.0:1783144374.961885:0:92280:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2af71e1800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00000100:00100000:0.0:1783144374.961938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144374.961983:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342080 00000100:00100000:2.0:1783144374.961991:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342080 00000100:00100000:2.0:1783144374.962029:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:2.0:1783144374.962037:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501342080:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783144374.962071:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2909 last 0 00010000:00010000:3.0:1783144374.962072:0:92280:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000020:00000080:2.0:1783144374.962171:0:8446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048750 00000004:00100000:2.0:1783144374.962187:0:8446:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783144374.962263:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.962267:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144374.962269:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.962273:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2908 00000100:00080000:2.0:1783144374.962276:0:8446:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb3800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783144374.962277:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783144374.962285:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144374.962303:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aef46f480 x1869759501342208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144374.962341:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501342080:12345-0@lo:38:llog_process_th.0 Request processed in 302us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.962351:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00080000:1.0:1783144374.962354:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.962358:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144374.962360:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.962364:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2908 00000100:00080000:1.0:1783144374.962367:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783144374.962370:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144374.962382:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3c26300 x1869759501342464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144374.962390:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501342208:0@lo:38:kworker.0 00000100:00080000:1.0:1783144374.962414:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.962417:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144374.962419:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.962423:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2908 00000100:00080000:1.0:1783144374.962426:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1783144374.962431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144374.962432:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144374.962449:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeea41f80 x1869759501342720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144374.962479:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144374.962482:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144374.962484:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144374.962487:0:35504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2908 00000100:00080000:1.0:1783144374.962489:0:35504:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783144374.962493:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144374.962506:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeea42a00 x1869759501343104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144374.962516:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783144374.962525:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00100000:1.0:1783144374.962533:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501342592:0@lo:400:kworker.0 00000100:00080000:0.0:1783144374.962533:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783144374.962540:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783144374.962544:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2afa974800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783144374.962559:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501342080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144374.962566:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.962582:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501342464:0@lo:38:kworker.0 00000100:00100000:0.0:1783144374.962617:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501342848:0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.962625:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501342336:0@lo:400:kworker.0 00000100:00100000:0.0:1783144374.962748:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.962782:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144374.962789:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501342976:0@lo:400:kworker.0 00000100:00100000:0.0:1783144374.962814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.962894:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342848 00000100:00100000:0.0:1783144374.962899:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342848 00000100:00100000:0.0:1783144374.962935:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342976 00000100:00100000:0.0:1783144374.962938:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342976 00000100:00100000:0.0:1783144374.962957:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1783144374.962964:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501342848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.963003:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1783144374.963008:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501342848:12345-0@lo:400:kworker.0 Request processed in 42us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.963016:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1783144374.963022:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501342976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144374.963052:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501342848:0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.963067:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501342976:12345-0@lo:400:kworker.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.963075:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501342976:0@lo:400:kworker.0 00000100:00100000:3.0:1783144374.963076:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000040:01000000:3.0:1783144374.963232:0:92280:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783144374.963353:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342208 00000100:00100000:2.0:1783144374.963358:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342208 00000100:00100000:2.0:1783144374.963381:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342592 00000100:00100000:1.0:1783144374.963382:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783144374.963385:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342592 00000100:00100000:1.0:1783144374.963391:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501343232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144374.963395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.963409:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342464 00000100:00100000:3.0:1783144374.963415:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342464 00000100:00100000:2.0:1783144374.963420:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1783144374.963428:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.963429:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501342720:0@lo:38:kworker.0 00000100:00100000:2.0:1783144374.963435:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501342592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144374.963466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.963473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144374.963486:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501342592:12345-0@lo:400:kworker.0 Request processed in 56us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.963493:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1783144374.963519:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501343104:0@lo:38:kworker.0 00000100:00100000:3.0:1783144374.963531:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342336 00000100:00100000:3.0:1783144374.963537:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342336 00000100:00100000:2.0:1783144374.963538:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1783144374.963545:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501342208:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144374.963554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.963556:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501343232 00000100:00100000:1.0:1783144374.963561:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501343232 00000100:00100000:3.0:1783144374.963563:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501343104 00000100:00100000:3.0:1783144374.963569:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501343104 00000100:00100000:3.0:1783144374.963595:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1783144374.963596:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501342208:12345-0@lo:38:kworker.0 Request processed in 47us (1163us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144374.963599:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501342720 00000100:00100000:1.0:1783144374.963605:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501342720 00000100:00100000:0.0:1783144374.963606:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1783144374.963610:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501342336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144374.963615:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1783144374.963617:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501342464:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144374.963622:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:1.0:1783144374.963631:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501343232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144374.963639:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1783144374.963646:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501343104:12345-0@lo:38:kworker.0 00000004:00000024:1.0:1783144374.963657:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1783144374.963692:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501342336:12345-0@lo:400:kworker.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.963704:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1783144374.963706:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501343104:12345-0@lo:38:kworker.0 Request processed in 55us (151us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144374.963708:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501343232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144374.963741:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1783144374.963745:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1783144374.963755:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501342464:12345-0@lo:38:kworker.0 Request processed in 136us (362us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144374.963778:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:0.0:1783144374.963778:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1783144374.963786:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501342720:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144374.963820:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501342720:12345-0@lo:38:kworker.0 Request processed in 34us (349us total) trans 0 rc -11/-11 00000040:01000000:3.0:1783144374.963822:0:92280:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1783144374.963823:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783144374.963826:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00080000:0.0:1783144374.963834:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783144374.963840:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501342464:0@lo:38:kworker.0 00000100:00080000:0.0:1783144374.963857:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783144374.963861:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501342336:0@lo:400:kworker.0 00000100:00080000:0.0:1783144374.963862:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783144374.963876:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501342720:0@lo:38:kworker.0 00000100:00100000:1.0:1783144374.963891:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501343232:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783144374.963896:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144374.963903:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144374.963905:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501342592:0@lo:400:kworker.0 00000100:00100000:0.0:1783144374.963910:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501343104:0@lo:38:kworker.0 00000100:00080000:0.0:1783144374.963926:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144374.963930:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783144374.963933:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501342208:0@lo:38:kworker.0 00000040:00080000:3.0:1783144374.965915:0:92280:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783144374.966105:0:92280:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:3.0:1783144374.968875:0:92280:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:3.0:1783144374.969238:0:92286:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1783144374.969243:0:92286:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783144374.969824:0:92280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144374.969835:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783144374.969872:0:92280:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783144374.969894:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048757 00000100:00080000:3.0:1783144374.969904:0:92280:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783144374.969910:0:92280:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2af71e1800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144374.969941:0:92280:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afab10e00 x1869759501343360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144374.969991:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501343360:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783144374.970052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144374.970097:0:92280:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783144374.970153:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144374.970157:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.970159:0:92280:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783144374.970163:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783144374.970165:0:92280:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783144374.970167:0:92280:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144374.970168:0:92280:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:1.0:1783144374.970168:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501343360 00000020:01000000:3.0:1783144374.970170:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783144374.970174:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.970175:0:92280:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000100:00100000:1.0:1783144374.970178:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501343360 00000020:01000000:3.0:1783144374.970179:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783144374.970185:0:92280:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783144374.970196:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.970198:0:92280:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783144374.970203:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783144374.970208:0:92280:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000100:00100000:1.0:1783144374.970224:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4965 00000020:01000000:3.0:1783144374.970228:0:92280:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783144374.970233:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:1.0:1783144374.970234:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3647:x1869759501343360:12345-0@lo:8:llog_process_th.0 00000020:00000080:3.0:1783144374.970244:0:92280:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c2aee593380) 00000020:00000080:3.0:1783144374.970260:0:92280:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00010000:00080000:1.0:1783144374.970263:0:26140:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2909 last 0 00000020:00000080:3.0:1783144374.970268:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:00000080:1.0:1783144374.970299:0:26140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048765 00002000:00100000:1.0:1783144374.970325:0:26140:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c29c5a43000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783144374.970329:0:26140:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783144374.970332:0:26140:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:3.0:1783144374.970334:0:92280:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783144374.970341:0:92280:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783144374.970347:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a42304876c 00010000:00080000:3.0:1783144374.970375:0:92280:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2af720e800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00002000:00080000:1.0:1783144374.970416:0:26140:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783144374.970450:0:26140:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a40000 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1783144374.970575:0:92280:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:1.0:1783144374.970604:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501343360:12345-0@lo:8:llog_process_th.0 Request processed in 369us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.970604:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783144374.970614:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:1.0:1783144374.970615:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4965 00000100:00080000:0.0:1783144374.970622:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783144374.970628:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783144374.970631:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:01000000:3.0:1783144374.970635:0:92280:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00080000:0.0:1783144374.970644:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000040:01000000:3.0:1783144374.970647:0:92280:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1783144374.970649:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501343360:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783144374.970674:0:92286:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783144374.970740:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144374.970752:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501343488:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1783144374.970774:0:92286:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2909324051443ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783144374.970783:0:92286:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783144374.970808:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144374.970836:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501343488 00000100:00100000:2.0:1783144374.970842:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501343488 00000100:00080000:1.0:1783144374.970873:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144374.970894:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1783144374.970904:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501343488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783144374.970922:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144374.970968:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501343488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.970976:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:1.0:1783144374.971013:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501343488:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1783144374.971979:0:92270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1783144374.972899:0:92280:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783144374.973159:0:92280:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:3.0:1783144374.973271:0:92280:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:1.0:1783144374.973678:0:92288:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:1.0:1783144374.973683:0:92288:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783144374.974278:0:92280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144374.974287:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783144374.974316:0:92280:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783144374.974331:0:92280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048773 00000100:00080000:0.0:1783144374.974339:0:92280:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144374.974344:0:92280:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2af720e800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144374.974371:0:92280:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b34380 x1869759501343616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144374.974405:0:92280:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783144374.974441:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501343616:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1783144374.974460:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144374.974464:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144374.974466:0:92280:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783144374.974468:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144374.974471:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144374.974473:0:92280:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783144374.974475:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783144374.974477:0:92280:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783144374.974479:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144374.974480:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144374.974482:0:92280:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783144374.974483:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144374.974485:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144374.974487:0:92280:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783144374.974490:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783144374.974495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.974514:0:92280:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92280:1869759501343744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144374.974542:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501343616 00000100:00100000:3.0:1783144374.974547:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501343616 00000100:00100000:0.0:1783144374.974556:0:92280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.974576:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4966 00000100:00100000:0.0:1783144374.974582:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501343744 00000100:00100000:3.0:1783144374.974583:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1869759501343616:12345-0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783144374.974585:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501343744 00010000:00080000:3.0:1783144374.974603:0:8602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2909 last 0 00000100:00100000:0.0:1783144374.974620:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000020:00000080:3.0:1783144374.974625:0:8602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304877a 00000100:00100000:0.0:1783144374.974626:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92280:x1869759501343744:12345-0@lo:502:llog_process_th.0 00002000:00100000:3.0:1783144374.974635:0:8602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2af5c4a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783144374.974639:0:8602:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783144374.974649:0:8602:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1783144374.974709:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92280:x1869759501343744:12345-0@lo:502:llog_process_th.0 Request processed in 82us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.974716:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783144374.974798:0:92280:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144374.974817:0:92280:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92280:1869759501343744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144374.974839:0:92280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144374.974846:0:92280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144374.974848:0:92280:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783144374.974852:0:92280:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783144374.974930:0:92269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783144374.974960:0:92269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783144374.974983:0:92269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.974995:0:92269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144374.975002:0:92269:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2aefdd9000 from 1 10000000:01000000:1.0:1783144374.975004:0:92269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783144374.975028:0:92269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.975035:0:92269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.975043:0:92269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.975061:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501343872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144374.975093:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.975121:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad0696f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.975146:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501343872 00000100:00100000:2.0:1783144374.975152:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501343872 00000100:00100000:2.0:1783144374.975185:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783144374.975193:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92269:x1869759501343872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144374.975202:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144374.975214:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048781 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.975234:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048781 expref: 9 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.975244:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048781 expref: 9 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.975253:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516a00, rc 0) 00000100:00100000:2.0:1783144374.975290:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:92269:x1869759501343872:12345-0@lo:101:mount.lustre.0 Request processed in 98us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.975296:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00080000:3.0:1783144374.975375:0:8602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783144374.975398:0:8602:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144374.975442:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501343616:12345-0@lo:8:llog_process_th.0 Request processed in 858us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.975449:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4966 00000100:00100000:0.0:1783144374.975473:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783144374.975479:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783144374.975485:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783144374.975490:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783144374.975492:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af720e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783144374.975512:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783144374.975517:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501343616:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783144374.975544:0:92288:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783144374.975565:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501343872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783144374.975568:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501344000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783144374.975580:0:92269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144374.975585:0:92288:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2909328862120ns, next at 0ns, rc = 0 00010000:00010000:1.0:1783144374.975589:0:92269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1783144374.975591:0:92288:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783144374.975603:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.975871:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344000 00000100:00100000:0.0:1783144374.975876:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344000 00000100:00080000:2.0:1783144374.975917:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144374.975925:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1783144374.975933:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501344000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783144374.975950:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144374.975990:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501344000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.975998:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00100000:2.0:1783144374.976014:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501344000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144374.976057:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344128:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783144374.976085:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.976115:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad0696f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144374.976133:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344128 00000100:00100000:0.0:1783144374.976137:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344128 00000100:00100000:2.0:1783144374.976243:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783144374.976252:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:92269:x1869759501344128:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783144374.976266:0:92276:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783144374.976281:0:92276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783144374.976284:0:92276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783144374.976286:0:92276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783144374.976289:0:92276:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 119 00000100:00100000:2.0:1783144374.976378:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:92269:x1869759501344128:12345-0@lo:256:mount.lustre.0 Request processed in 126us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.976385:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783144374.976487:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344128:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783144374.977126:0:92269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144374.977146:0:92269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783144374.977152:0:92270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1783144374.977155:0:92269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144374.977162:0:92269:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2aefdd9000 from 1 10000000:01000000:3.0:1783144374.977165:0:92269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144374.977186:0:92269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.977194:0:92269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.977203:0:92269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144374.977217:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144374.977245:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.977268:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac42fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.977280:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344256 00000100:00100000:2.0:1783144374.977285:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344256 00000100:00100000:2.0:1783144374.977341:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783144374.977347:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:92269:x1869759501344256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144374.977353:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144374.977363:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048796 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304878f expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.977375:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304878f expref: 10 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.977381:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304878f expref: 10 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144374.977394:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517800, rc 0) 00000100:00100000:2.0:1783144374.977426:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92269:x1869759501344256:12345-0@lo:101:mount.lustre.0 Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.977433:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783144374.977460:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144374.977479:0:92269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.977488:0:92269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144374.977523:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144374.977545:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.977563:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac42fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.977585:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344384 00000100:00100000:2.0:1783144374.977590:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344384 00000100:00100000:2.0:1783144374.977614:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783144374.977621:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92269:x1869759501344384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144374.977809:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92269:x1869759501344384:12345-0@lo:501:mount.lustre.0 Request processed in 187us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.977810:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144374.977823:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783144374.977847:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144374.977885:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144374.977911:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344512 00000100:00100000:3.0:1783144374.977914:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac42fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.977916:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344512 00000100:00100000:2.0:1783144374.977940:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783144374.977946:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92269:x1869759501344512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144374.978014:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92269:x1869759501344512:12345-0@lo:503:mount.lustre.0 Request processed in 67us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.978022:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783144374.978039:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144374.978311:0:92290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92290:1869759501344640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144374.978335:0:92290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.978351:0:92290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac42fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.978374:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344640 00000100:00100000:2.0:1783144374.978378:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344640 00000100:00100000:2.0:1783144374.978398:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783144374.978404:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92290:x1869759501344640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144374.979086:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92290:x1869759501344640:12345-0@lo:502:llog_process_th.0 Request processed in 682us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.979091:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783144374.979123:0:92290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92290:1869759501344640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783144374.979148:0:92290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144374.979157:0:92290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.979159:0:92290:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783144374.979166:0:92290:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2aefdd9000 00000020:00000080:3.0:1783144374.979168:0:92290:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783144374.979175:0:92290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144374.979177:0:92290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.979179:0:92290:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783144374.979187:0:92290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144374.979190:0:92290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.979191:0:92290:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783144374.979194:0:92290:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2aefdd9000 00000020:00000080:3.0:1783144374.979196:0:92290:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783144374.979261:0:92290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92290:1869759501344768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144374.979294:0:92290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.979313:0:92290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47000 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.979335:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344768 00000100:00100000:2.0:1783144374.979340:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344768 00000100:00100000:2.0:1783144374.979408:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783144374.979416:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92290:x1869759501344768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144374.979481:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92290:x1869759501344768:12345-0@lo:502:llog_process_th.0 Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.979488:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783144374.979514:0:92290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92290:1869759501344768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783144374.979534:0:92290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144374.979539:0:92290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144374.979540:0:92290:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783144374.979544:0:92290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783144374.979598:0:92269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783144374.979624:0:92269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783144374.979639:0:92269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.979649:0:92269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144374.979695:0:92269:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783144374.979698:0:92269:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2aefdd9000 10000000:01000000:1.0:1783144374.979701:0:92269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2aefdd9000 10000000:01000000:1.0:1783144374.979705:0:92269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783144374.979710:0:92269:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2aefdd9000 from 1 10000000:01000000:1.0:1783144374.979717:0:92269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144374.979755:0:92269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.979774:0:92269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.979783:0:92269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.979795:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144374.979821:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.979846:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501344896 00000100:00100000:1.0:1783144374.979849:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144374.979851:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501344896 00000100:00100000:3.0:1783144374.979888:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783144374.979897:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:92269:x1869759501344896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144374.979905:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144374.979917:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304879d expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.979935:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304879d expref: 11 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.979953:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304879d expref: 11 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.979961:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0e00, rc 0) 00000100:00100000:3.0:1783144374.980002:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92269:x1869759501344896:12345-0@lo:101:mount.lustre.0 Request processed in 106us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144374.980015:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783144374.980124:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501344896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144374.980136:0:92269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144374.980145:0:92269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.980189:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501345024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144374.980213:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.980230:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.980253:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345024 00000100:00100000:2.0:1783144374.980258:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345024 00000100:00100000:2.0:1783144374.980290:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783144374.980297:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92269:x1869759501345024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144374.980382:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92269:x1869759501345024:12345-0@lo:501:mount.lustre.0 Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.980389:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783144374.980542:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501345024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144374.980571:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501345152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144374.980615:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.980634:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144374.980656:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345152 00000100:00100000:2.0:1783144374.980661:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345152 00000100:00100000:2.0:1783144374.980738:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783144374.980746:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92269:x1869759501345152:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144374.980822:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92269:x1869759501345152:12345-0@lo:503:mount.lustre.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144374.980829:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783144374.980876:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501345152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144374.981199:0:92292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92292:1869759501345280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144374.981235:0:92292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144374.981290:0:92292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6900 going to sleep for 11 seconds 00000100:00100000:1.0:1783144374.981365:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345280 00000100:00100000:1.0:1783144374.981370:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345280 00000100:00100000:1.0:1783144374.981428:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783144374.981436:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92292:x1869759501345280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144374.981529:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92292:x1869759501345280:12345-0@lo:502:llog_process_th.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144374.981542:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783144374.981655:0:92292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92292:1869759501345280:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783144374.981702:0:92292:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783144374.981714:0:92292:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c2ad08dcd40) 00000020:00000080:0.0:1783144374.981783:0:92292:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783144374.981912:0:92292:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aefdd9000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783144374.981921:0:92292:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aefdd9000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783144374.981923:0:92292:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefdd9000 4 00010000:00080000:0.0:1783144374.981948:0:92292:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c29ca29f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1783144374.983671:0:92292:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1783144374.984614:0:92292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783144374.984665:0:92292:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783144374.984678:0:92292:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad8e53a4230487b2 00000100:00080000:0.0:1783144374.984686:0:92292:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783144374.984691:0:92292:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c29ca29f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144374.984747:0:92292:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4b34700 x1869759501345408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144374.984806:0:92292:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783144374.985115:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501345408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783144374.985175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.985248:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345408 00000100:00100000:0.0:1783144374.985253:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345408 00000100:00100000:0.0:1783144374.985287:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1783144374.985294:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501345408:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783144374.985342:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501345408:12345-0@lo:38:llog_process_th.0 Request processed in 48us (169us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144374.985349:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1783144374.985403:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783144374.985410:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29ca29f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144374.985415:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783144374.985418:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501345408:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144374.987206:0:92292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92292:1869759501345536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144374.987263:0:92292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.987300:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345536 00000100:00100000:1.0:1783144374.987304:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345536 00000100:00100000:1.0:1783144374.987403:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783144374.987413:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92292:x1869759501345536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144374.987512:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92292:x1869759501345536:12345-0@lo:502:llog_process_th.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144374.987520:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783144374.987565:0:92292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca1cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1783144374.987578:0:92292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92292:1869759501345536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144374.987608:0:92292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92292:1869759501345664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144374.987632:0:92292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144374.987646:0:92292:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca1cf180 going to sleep for 11 seconds 00000100:00100000:0.0:1783144374.987670:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345664 00000100:00100000:0.0:1783144374.987676:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345664 00000100:00100000:0.0:1783144374.987713:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783144374.987740:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92292:x1869759501345664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144374.987835:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92292:x1869759501345664:12345-0@lo:502:llog_process_th.0 Request processed in 114us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.987843:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783144374.988120:0:92292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92292:1869759501345664:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144374.988141:0:92292:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783144374.988289:0:92269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783144374.988323:0:92269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144374.988349:0:92269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.988360:0:92269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783144374.988408:0:92269:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783144374.988411:0:92269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144374.988412:0:92269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144374.988413:0:92269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144374.988415:0:92269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144374.988416:0:92269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144374.988417:0:92269:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144374.988419:0:92269:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144374.988421:0:92269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144374.988423:0:92269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783144374.988426:0:92269:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783144374.988428:0:92269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783144374.988429:0:92269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144374.988430:0:92269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144374.988431:0:92269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144374.988432:0:92269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144374.988434:0:92269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144374.988435:0:92269:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144374.988436:0:92269:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144374.988437:0:92269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144374.988438:0:92269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783144374.988451:0:92269:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783144374.988460:0:92269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501345792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783144374.988495:0:92269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.988527:0:92269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144374.988781:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345792 00000100:00100000:1.0:1783144374.988787:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345792 00000100:00100000:1.0:1783144374.988819:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783144374.988829:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92269:x1869759501345792:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144374.988848:0:92277:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783144374.988862:0:92277:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783144374.992241:0:92277:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783144374.992265:0:92277:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783144374.992360:0:92278:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783144374.992365:0:92278:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783144374.992386:0:92278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.992403:0:92278:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048781 expref: 11 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.992410:0:92278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.992448:0:92278:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048781 expref: 11 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.992466:0:92278:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048781 expref: 11 pid: 92277 timeout: 3009 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144374.992477:0:92278:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92278:1869759501345920:0@lo:104: 00000100:00100000:3.0:1783144374.992523:0:92278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144374.992550:0:92278:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144374.992571:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501345920 00000100:00100000:0.0:1783144374.992580:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501345920 00000100:00100000:0.0:1783144374.992634:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783144374.992642:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:92269:x1869759501345792:12345-0@lo:253:mount.lustre.0 Request processed in 3815us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.992647:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:92278:x1869759501345920:12345-0@lo:104: 00000100:00100000:1.0:1783144374.992653:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1783144374.992670:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144374.992696:0:92269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92269:1869759501345792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783144374.992706:0:92269:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783144374.992709:0:92269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783144374.992710:0:92269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783144374.992712:0:92269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144374.992713:0:92269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144374.992714:0:92269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144374.992715:0:92269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144374.992716:0:92269:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144374.992718:0:92269:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783144374.992740:0:92269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144374.992742:0:92269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783144374.992756:0:92269:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783144374.992801:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783144374.992808:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:92278:x1869759501345920:12345-0@lo:104: Request processed in 166us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144374.992815:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:0.0:1783144374.992836:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144374.992843:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.992851:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34200 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144374.992855:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.992864:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144374.992872:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144374.992877:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144374.992904:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.992911:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144374.992932:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.992939:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34200/0xad8e53a423048781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048788 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.992963:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144374.992966:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144374.992968:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144374.992986:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144374.992999:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501346048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144374.993038:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144374.993080:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346048 00000100:00100000:0.0:1783144374.993084:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346048 00010000:00010000:0.0:1783144374.993103:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048781 expref: 11 pid: 92277 timeout: 3009 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144374.993130:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:0.0:1783144374.993140:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3650:x1869759501346048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144374.993152:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144374.993157:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048781 expref: 11 pid: 92277 timeout: 3009 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993168:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048781 expref: 11 pid: 92277 timeout: 3009 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993184:0:26153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993190:0:26153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144374.993204:0:26153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000839390s 00010000:00010000:0.0:1783144374.993208:0:26153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993222:0:26153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993230:0:26153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993237:0:26153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993243:0:26153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144374.993247:0:26153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993255:0:26153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993265:0:26153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144374.993292:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144374.993331:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3650:x1869759501346048:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1783144374.993333:0:92278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516a00/0xad8e53a423048788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048781 expref: 11 pid: 92277 timeout: 3009 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144374.993346:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1783144374.993355:0:92278:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92278:1869759501345920:0@lo:104: 00010000:00010000:3.0:1783144374.993374:0:92278:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.993384:0:92278:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.993391:0:92278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144374.993398:0:92278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144374.993426:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501346048:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1783144375.001675:0:92269:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:1.0:1783144375.002579:0:92269:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783144375.002584:0:92298:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:2.0:1783144375.002588:0:92298:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:2.0:1783144375.002758:0:92299:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783144375.002788:0:92269:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783144375.003168:0:92299:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783144375.003322:0:92269:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783144375.003354:0:92269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783144375.004145:0:92269:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783144375.004153:0:92269:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783144375.004184:0:92269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783144375.004315:0:92300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92300:1869759501346176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144375.004373:0:92300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144375.004406:0:92300:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6fb8540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144375.004552:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346176 00000100:00100000:3.0:1783144375.004559:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346176 00000100:00100000:3.0:1783144375.004606:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:3.0:1783144375.004616:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92300:x1869759501346176:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144375.004695:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92300:x1869759501346176:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144375.004712:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:3.0:1783144375.004787:0:92300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92300:1869759501346176:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783144375.004817:0:92300:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783144375.004847:0:92300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92300:1869759501346304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144375.004880:0:92300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144375.004904:0:92300:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144375.005121:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346304 00000100:00100000:0.0:1783144375.005125:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346304 00000100:00100000:0.0:1783144375.005151:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:0.0:1783144375.005157:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92300:x1869759501346304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144375.005258:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92300:x1869759501346304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144375.005264:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000040:00080000:1.0:1783144375.005277:0:92269:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1783144375.005372:0:92300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92300:1869759501346304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144375.005438:0:92300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92300:1869759501346432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144375.005467:0:92300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144375.005489:0:92300:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144375.005804:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346432 00000100:00100000:0.0:1783144375.005808:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346432 00000100:00100000:0.0:1783144375.005830:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1783144375.005836:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92300:x1869759501346432:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144375.005882:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92300:x1869759501346432:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144375.005888:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000040:00080000:1.0:1783144375.005937:0:92269:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783144375.005962:0:92269:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783144375.006022:0:92269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783144375.006096:0:92300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92300:1869759501346432:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783144375.006134:0:92300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783144375.006474:0:92269:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:1.0:1783144375.008777:0:92269:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149701 00010000:00080000:1.0:1783144375.009322:0:92301:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92301 00010000:02000000:1.0:1783144375.009337:0:92301:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783144375.009340:0:92301:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783144375.009348:0:92301:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000040:00080000:2.0:1783144375.009556:0:92299:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783144375.009606:0:92299:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:01000004:0.0:1783144375.009749:0:92269:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783144375.009774:0:92269:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783144375.009792:0:92269:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783144375.009817:0:92269:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783144375.010551:0:92269:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783144375.010866:0:92269:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1783144375.011174:0:92300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783144375.011228:0:92300:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783144375.011233:0:92300:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1783144375.012831:0:92301:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1783144375.246659:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144375.395231:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144375.395305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144375.395326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144375.395339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144375.395357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144375.395379:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481694336 00000100:00100000:1.0:1783144375.395387:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481694336 00000100:00100000:1.0:1783144375.395427:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481694208 00000100:00100000:1.0:1783144375.395429:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481694208 00000100:00100000:1.0:1783144375.395447:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2056 00000100:00100000:1.0:1783144375.395455:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481694336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144375.395522:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481694336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144375.395527:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2056 00000100:00100000:1.0:1783144375.395541:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2057 00000100:00100000:1.0:1783144375.395546:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481694208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144375.395567:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481694208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144375.395571:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2057 00000100:00100000:1.0:1783144375.395590:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481693952 00000100:00100000:1.0:1783144375.395593:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481693952 00000100:00100000:1.0:1783144375.395611:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481694080 00000100:00100000:1.0:1783144375.395614:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481694080 00000100:00100000:1.0:1783144375.395650:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 830 00000100:00100000:1.0:1783144375.395658:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2402:x1869759481694080:12345-192.168.203.4@tcp:38:kworker.0 00010000:02000400:1.0:1783144375.395681:0:66114:0:(ldlm_lib.c:951:target_handle_reconnect()) lustre-MDT0001: Client 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef (at 192.168.203.4@tcp) reconnecting 00000100:00080000:2.0:1783144375.395805:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144375.395811:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144375.395814:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144375.395832:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481693824 00000100:00100000:2.0:1783144375.395833:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1220 00000100:00100000:0.0:1783144375.395837:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481693824 00000100:00100000:2.0:1783144375.395843:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481693952:12345-192.168.203.4@tcp:38:kworker.0 00010000:00080000:2.0:1783144375.395861:0:66112:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef' at ffff9c2aefa78800, cookie 0xad8e53a423048711 00010000:00080000:2.0:1783144375.395868:0:66112:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp recovering/t0 exp ffff9c2aefa78800 cur 2909 last 1783144374 00000100:00100000:0.0:1783144375.395873:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00010000:02000400:2.0:1783144375.395881:0:66112:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:0.0:1783144375.395881:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2405:x1869759481693824:12345-192.168.203.4@tcp:400:kworker.0 00010000:00080000:2.0:1783144375.395891:0:66112:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1783144375.395910:0:66112:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00080000:0.0:1783144375.395993:0:92275:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:0.0:1783144375.396025:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2405:x1869759481693824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 144us (801us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144375.396031:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00080000:2.0:1783144375.396058:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c70000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144375.396092:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481693952:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 249us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144375.396098:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1220 00000100:00100000:2.0:1783144375.399912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144375.399963:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481694464 00000100:00100000:3.0:1783144375.399972:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481694464 00000100:00100000:3.0:1783144375.400013:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1783144375.400021:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2402:x1869759481694464:12345-192.168.203.4@tcp:250:ptlrpcd_01_00.0 00000100:00100000:2.0:1783144375.400032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00080000:3.0:1783144375.400050:0:92277:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp t0 exp 0000000000000000 cur 2909 last 0 00000100:00100000:2.0:1783144375.400064:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481694592 00000100:00100000:2.0:1783144375.400069:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481694592 00000020:00000080:3.0:1783144375.400079:0:92277:0:(genops.c:1406:class_connect()) connect: client a1ed6386-b53d-4b75-b3e0-82656a667de7, cookie 0xad8e53a4230487c0 00000100:00100000:2.0:1783144375.400112:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1221 00000100:00100000:2.0:1783144375.400123:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481694592:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1783144375.400143:0:66143:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c29c61ff480 x1869759481694592/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:486/0 lens 328/0 e 0 to 0 dl 1783144386 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144375.400183:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481694592:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 62us (151us total) trans 0 rc 0/-999 00010000:00080000:0.0:1783144375.400188:0:92301:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1783144375.400194:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1221 00000100:00080000:3.0:1783144375.400258:0:92277:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144375.400337:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+5:2402:x1869759481694464:12345-192.168.203.4@tcp:250:ptlrpcd_01_00.0 Request processed in 314us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144375.400352:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00010000:00080000:1.0:1783144375.405396:0:66114:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp t0 exp ffff9c2ac7fb4000 cur 2909 last 1783144375 00000004:00100000:1.0:1783144375.405546:0:66114:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.203.4@tcp supports cksum type f7, return f7 00000100:00080000:1.0:1783144375.405602:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb6800 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1783144375.405622:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144375.406018:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2402:x1869759481694080:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 10359us (10656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144375.406222:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 830 00000100:00100000:2.0:1783144375.410218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144375.410265:0:66890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481691648 00000100:00100000:1.0:1783144375.410273:0:66890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481691648 00000100:00100000:1.0:1783144375.410315:0:66890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1783144375.410326:0:66890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70903:x1869759481691648:12345-192.168.203.4@tcp:700:cp.0 00000100:00080000:1.0:1783144375.410395:0:66890:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c2aeea41500 x1869759501346560/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144375.410407:0:66890:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3ce40 going to sleep for 0 seconds 00000100:00100000:2.0:1783144375.821894:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:2.0:1783144376.270547:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783144376.397804:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783144376.397814:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2aefdd9000 from 120 10000000:01000000:3.0:1783144376.397820:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144376.397877:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.397891:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.397904:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.397934:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501346688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.398017:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.398058:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5196f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.398081:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346688 00000100:00100000:3.0:1783144376.398090:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346688 00000100:00100000:3.0:1783144376.398149:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783144376.398160:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:6518:x1869759501346688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.398176:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.398191:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230487c7 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398217:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230487c7 expref: 11 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398229:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230487c7 expref: 11 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398252:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1800, rc 0) 00000100:00100000:3.0:1783144376.398291:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501346688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.398298:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783144376.398369:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501346688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.398384:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398393:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.398441:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501346816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.398472:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.398485:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5196f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.398497:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346816 00000100:00100000:3.0:1783144376.398500:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346816 00000100:00100000:3.0:1783144376.398522:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783144376.398529:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501346816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144376.398542:0:92277:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783144376.398560:0:92277:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144376.398564:0:92277:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 120 00000100:00100000:3.0:1783144376.398636:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501346816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.398643:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783144376.398670:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501346816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783144376.398718:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144376.398747:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398767:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.398777:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144376.398779:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 52 10000000:01000000:3.0:1783144376.398781:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144376.398795:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398802:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398810:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.398822:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501346944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.398846:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.398858:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2000 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.398870:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346944 00000100:00100000:3.0:1783144376.398873:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346944 00000100:00100000:3.0:1783144376.398894:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783144376.398901:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501346944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.398908:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.398918:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230487d5 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398942:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 12 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398950:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 12 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.398956:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0400, rc 0) 00000100:00100000:3.0:1783144376.398982:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501346944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.398988:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783144376.399019:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501346944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.399031:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.399039:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.399096:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.399119:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.399137:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3b2000 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.399147:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347072 00000100:00100000:3.0:1783144376.399150:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347072 00000100:00100000:3.0:1783144376.399170:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783144376.399176:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501347072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.399303:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501347072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.399318:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783144376.399346:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.399372:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.399408:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.399419:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.399429:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347200 00000100:00100000:3.0:1783144376.399432:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347200 00000100:00100000:3.0:1783144376.399448:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783144376.399454:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501347200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.399526:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501347200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.399532:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783144376.399568:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144376.400252:0:92485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783144376.400308:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783144376.400323:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144376.400329:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.400338:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.400345:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783144376.400347:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2ac91e0000 from 117 10000000:01000000:3.0:1783144376.400350:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144376.400365:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.400378:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.400386:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.400399:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.400424:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.400443:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.400453:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347328 00000100:00100000:3.0:1783144376.400457:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347328 00000100:00100000:3.0:1783144376.400477:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783144376.400483:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501347328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.400491:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.400500:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230487ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230487e3 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.400513:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230487ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230487e3 expref: 13 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.400521:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230487ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230487e3 expref: 13 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.400528:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1200, rc 0) 00000100:00100000:3.0:1783144376.400554:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501347328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.400560:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783144376.400593:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.400602:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.400609:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230487ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.400642:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.400669:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.400680:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.400690:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347456 00000100:00100000:3.0:1783144376.400693:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347456 00000100:00100000:3.0:1783144376.400711:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783144376.400717:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501347456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144376.400745:0:92276:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783144376.402387:0:92276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144376.402395:0:92276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783144376.402399:0:92276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783144376.402402:0:92276:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783144376.402405:0:92276:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:3.0:1783144376.403304:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501347456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2582us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.403318:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783144376.403532:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783144376.403620:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783144376.403630:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.403641:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144376.403650:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783144376.403653:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1783144376.403656:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783144376.403687:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.403695:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.403705:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144376.404095:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.404138:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144376.404248:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.404391:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347584 00000100:00100000:3.0:1783144376.404398:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347584 00000100:00100000:3.0:1783144376.404554:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783144376.404566:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501347584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.404581:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.404601:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230487f1 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.404636:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 14 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.404648:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 14 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.404657:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1c00, rc 0) 00000100:00100000:3.0:1783144376.404701:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501347584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.404708:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783144376.404871:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144376.404886:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.404896:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144376.404966:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.404992:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144376.405058:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.405101:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347712 00000100:00100000:3.0:1783144376.405105:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347712 00000100:00100000:3.0:1783144376.405134:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783144376.405141:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501347712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.405285:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501347712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.405293:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783144376.405319:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.405351:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.405394:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.405772:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.405948:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347840 00000100:00100000:0.0:1783144376.405954:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347840 00000100:00100000:0.0:1783144376.405980:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783144376.405988:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501347840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.408250:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501347840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2254us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.408262:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783144376.408340:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144376.409993:0:92486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1783144376.410176:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1783144376.410202:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783144376.410221:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410233:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.410243:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1783144376.410247:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2ac91e0000 from 1 10000000:01000000:3.0:1783144376.410250:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783144376.410287:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410296:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410306:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.410329:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.410384:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.410428:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.410472:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501347968 00000100:00100000:0.0:1783144376.410479:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501347968 00000100:00100000:0.0:1783144376.410526:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783144376.410536:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501347968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144376.410552:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144376.410569:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3ce00/0xad8e53a423048806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230487ff expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.410596:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3ce00/0xad8e53a423048806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230487ff expref: 15 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.410608:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3ce00/0xad8e53a423048806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230487ff expref: 15 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.410617:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3ce00, rc 0) 00000100:00100000:0.0:1783144376.410658:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501347968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.410665:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783144376.410764:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501347968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.410777:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048806 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410787:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048806 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.410802:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783144376.410805:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048806 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410817:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048806 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.410824:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144376.410826:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2ac91e0000 from 7 10000000:01000000:3.0:1783144376.410828:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144376.410841:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410847:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410855:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.410867:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.410891:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.410906:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.410921:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348096 00000100:00100000:3.0:1783144376.410924:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348096 00000100:00100000:3.0:1783144376.410948:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783144376.410954:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501348096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.410961:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.410970:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423048814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304880d expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.410983:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423048814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304880d expref: 16 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.411003:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423048814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304880d expref: 16 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.411009:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0800, rc 0) 00000100:00100000:3.0:1783144376.411033:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501348096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.411040:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783144376.411067:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.411076:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048814 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.411083:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048814 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.411125:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.411147:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.411158:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.411167:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348224 00000100:00100000:3.0:1783144376.411170:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348224 00000100:00100000:3.0:1783144376.411188:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783144376.411194:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501348224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.411300:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501348224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.411307:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783144376.411331:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.411364:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.411401:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.411413:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.411423:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348352 00000100:00100000:3.0:1783144376.411426:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348352 00000100:00100000:3.0:1783144376.411443:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783144376.411448:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501348352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.411520:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501348352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.411527:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783144376.411563:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144376.412210:0:92487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783144376.412254:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783144376.412267:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783144376.412273:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048814 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.412281:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048814 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.412288:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144376.412290:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 52 10000000:01000000:3.0:1783144376.412292:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144376.412309:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.412316:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.412330:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.412342:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.412368:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.412381:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.412393:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348480 00000100:00100000:3.0:1783144376.412396:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348480 00000100:00100000:3.0:1783144376.412418:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783144376.412425:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501348480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.412432:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.412442:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304881b expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.412457:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304881b expref: 17 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.412465:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304881b expref: 17 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.412472:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1600, rc 0) 00000100:00100000:3.0:1783144376.412498:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501348480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.412505:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783144376.412532:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.412542:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.412556:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.412594:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.412616:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.412627:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.412637:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348608 00000100:00100000:3.0:1783144376.412640:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348608 00000100:00100000:3.0:1783144376.412656:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783144376.412661:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501348608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.412748:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501348608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.412766:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783144376.412793:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.412813:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.412845:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.412857:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.412867:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348736 00000100:00100000:3.0:1783144376.412871:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348736 00000100:00100000:3.0:1783144376.412890:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783144376.412896:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501348736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.412953:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501348736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.412960:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783144376.412995:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144376.413659:0:92488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783144376.413692:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783144376.413705:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144376.413711:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.413738:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.413746:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783144376.413749:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783144376.413901:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783144376.413960:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.413973:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.413984:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.414371:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.414449:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144376.414508:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348864 00000100:00100000:3.0:1783144376.414514:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.414517:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348864 00000100:00100000:0.0:1783144376.414575:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783144376.414586:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501348864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144376.414600:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144376.414616:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048829 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.414637:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048829 expref: 18 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.414647:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048829 expref: 18 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.414654:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d800, rc 0) 00000100:00100000:0.0:1783144376.414704:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501348864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.414711:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783144376.414805:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.414827:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.414851:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.414921:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.414956:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.414987:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac9d999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.415002:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501348992 00000100:00100000:0.0:1783144376.415009:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501348992 00000100:00100000:0.0:1783144376.415045:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783144376.415054:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501348992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.415190:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501348992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.415198:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783144376.415225:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501348992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.415270:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.415320:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144376.415346:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.415400:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501349120 00000100:00100000:0.0:1783144376.415406:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501349120 00000100:00100000:0.0:1783144376.415437:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783144376.415493:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501349120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.416227:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501349120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 781us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.416235:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783144376.416344:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144376.417553:0:92489:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783144376.417700:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783144376.417769:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783144376.417784:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.417836:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144376.417846:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783144376.417849:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2b017f2000 from 7 10000000:01000000:0.0:1783144376.417852:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783144376.417890:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.417900:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.417910:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144376.417934:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.417984:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144376.418044:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.418187:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501349248 00000100:00100000:3.0:1783144376.418196:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501349248 00000100:00100000:3.0:1783144376.418248:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783144376.418258:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501349248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.418273:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.418289:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47ce00/0xad8e53a42304883e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048837 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.418314:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47ce00/0xad8e53a42304883e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048837 expref: 19 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.418326:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47ce00/0xad8e53a42304883e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048837 expref: 19 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.418336:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47ce00, rc 0) 00000100:00100000:3.0:1783144376.418397:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501349248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.418404:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783144376.418438:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144376.418521:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304883e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.418533:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304883e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144376.418594:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.418626:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144376.418696:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.419545:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501349376 00000100:00100000:3.0:1783144376.419551:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501349376 00000100:00100000:3.0:1783144376.419584:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783144376.419590:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501349376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.419818:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501349376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.419828:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783144376.419852:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.419915:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.419965:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.420005:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501349504 00000100:00100000:1.0:1783144376.420006:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa847600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.420010:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501349504 00000100:00100000:3.0:1783144376.420039:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783144376.420046:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501349504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.420443:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501349504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 397us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.420451:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783144376.420482:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144376.421828:0:92490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783144376.421923:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783144376.421949:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783144376.421960:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304883e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.421971:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304883e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.421981:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144376.421984:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 52 10000000:01000000:3.0:1783144376.421987:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144376.422016:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.422025:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.422042:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.422062:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.422118:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.422160:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799840 going to sleep for 11 seconds 00000100:00100000:1.0:1783144376.422161:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501349632 00000100:00100000:1.0:1783144376.422168:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501349632 00000100:00100000:1.0:1783144376.422210:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783144376.422327:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501349632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144376.422344:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144376.422359:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048845 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.422382:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048845 expref: 20 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.422393:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048845 expref: 20 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.422402:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35a00, rc 0) 00000100:00100000:1.0:1783144376.422444:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501349632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144376.422452:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783144376.422492:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144376.422504:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.422513:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144376.422559:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.422583:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144376.422599:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa847900 going to sleep for 11 seconds 00000100:00100000:1.0:1783144376.422617:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501349760 00000100:00100000:1.0:1783144376.422621:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501349760 00000100:00100000:1.0:1783144376.422650:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783144376.422659:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501349760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.422859:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501349760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144376.422866:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783144376.422876:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.422912:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.422951:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144376.422978:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501349888 00000100:00100000:3.0:1783144376.422981:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144376.422984:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501349888 00000100:00100000:1.0:1783144376.423020:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783144376.423027:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501349888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.423107:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501349888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144376.423114:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783144376.423171:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501349888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144376.424493:0:92491:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783144376.424561:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783144376.424586:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144376.424594:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.424605:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144376.424612:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783144376.424615:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783144376.424617:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783144376.424639:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.424647:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.424662:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144376.424678:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.424810:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.424836:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350016 00000100:00100000:1.0:1783144376.424842:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa847900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.424843:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350016 00000100:00100000:3.0:1783144376.424887:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783144376.424896:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501350016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.424907:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.424920:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048853 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.424938:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048853 expref: 21 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.424948:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048853 expref: 21 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.424967:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c000, rc 0) 00000100:00100000:3.0:1783144376.425003:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501350016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.425010:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783144376.425116:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144376.425128:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144376.425137:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144376.425181:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.425203:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144376.425229:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa847900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.425245:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350144 00000100:00100000:3.0:1783144376.425249:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350144 00000100:00100000:3.0:1783144376.425288:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783144376.425296:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501350144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.425483:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.425485:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501350144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.425496:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783144376.425518:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144376.425554:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144376.425570:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa847900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.425620:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350272 00000100:00100000:3.0:1783144376.425625:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350272 00000100:00100000:3.0:1783144376.425648:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783144376.425656:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501350272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.426393:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501350272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 737us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.426402:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783144376.426526:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144376.427615:0:92492:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783144376.427983:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783144376.428014:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783144376.428078:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.428090:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144376.428112:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144376.428116:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2afaac8800 from 7 10000000:01000000:3.0:1783144376.428119:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144376.428146:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.428154:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.428164:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.428183:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.428224:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.428274:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.428276:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350400 00000100:00100000:0.0:1783144376.428343:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350400 00000100:00100000:0.0:1783144376.428401:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783144376.428414:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501350400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144376.428430:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144376.428448:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29c9d3de00/0xad8e53a423048868 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048861 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.428476:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29c9d3de00/0xad8e53a423048868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048861 expref: 22 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.428486:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29c9d3de00/0xad8e53a423048868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048861 expref: 22 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.428495:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3de00, rc 0) 00000100:00100000:0.0:1783144376.428570:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501350400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.428578:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783144376.428626:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.428644:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.428654:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.428713:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.428814:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.428839:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.428992:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350528 00000100:00100000:0.0:1783144376.429000:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350528 00000100:00100000:0.0:1783144376.429044:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783144376.429056:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501350528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.429186:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501350528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.429194:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783144376.429314:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.429338:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.429374:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.429389:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144376.429424:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350656 00000100:00100000:0.0:1783144376.429431:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350656 00000100:00100000:0.0:1783144376.429458:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783144376.429470:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501350656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.429571:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501350656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144376.429578:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783144376.429606:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144376.431007:0:92493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783144376.431857:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783144376.431902:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783144376.431918:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.431931:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144376.431943:0:6518:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783144376.431947:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144376.431951:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783144376.432007:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.432017:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.432028:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144376.432053:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.432117:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.432174:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350784 00000100:00100000:3.0:1783144376.432184:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350784 00000100:00100000:0.0:1783144376.432191:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.432241:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783144376.432253:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501350784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.432270:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.432289:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47d600/0xad8e53a423048876 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304886f expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.432314:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47d600/0xad8e53a423048876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304886f expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.432324:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47d600/0xad8e53a423048876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304886f expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.432332:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d600, rc 0) 00000100:00100000:3.0:1783144376.432396:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501350784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.432403:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783144376.432866:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144376.432885:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048876 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.432897:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048876 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144376.432920:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783144376.432925:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048876 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.432932:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048876 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144376.433178:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783144376.433181:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144376.433184:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783144376.433207:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.433225:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144376.433234:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144376.433251:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144376.433304:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144376.433345:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.433440:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501350912 00000100:00100000:3.0:1783144376.433449:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501350912 00000100:00100000:3.0:1783144376.433530:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783144376.433539:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501350912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.433549:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.433568:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304887d expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.433587:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304887d expref: 24 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.433597:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304887d expref: 24 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.433604:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47da00, rc 0) 00000100:00100000:3.0:1783144376.433653:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501350912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.433660:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783144376.433687:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501350912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144376.433706:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144376.433717:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144376.433821:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501351040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144376.433859:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.434745:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351040 00000100:00100000:3.0:1783144376.434759:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351040 00000100:00100000:2.0:1783144376.434792:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144376.434801:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783144376.434811:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501351040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.434976:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501351040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (1117us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144376.434984:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783144376.435055:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501351040:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783144376.435085:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783144376.435092:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144376.435102:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144376.461820:0:66890:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3ce40 going to sleep for 0 seconds 00000001:02000400:1.0:1783144376.709191:0:92551:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783144376.845791:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00000100:00100000:3.0:1783144376.845982:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144376.846002:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501351168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144376.846082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144376.846136:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351168 00000100:00100000:2.0:1783144376.846153:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351168 00000100:00100000:2.0:1783144376.846209:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1783144376.846216:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501351168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144376.846244:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144376.846289:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501351168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144376.846302:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00080000:3.0:1783144376.846452:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144376.846488:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501351168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144376.847845:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144376.847860:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501351296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144376.847900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144376.847933:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351296 00000100:00100000:3.0:1783144376.847938:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351296 00000100:00080000:2.0:1783144376.847971:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144376.848024:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:3.0:1783144376.848034:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501351296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144376.848064:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783144376.848118:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501351296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.848125:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:2.0:1783144376.848144:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501351296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144376.866863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144376.866933:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481694848 00000100:00100000:3.0:1783144376.866949:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481694848 00000100:00100000:3.0:1783144376.866993:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:3.0:1783144376.867000:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+5:70816:x1869759481694848:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.867013:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.867026:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c200/0xad8e53a42304888b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c3a expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.867052:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c200/0xad8e53a42304888b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c3a expref: 6 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.867064:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c200/0xad8e53a42304888b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c3a expref: 6 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.867074:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c200, rc 0) 00000100:00100000:3.0:1783144376.867132:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481694848:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.867139:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 62 00000100:00100000:2.0:1783144376.868012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144376.868117:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481694976 00000100:00100000:3.0:1783144376.868123:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481694976 00000100:00100000:3.0:1783144376.868158:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1783144376.868166:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481694976:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144376.868194:0:92277:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783144376.868209:0:92277:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144376.868213:0:92277:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783144376.868228:0:92277:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783144376.868231:0:92277:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783144376.868233:0:92277:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:3.0:1783144376.869290:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481694976:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 Request processed in 1121us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.869299:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:2.0:1783144376.870834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144376.870901:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481695104 00000100:00100000:3.0:1783144376.870908:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481695104 00000100:00100000:3.0:1783144376.870952:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:3.0:1783144376.870961:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481695104:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.870973:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.870986:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c41 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.871007:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 7 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.871016:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 7 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.871024:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d800, rc 0) 00000100:00100000:3.0:1783144376.871063:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+7:70816:x1869759481695104:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 100us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.871070:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:2.0:1783144376.872215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144376.872279:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481695232 00000100:00100000:3.0:1783144376.872304:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481695232 00000100:00100000:3.0:1783144376.872339:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1783144376.872346:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+7:70816:x1869759481695232:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.872457:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481695232:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.872464:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:0.0:1783144376.873895:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144376.873932:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481695360 00000100:00100000:3.0:1783144376.873938:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481695360 00000100:00100000:3.0:1783144376.873968:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1783144376.873975:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481695360:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.874094:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481695360:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 118us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.874101:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:0.0:1783144376.876772:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144376.876861:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481695488 00000100:00100000:2.0:1783144376.876869:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481695488 00000100:00100000:2.0:1783144376.876948:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1783144376.876959:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481695488:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144376.876972:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144376.876988:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516c00/0xad8e53a423048899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c48 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144376.877014:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516c00/0xad8e53a423048899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c48 expref: 9 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144376.877026:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516c00/0xad8e53a423048899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c48 expref: 9 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144376.877046:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516c00, rc 0) 00000100:00100000:2.0:1783144376.877098:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481695488:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 141us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144376.877105:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:2.0:1783144376.878189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144376.878271:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481695616 00000100:00100000:3.0:1783144376.878276:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481695616 00000100:00100000:3.0:1783144376.878372:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:3.0:1783144376.878382:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481695616:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144376.878497:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481695616:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.878505:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:1.0:1783144376.881283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144376.881340:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481695744 00000100:00100000:2.0:1783144376.881348:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481695744 00000100:00100000:2.0:1783144376.881387:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:2.0:1783144376.881394:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481695744:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144376.881539:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481695744:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144376.881547:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1783144376.884153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144376.884215:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481695872 00000100:00100000:3.0:1783144376.884224:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481695872 00000100:00100000:3.0:1783144376.884370:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:3.0:1783144376.884381:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481695872:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144376.884397:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144376.884425:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c4f expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.884452:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 10 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.884464:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 10 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144376.884472:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47c800, rc 0) 00000100:00100000:3.0:1783144376.884522:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481695872:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 143us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144376.884529:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:1.0:1783144376.885503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144376.885558:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481696000 00000100:00100000:2.0:1783144376.885564:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481696000 00000100:00100000:2.0:1783144376.885597:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:2.0:1783144376.885603:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481696000:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144376.885668:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481696000:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 66us (167us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144376.885673:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000020:00000004:1.0:1783144377.097614:0:92603:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783144377.098502:0:92603:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783144377.295805:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783144377.458981:0:92653:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144377.459173:0:92653:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783144377.486647:0:66890:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3ce40 going to sleep for 0 seconds 00000100:00100000:2.0:1783144377.869789:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:0.0:1783144378.317887:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144378.509815:0:66890:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3ce40 going to sleep for 0 seconds 00000100:00100000:2.0:1783144378.893830:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:3.0:1783144379.343611:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144379.533844:0:66890:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3ce40 going to sleep for 0 seconds 00000100:00100000:2.0:1783144379.917871:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 0 seconds 00010000:00010000:2.0:1783144380.366775:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144380.430107:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501351424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144380.430175:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144380.430280:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144380.430284:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144380.430288:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144380.430296:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144380.430315:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60e8a80 x1869759501351680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144380.430347:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144380.430350:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144380.430351:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144380.430355:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144380.430365:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4ea5500 x1869759501351936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144380.430393:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144380.430396:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144380.430397:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144380.430402:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144380.430413:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeff06680 x1869759501352192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144380.430432:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144380.430435:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144380.430437:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144380.430440:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144380.430450:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeff05180 x1869759501352576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783144380.430467:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783144380.430471:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144380.430472:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29ca29f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144380.430477:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c29ca29f000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144380.430487:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aeff06300 x1869759501352960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144380.430509:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501351680:0@lo:38:kworker.0 00000100:00100000:3.0:1783144380.430539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430558:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501351936:0@lo:38:kworker.0 00000100:00100000:3.0:1783144380.430578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430594:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501352192:0@lo:38:kworker.0 00000100:00100000:3.0:1783144380.430621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430637:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501352576:0@lo:38:kworker.0 00000100:00100000:3.0:1783144380.430658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430674:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501352960:0@lo:38:kworker.0 00000100:00100000:3.0:1783144380.430694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430748:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501351808:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.430773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430791:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501352704:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.430817:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430835:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783144380.430841:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501352064:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.430862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430875:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501352832:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.430895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.430924:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351680 00000100:00100000:3.0:1783144380.430931:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351680 00000100:00100000:3.0:1783144380.430954:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351936 00000100:00100000:3.0:1783144380.430957:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351936 00000100:00100000:3.0:1783144380.430965:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352576 00000100:00100000:3.0:1783144380.430967:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352576 00000100:00100000:3.0:1783144380.430974:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352960 00000100:00100000:3.0:1783144380.430976:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352960 00000100:00100000:3.0:1783144380.430982:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351808 00000100:00100000:3.0:1783144380.430985:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351808 00000100:00100000:3.0:1783144380.431011:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352064 00000100:00100000:3.0:1783144380.431014:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352064 00000100:00100000:3.0:1783144380.431031:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1783144380.431038:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501351808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.431089:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501351808:12345-0@lo:400:kworker.0 Request processed in 51us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.431095:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1783144380.431110:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1783144380.431115:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501352064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.431137:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501352064:12345-0@lo:400:kworker.0 Request processed in 22us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.431141:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1783144380.431150:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1783144380.431154:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501351680:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783144380.431173:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2914 last 0 00000020:00000080:3.0:1783144380.431204:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad8e53a4230488a7 00000004:00100000:3.0:1783144380.431218:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783144380.431363:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144380.431403:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501351680:12345-0@lo:38:kworker.0 Request processed in 247us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.431410:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1783144380.431426:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1783144380.431432:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501351936:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144380.431443:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00010000:00080000:3.0:1783144380.431447:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2914 last 0 00000100:00100000:2.0:1783144380.431455:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501352576:12345-0@lo:38:kworker.0 00000020:00000080:3.0:1783144380.431469:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad8e53a4230488ae 00010000:00080000:2.0:1783144380.431476:0:66112:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2914 last 0 00000004:00100000:3.0:1783144380.431477:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783144380.431500:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4a000 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1783144380.431509:0:66112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad8e53a4230488b5 00000004:00100000:2.0:1783144380.431519:0:66112:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783144380.431532:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869759501351936:12345-0@lo:38:kworker.0 Request processed in 99us (952us total) trans 0 rc 0/0 00000100:00080000:2.0:1783144380.431539:0:66112:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c75000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144380.431550:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1783144380.431565:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1783144380.431570:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501352960:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783144380.431584:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2914 last 0 00000020:00000080:3.0:1783144380.431606:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad8e53a4230488bc 00000004:00100000:3.0:1783144380.431614:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783144380.431632:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2aee190800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144380.431635:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869759501352576:12345-0@lo:38:kworker.0 Request processed in 127us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144380.431643:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1783144380.431666:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501352960:12345-0@lo:38:kworker.0 Request processed in 93us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144380.431669:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352704 00000100:00100000:2.0:1783144380.431674:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352704 00000100:00100000:3.0:1783144380.431677:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:2.0:1783144380.431707:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352832 00000100:00100000:2.0:1783144380.431711:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352832 00000100:00100000:3.0:1783144380.431749:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1783144380.431761:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501352704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144380.431772:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1783144380.431782:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501352832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.431797:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501352704:12345-0@lo:400:kworker.0 Request processed in 39us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.431805:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1783144380.431825:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501352832:12345-0@lo:400:kworker.0 Request processed in 45us (928us total) trans 0 rc 0/0 00000100:00080000:3.0:1783144380.431826:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144380.431832:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144380.431835:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144380.431839:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:3.0:1783144380.431849:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501352320:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.431878:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.431897:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783144380.431903:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501351552:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.431930:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.431957:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501352448:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.431983:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.431987:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501352064:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.432023:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351552 00000100:00100000:3.0:1783144380.432028:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351552 00000100:00100000:2.0:1783144380.432047:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501352832:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.432058:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783144380.432067:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501351552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144380.432081:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501351808:0@lo:400:kworker.0 00000100:00100000:2.0:1783144380.432097:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501352704:0@lo:400:kworker.0 00000100:00100000:3.0:1783144380.432111:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501351552:12345-0@lo:400:kworker.0 Request processed in 43us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.432119:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1783144380.432137:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c29c60e8a80 x1869759501351680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144380.432160:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501351552:0@lo:400:kworker.0 00000100:00100000:1.0:1783144380.432306:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501351424 00000100:00100000:1.0:1783144380.432310:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501351424 00000100:00100000:1.0:1783144380.432333:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352192 00000100:00100000:1.0:1783144380.432336:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352192 00000100:00100000:1.0:1783144380.432352:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:1.0:1783144380.432359:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501351424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783144380.432381:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:1.0:1783144380.432418:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501351424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144380.432423:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:1.0:1783144380.432436:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:1.0:1783144380.432440:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501352192:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783144380.432453:0:23926:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2ac6d96000, cookie 0xad8e53a42304870a 00010000:00080000:1.0:1783144380.432457:0:23926:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c2ac6d96000 cur 2914 last 1783144374 00000004:00100000:1.0:1783144380.432466:0:23926:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783144380.432481:0:23926:0:(import.c:65:import_set_state_nolock()) ffff9c2afa9bc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783144380.432513:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501352192:12345-0@lo:38:kworker.0 Request processed in 70us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144380.432519:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:1.0:1783144380.432625:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501351424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144380.432783:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352320 00000100:00100000:0.0:1783144380.432787:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352320 00000100:00080000:2.0:1783144380.432863:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00100000:1.0:1783144380.433130:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501352448 00000100:00100000:1.0:1783144380.433135:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501352448 00000100:00100000:0.0:1783144380.433262:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:1.0:1783144380.433273:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1783144380.433274:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501352320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144380.433293:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501352448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144380.433327:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501352320:12345-0@lo:400:kworker.0 Request processed in 56us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.433335:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:1.0:1783144380.433343:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501352448:12345-0@lo:400:kworker.0 Request processed in 52us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144380.433350:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00010000:00080000:0.0:1783144380.433363:0:92301:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783144380.433369:0:92301:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 111669149702 00000020:00080000:0.0:1783144380.433375:0:92301:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144380.433378:0:92301:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149702 00000020:00080000:0.0:1783144380.433389:0:92301:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783144380.433391:0:92301:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149702 00000100:00080000:0.0:1783144380.433409:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144380.433414:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144380.433520:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501352448:0@lo:400:kworker.0 00000100:00100000:0.0:1783144380.433532:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501352320:0@lo:400:kworker.0 00000001:00100000:1.0:1783144380.434096:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783144380.434485:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783144380.434704:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1783144380.434777:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c29c60e8a80 x1869759501351680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144405 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.434788:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783144380.434793:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144380.434796:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783144380.434802:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501351680:0@lo:38:kworker.0 00010000:00080000:2.0:1783144380.434820:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2ae4ea5500 x1869759501351936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.434832:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:2.0:1783144380.435556:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2ae4ea5500 x1869759501351936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144405 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.435565:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783144380.435569:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144380.435571:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783144380.435576:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501351936:0@lo:38:kworker.0 00000100:00080000:2.0:1783144380.435594:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:2.0:1783144380.435601:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783144380.435605:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1783144380.435608:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149701 gen 3 00000100:00080000:2.0:1783144380.435611:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2af7208000 from lustre-MDT0000_UUID committed 111669149701 last 0 00000100:00080000:2.0:1783144380.435614:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1783144380.436264:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501352192:0@lo:38:kworker.0 00010000:00080000:2.0:1783144380.436285:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aeff05180 x1869759501352576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.436315:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00010000:00080000:3.0:1783144380.436439:0:92666:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1783144380.436443:0:92666:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1783144380.436448:0:92666:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1783144380.438122:0:92666:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1783144380.438424:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2aeff05180 x1869759501352576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144405 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.438432:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783144380.438435:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144380.438438:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1783144380.438442:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b2796a86): req@ffff9c2aeea41500 x1869759501346560/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144380.438459:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501352576:0@lo:38:kworker.0 00010000:00080000:2.0:1783144380.438487:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2aeff06300 x1869759501352960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.438497:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:2.0:1783144380.438502:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783144380.438505:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783144380.438507:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29ca29f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783144380.438510:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501352960:0@lo:38:kworker.0 00000100:00100000:2.0:1783144380.438551:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501353088:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783144380.438568:0:66890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.438592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.438641:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501353088 00000100:00100000:3.0:1783144380.438647:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501353088 00000100:00100000:1.0:1783144380.438649:0:66890:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.438704:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:3.0:1783144380.438715:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501353088:12345-0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783144380.438753:0:66119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501346560 00000100:00100000:0.0:1783144380.438759:0:66119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501346560 00010000:00080000:3.0:1783144380.438788:0:23926:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c29c61fed80 x1869759501353088/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:491/0 lens 224/0 e 0 to 0 dl 1783144391 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144380.438797:0:66119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783144380.438807:0:66119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66890:x1869759501346560:12345-0@lo:700:mdt_seqm_0002.0 00000100:00100000:3.0:1783144380.438814:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501353088:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 100us (220us total) trans 0 rc 0/-999 00010000:00080000:0.0:1783144380.438820:0:66119:0:(ldlm_lib.c:3198:target_queue_recovery_request()) @@@ not queueing req@ffff9c29c3c26300 x1869759501346560/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:491/0 lens 264/0 e 0 to 0 dl 1783144391 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144380.438824:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000020:00080000:2.0:1783144380.438843:0:92301:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144380.438848:0:92301:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149702 00010000:00080000:2.0:1783144380.438852:0:92301:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1783144380.438856:0:92301:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144380.438863:0:92301:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783144380.438879:0:92301:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783144380.438888:0:92301:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c29c61ff480 x1869759481694592/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:486/0 lens 328/0 e 0 to 0 dl 1783144386 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783144380.438904:0:92301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144380.438933:0:92301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c10 expref: -99 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.438952:0:92301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 7 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.438964:0:92301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 7 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.438970:0:92301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516000, rc 0) 00010000:00080000:2.0:1783144380.439014:0:92301:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1783144380.439024:0:92301:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1783144380.440602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144380.440676:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481696128 00000100:00100000:2.0:1783144380.440682:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481696128 00000100:00100000:2.0:1783144380.440755:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 833 00000100:00100000:2.0:1783144380.440765:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2402:x1869759481696128:12345-192.168.203.4@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1783144380.440783:0:66112:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c29c3c24e00 x1869759481696128/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:491/0 lens 224/0 e 0 to 0 dl 1783144391 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144380.440806:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2402:x1869759481696128:12345-192.168.203.4@tcp:400:ptlrpcd_rcv.0 Request processed in 44us (210us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144380.440813:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 833 00010000:00080000:0.0:1783144380.441305:0:92301:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783144380.441399:0:92301:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:2.0:1783144380.445546:0:92270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00100000:2.0:1783144380.445556:0:92270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1783144380.445657:0:92301:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 40000000:02000000:1.0:1783144380.445694:0:66119:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00010000:00080000:0.0:1783144380.445702:0:92301:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1783144380.445719:0:92301:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c29c61fed80 x1869759501353088/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:491/0 lens 224/0 e 0 to 0 dl 1783144391 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783144380.445859:0:92301:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.203.4@tcp: req@ffff9c29c3c24e00 x1869759481696128/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:491/0 lens 224/0 e 0 to 0 dl 1783144391 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1783144380.445920:0:92301:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1783144380.446307:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783144380.446315:0:3647:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2af5511c00 x1869759501353088/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144396 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.446325:0:3647:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2af5511c00 x1869759501353088/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144396 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.446333:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783144380.446352:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1783144380.446359:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000602c2d73): req@ffff9c29c50e6a00 x1869759501338112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144380.446377:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000068849654): req@ffff9c2affdb4000 x1869759501336192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144380 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144380.446390:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501353088:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783144380.446469:0:75537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.446491:0:75537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144380.446508:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501338112 00000100:00100000:2.0:1783144380.446513:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501338112 00000100:00100000:2.0:1783144380.446551:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1783144380.446560:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75537:x1869759501338112:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:2.0:1783144380.446627:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75537:x1869759501338112:12345-0@lo:1000:dist_txn-1.0 Request processed in 67us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144380.446635:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1783144380.446660:0:75537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:75537:1869759501338112:0@lo:1000:dist_txn-1.0 00000004:00080000:2.0:1783144380.446706:0:75537:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c29c6c479c0 with version 8 00000020:00080000:2.0:1783144380.446717:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411385 cancel update log [0x20000c751:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1783144380.446839:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411385 cancel update log [0x2400090a4:0x1:0x0].1: rc = 0 00000020:00080000:2.0:1783144380.446862:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411385 00000004:00080000:3.0:1783144380.447015:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 8 rpc_version 8 00000020:00100000:3.0:1783144380.447034:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783144380.447040:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2af5512300 x1869759501353472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144380.447113:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501353216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144380.447155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.447189:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501353216 00000100:00100000:2.0:1783144380.447192:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501353216 00000100:00100000:2.0:1783144380.447219:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:3.0:1783144380.447228:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501353472:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144380.447230:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501353216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783144380.447257:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444962304 avail 1298722816 00000100:00100000:3.0:1783144380.447268:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.447289:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d82240 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.447307:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501353472 00000100:00100000:2.0:1783144380.447308:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501353216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.447312:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501353472 00000100:00100000:2.0:1783144380.447319:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1783144380.447339:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1783144380.447346:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75523:x1869759501353472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783144380.447879:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501353216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144380.447923:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.447957:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501336192 00000100:00100000:2.0:1783144380.447962:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501336192 00000100:00100000:2.0:1783144380.447993:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1783144380.448001:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501336192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783144380.448013:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444962304 avail 1298722816 00000100:00100000:2.0:1783144380.448485:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501336192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 484us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144380.448493:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:3.0:1783144380.448556:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501336192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144380.449530:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75523:x1869759501353472:12345-0@lo:1000:osp_up0-1.0 Request processed in 2183us (2261us total) trans 115964116993 rc 0/0 00000100:00100000:2.0:1783144380.449538:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:3.0:1783144380.450306:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501353472:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783144380.452684:0:66119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66890:x1869759501346560:12345-0@lo:700:mdt_seqm_0002.0 Request processed in 13872us (14112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144380.452703:0:66119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783144380.452759:0:66890:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0002:lustre-MDT0000-lwp-MDT0001_UUID:66890:1869759501346560:0@lo:700:mdt_seqm_0002.0 40000000:02000000:3.0:1783144380.452772:0:66890:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00100000:3.0:1783144380.458230:0:66890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70903:x1869759481691648:12345-192.168.203.4@tcp:700:cp.0 Request processed in 5047896us (5048009us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.458243:0:66890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000004:00000080:0.0:1783144380.458519:0:92301:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc162886afe10 00100000:10000000:0.0:1783144380.458529:0:92301:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1783144380.459017:0:92287:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x702:0x0] 00000100:00100000:0.0:1783144380.459062:0:92287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b37800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92287:1869759501353600:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783144380.459112:0:92287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783144380.459171:0:92289:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x703:0x0] 00000100:00100000:2.0:1783144380.459194:0:92289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92289:1869759501353728:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783144380.459197:0:92287:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144380.459235:0:92289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144380.459256:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501353600 00000100:00100000:1.0:1783144380.459263:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501353600 00000100:00100000:2.0:1783144380.459266:0:92289:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016900 going to sleep for 11 seconds 00000100:00100000:1.0:1783144380.459342:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501353728 00000100:00100000:1.0:1783144380.459346:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501353728 00000100:00100000:0.0:1783144380.459410:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4967 00000100:00100000:0.0:1783144380.459420:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:92287:x1869759501353600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783144380.459445:0:26149:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -63 00002000:02000040:0.0:1783144380.459451:0:26149:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1795 to 0x280000401:1857) 00000100:00100000:1.0:1783144380.459545:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968 00000100:00100000:1.0:1783144380.459554:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:92289:x1869759501353728:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783144380.459569:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -62 00002000:02000040:1.0:1783144380.459572:0:8435:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1796 to 0x2c0000401:1857) 00000100:00100000:3.0:1783144380.461514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144380.461569:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481696384 00000100:00100000:2.0:1783144380.461578:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481696384 00000100:00100000:2.0:1783144380.461629:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1226 00000100:00100000:2.0:1783144380.461638:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:70903:x1869759481696384:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:2.0:1783144380.461654:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144380.461671:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a4230488ca lrc: 2/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c56 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783144380.462060:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783144380.462126:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462135:0:66113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462145:0:66113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144380.462161:0:66113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66113:1869759501353856:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1783144380.462199:0:66113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.462228:0:66113:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.462437:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501353856 00000100:00100000:3.0:1783144380.462441:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501353856 00000100:00100000:3.0:1783144380.462475:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:3.0:1783144380.462484:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66113:x1869759501353856:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1783144380.462497:0:23926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.462512:0:23926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a4230488d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a4230488d1 expref: -99 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.462533:0:23926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a4230488d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230488d1 expref: 8 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.462560:0:23926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a4230488d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230488d1 expref: 8 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.462569:0:23926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144380.462572:0:23926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144380.462576:0:23926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d200, rc 0) 00000100:00100000:3.0:1783144380.462615:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66113:x1869759501353856:12345-0@lo:101:mdt00_001.0 Request processed in 133us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.462622:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1783144380.462656:0:66113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66113:1869759501353856:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1783144380.462671:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a4230488d8 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462681:0:66113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a4230488d8 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144380.462708:0:66113:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783144380.462715:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a4230488d8 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462764:0:66113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a4230488d8 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462812:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462821:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462829:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462841:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462847:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.462853:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144380.462961:0:66113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff05180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66113:1869759501353984:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783144380.462989:0:66113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.463012:0:66113:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cf840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.463346:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501353984 00000100:00100000:3.0:1783144380.463350:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501353984 00000100:00100000:3.0:1783144380.463374:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:3.0:1783144380.463379:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66113:x1869759501353984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783144380.463437:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66113:x1869759501353984:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.463442:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1783144380.463471:0:66113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff05180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66113:1869759501353984:0@lo:1000:mdt00_001.0 00002000:00010000:0.0:1783144380.465492:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.465502:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.465516:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.465520:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.465526:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.465540:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.465549:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.465556:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.465577:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144380.465599:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144380.465607:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.465618:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144380.465623:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.465633:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.465663:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144380.465664:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.465673:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.465676:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004259800e/0xad8e53a4230488ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.465694:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.465699:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.465703:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.465706:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.465710:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.465714:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.465716:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144380.466027:0:66113:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0xd1:0x0], count =369 00000004:00080000:2.0:1783144380.466036:0:66113:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0xd1:0x0]+369 in llog 00000004:00080000:2.0:1783144380.466055:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x242:0x0], index 1: 0 00010000:00010000:0.0:1783144380.466058:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466068:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466083:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.466093:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.466097:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466105:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.466109:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466129:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466141:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466149:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000914e6147/0xad8e53a4230488f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466167:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466168:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466170:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.466216:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.466222:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466230:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.466233:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.466237:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466246:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466253:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466266:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466282:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.466290:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.466294:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466301:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.466305:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466313:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466319:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516400/0xad8e53a423048902 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466325:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466333:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516400/0xad8e53a423048902 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466336:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd277147/0xad8e53a4230488fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466351:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516400/0xad8e53a423048902 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466357:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466360:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466361:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.466389:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466397:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466404:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.466409:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144380.466410:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466415:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144380.466422:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466423:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466438:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466441:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.466449:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144380.466452:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:0.0:1783144380.466454:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466465:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144380.466467:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466471:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466489:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a4230488df lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466489:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144380.466512:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000baeb0300 reply state 000000007dd7de5a transno 81604378741 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466521:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466526:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xb1bed465 (ffff9c2afa089c00) 00010000:00010000:2.0:1783144380.466529:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144380.466531:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783144380.466559:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a4230488ca lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c56 expref: 10 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466572:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466573:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516400/0xad8e53a423048902 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c56 expref: 9 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.466593:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c2afa089400) 00010000:00010000:2.0:1783144380.466596:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144380.466598:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516400, rc 0) 00010000:00010000:0.0:1783144380.466602:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.466612:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.466617:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466625:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3ca00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.466629:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466637:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144380.466655:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:70903:x1869759481696384:12345-192.168.203.4@tcp:101:cp.0 Request processed in 5015us (5143us total) trans 81604378741 rc 0/0 00010000:00010000:0.0:1783144380.466656:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144380.466671:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1226 00010000:00010000:0.0:1783144380.466672:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078bcdc73/0xad8e53a423048910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466689:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466691:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466693:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.466815:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.466821:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466829:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.466831:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.466835:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466846:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466853:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466860:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466884:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.466891:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.466894:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466900:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.466903:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466910:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466920:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466927:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002953ce83/0xad8e53a423048917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466938:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.466942:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.466984:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.466990:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.466998:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.467007:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.467012:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467021:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467029:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467036:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467099:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.467137:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.467142:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467150:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.467153:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.467157:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467166:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467173:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467186:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467672:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783144380.467690:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144380.467696:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467709:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.467712:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.467717:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144380.467745:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467758:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467761:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467772:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b95ddd9a/0xad8e53a42304891e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467776:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.467782:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.467786:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467789:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.467795:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467799:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467806:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.467811:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467814:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467831:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467832:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467858:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467862:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.467872:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.467874:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005295074f/0xad8e53a423048925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467877:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.467887:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.467890:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.467894:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.467894:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3cc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.467900:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467909:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467920:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467927:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007037445c/0xad8e53a42304892c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.467942:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.467944:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.467945:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.467989:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.467994:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468002:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.468005:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.468009:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468016:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468030:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468037:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468057:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.468086:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.468092:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468100:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c600 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:0.0:1783144380.468101:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144380.468104:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468108:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468115:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468121:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.468130:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.468135:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468136:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468157:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d353bd3/0xad8e53a423048933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468158:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468173:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468181:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468200:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.468238:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.468242:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468249:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.468252:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.468256:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468264:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468272:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468279:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468292:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144380.468299:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144380.468303:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468309:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.468319:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468327:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468338:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468354:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a42304893a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468360:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.468365:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468370:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.468373:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.468376:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.468383:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.468387:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468395:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468408:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468415:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af8ec82/0xad8e53a423048941 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.468424:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144380.468429:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.468432:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.468433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.468436:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.468445:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.468448:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.468452:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468460:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468479:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468486:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468503:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.468558:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.468564:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468571:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.468574:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.468578:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468587:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468595:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468603:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468631:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144380.468639:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144380.468643:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468649:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.468653:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468661:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468671:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468678:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423048948 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468690:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.468693:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468699:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.468702:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468745:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468758:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468765:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011f5be2/0xad8e53a42304894f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468777:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.468779:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.468780:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.468821:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.468826:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468833:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.468836:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.468840:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468849:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468856:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468869:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468880:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.468917:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.468921:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468929:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.468932:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.468936:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468944:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468951:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468958:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.468971:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144380.468978:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144380.468981:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469000:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.469004:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469011:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469022:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469029:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423048956 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469042:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.469045:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469051:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.469054:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469061:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469068:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469081:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4331a58/0xad8e53a42304895d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469092:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.469093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.469095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.469134:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.469139:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469147:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.469150:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.469153:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469163:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469170:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469178:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469190:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.469202:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.469206:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469213:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.469216:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469223:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469234:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469241:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6e9ecb/0xad8e53a423048964 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.469255:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.469257:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.469289:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.469295:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.469300:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.469306:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469313:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.469316:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.469321:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469342:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469350:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469357:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469377:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.469407:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.469410:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469415:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.469417:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.469420:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469426:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469430:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.469431:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469439:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469462:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469463:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.469470:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469476:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.469499:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469512:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.469514:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.469524:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469528:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000282468df/0xad8e53a42304896b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469543:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.469547:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.469551:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469553:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.469560:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469565:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469572:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.469579:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469580:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469601:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469604:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469613:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.469618:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469626:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef7aa148/0xad8e53a423048972 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.469642:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.469646:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469650:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.469657:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469661:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.469666:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.469674:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469675:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.469681:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469685:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469698:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469699:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469718:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469753:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469759:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.469766:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4bc182c/0xad8e53a423048979 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469785:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.469789:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469796:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.469799:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.469806:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.469813:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469826:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469827:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.469835:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.469844:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469849:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.469852:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.469855:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469866:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000206d1dec/0xad8e53a423048980 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469884:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.469889:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.469893:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.469895:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469901:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.469910:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.469916:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.469921:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.469921:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.469931:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.469934:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469943:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469954:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.469962:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.469973:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.469975:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e77c7ba/0xad8e53a423048987 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.469987:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1783144380.469990:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.469994:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.469997:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470011:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.470019:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.470019:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.470021:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481696512 00010000:00010000:2.0:1783144380.470023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.470027:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144380.470028:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481696512 00010000:00010000:0.0:1783144380.470029:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470048:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.470082:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.470087:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.470088:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4969 00010000:00010000:0.0:1783144380.470094:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=2914s v=(0 0) 00000100:00100000:3.0:1783144380.470097:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481696512:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:0.0:1783144380.470097:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.470101:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470108:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.470112:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144380.470114:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470121:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.470123:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c5d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470133:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144380.470138:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144380.470142:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470149:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.470158:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470166:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470176:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470183:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ebb139/0xad8e53a42304898e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470195:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.470198:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470204:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.470206:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470213:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470220:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470227:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a1eb006/0xad8e53a423048995 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470245:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.470246:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.470248:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.470287:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.470292:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470299:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.470302:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.470306:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470314:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470322:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470330:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470339:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.470373:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.470378:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470397:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.470400:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.470404:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470412:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470420:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470427:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470439:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144380.470446:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144380.470449:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470455:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.470458:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470464:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470483:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470489:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001446fa58/0xad8e53a4230489a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470501:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.470504:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470510:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.470512:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470519:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470529:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470535:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a4230489aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470546:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.470547:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.470554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.470593:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.470599:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470606:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.470609:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.470612:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470621:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470629:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470636:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470648:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.470654:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.470658:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470664:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.470667:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470684:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470693:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470699:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e258ec/0xad8e53a4230489b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470712:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.470713:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.470715:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.470914:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.470919:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470927:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.470930:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.470934:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470943:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470950:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470963:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470976:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.470983:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.470986:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.470994:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.470997:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471005:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144380.471009:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.471015:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471022:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab42ea08/0xad8e53a4230489b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471033:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.471034:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.471035:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.471037:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.471037:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.471044:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.471059:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.471072:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144380.471076:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47dc00, rc 0) 00010000:00010000:0.0:1783144380.471080:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471087:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.471089:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.471093:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471100:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471106:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471112:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471123:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783144380.471124:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2404:x1869759481696512:12345-192.168.203.4@tcp:101:cp.0 Request processed in 1028us (1141us total) trans 0 rc 0/0 00010000:00010000:0.0:1783144380.471129:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.471132:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471138:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.471142:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471150:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471166:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471173:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b920c333/0xad8e53a4230489bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471187:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471188:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471190:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144380.471229:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4969 00002000:00010000:0.0:1783144380.471230:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.471234:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471241:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.471244:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.471248:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471257:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471264:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471271:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783144380.471276:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783144380.471285:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.471291:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471299:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.471309:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.471312:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471319:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.471321:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471328:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471338:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471345:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf90e6fe/0xad8e53a4230489c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.471349:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471357:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471358:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471360:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144380.471395:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.471398:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471403:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.471408:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.471411:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471417:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471422:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471426:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471470:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144380.471502:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.471516:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471523:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.471526:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.471530:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471539:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471547:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471560:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471634:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144380.471638:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471643:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.471645:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471650:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471657:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471663:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3ebe81a/0xad8e53a4230489cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471688:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.471691:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471696:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.471698:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471702:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471708:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471712:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.471713:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.471715:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471846:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783144380.471850:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005af429d7/0xad8e53a4230489d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144380.471884:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.471887:0:26149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471892:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.471894:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.471898:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471907:0:26149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471912:0:26149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.471916:0:26149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471945:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.471948:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471952:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.471954:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471965:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471971:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.471976:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.471977:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.471978:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.471998:0:26149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783144380.472003:0:26149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1d5842/0xad8e53a4230489db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.472015:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783144380.472228:0:26149:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1794 00000100:00100000:0.0:1783144380.472280:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:92287:x1869759501353600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12861us (13166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.472288:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4967 00000100:00100000:3.0:1783144380.472328:0:92287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b37800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92287:1869759501353600:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783144380.472342:0:92287:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x702:0x0] 00000100:00100000:2.0:1783144380.472402:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144380.472410:0:92287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92287:1869759501354240:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783144380.472412:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501354112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144380.472440:0:92287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.472440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.472459:0:92287:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144380.472470:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501354112 00000100:00100000:3.0:1783144380.472471:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501354240 00000100:00100000:3.0:1783144380.472474:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501354240 00000100:00100000:2.0:1783144380.472474:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501354112 00000100:00100000:2.0:1783144380.472500:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:2.0:1783144380.472560:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501354112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783144380.472580:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144380.472614:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501354112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.472617:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4970 00000100:00100000:2.0:1783144380.472620:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:3.0:1783144380.472624:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:92287:x1869759501354240:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783144380.472648:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501354112:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1783144380.472666:0:26147:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00002000:00010000:1.0:1783144380.473044:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.473053:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473061:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.473064:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.473067:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473082:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473088:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473093:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473106:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.473130:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.473136:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.473145:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.473150:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.473158:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.473159:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473164:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473179:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.473181:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473183:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.473193:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.473196:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230489e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473214:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473230:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.473245:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.473246:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.473249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.473253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.473265:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.473290:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.473295:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473312:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.473315:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473324:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473337:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.473340:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.473348:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473350:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a4230489e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473362:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.473366:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.473369:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473374:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.473376:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473377:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.473381:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.473386:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473391:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473407:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.473421:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.473427:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473435:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.473438:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.473441:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.473452:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473453:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473462:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.473469:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.473477:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473483:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473485:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473503:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473506:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a4230489f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473511:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473526:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144380.473559:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.473563:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473568:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.473573:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.473579:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473587:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473593:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.473599:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473604:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473613:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144380.473616:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473619:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473626:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.473630:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473642:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473650:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a4230489f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.473661:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144380.473663:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144380.473666:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473668:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473673:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.473678:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.473685:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473689:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144380.473693:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473694:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473708:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473712:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473715:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473768:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144380.473811:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.473818:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.473825:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473827:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.473836:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144380.473844:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a4230489fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473845:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473860:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473868:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473874:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473882:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783144380.473968:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.473973:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.473978:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.473985:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.473988:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474049:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474059:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474066:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474077:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783144380.474123:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.474129:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474137:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474140:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474143:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474152:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474160:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474173:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474181:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783144380.474217:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.474222:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474230:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474233:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474236:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474245:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474252:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474256:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474262:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783144380.474332:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.474335:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474344:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474346:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474348:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474354:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474359:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474363:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474368:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783144380.474392:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.474395:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474399:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474401:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474403:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474408:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474420:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474425:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474429:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783144380.474454:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.474457:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474461:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474463:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474466:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474472:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474477:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474481:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474493:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783144380.474515:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.474517:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474522:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474524:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474526:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474532:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474536:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474540:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474544:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783144380.474560:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.474562:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474566:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474576:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474579:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474585:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474590:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474591:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783144380.474599:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474600:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474619:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1783144380.474625:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.474630:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474638:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474651:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.474661:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144380.474666:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423048a05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474668:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474685:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.474688:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144380.474692:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1783144380.474693:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474697:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474709:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474710:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.474716:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474752:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474766:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474775:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1783144380.474819:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.474820:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00002000:00010000:1.0:1783144380.474822:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.474829:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474833:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474846:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.474853:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144380.474859:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.474860:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474863:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a423048a0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474867:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.474878:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474887:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1783144380.474891:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474894:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.474900:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474916:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.474921:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474927:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.474934:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423048a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474942:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.474949:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:92287:x1869759501354240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2323us (2506us total) trans 4294968829 rc 0/0 00010000:00010000:0.0:1783144380.474957:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:3.0:1783144380.474958:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4970 00010000:00010000:2.0:1783144380.474958:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.474965:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474968:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423048a1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.474980:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.474991:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.474993:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783144380.475000:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475004:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475014:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.475020:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475024:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475034:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475049:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423048a21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475055:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475065:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783144380.475066:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a423048a28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475070:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475093:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fe00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144380.475096:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475097:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475105:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783144380.475112:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475125:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475125:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475127:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.475133:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475152:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783144380.475152:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475169:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475171:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096407d5a/0xad8e53a423048a2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475187:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475193:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783144380.475200:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475201:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a423048a36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.475201:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.475213:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475224:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.475230:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475233:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:2.0:1783144380.475235:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783144380.475241:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475243:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.475248:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475252:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475265:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.475271:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475288:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475291:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475305:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8f8f01/0xad8e53a423048a3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475312:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475318:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144380.475321:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a423048a44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475323:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475341:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.475345:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475351:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.475356:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475378:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144380.475379:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475379:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475384:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475408:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475411:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475411:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475428:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423048a4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475439:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475443:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475448:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.475453:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.475457:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.475459:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423048a52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475459:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783144380.475462:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475479:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.475483:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475502:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.475507:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.475513:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475515:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475534:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.475541:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.475550:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.475552:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92dff90/0xad8e53a423048a59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475572:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475594:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475601:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475610:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144380.475648:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.475655:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475663:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.475665:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1783144380.475668:0:92287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92287:1869759501354240:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783144380.475671:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475684:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144380.475685:0:92287:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00000100:00100000:3.0:1783144380.475762:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.475788:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481696640 00000100:00100000:3.0:1783144380.475800:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481696640 00010000:00010000:2.0:1783144380.475809:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.475813:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475820:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.475823:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.475830:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4971 00010000:00010000:2.0:1783144380.475831:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.475837:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:70903:x1869759481696640:12345-192.168.203.4@tcp:101:cp.0 00010000:00010000:2.0:1783144380.475841:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.475847:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a423048a60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.475850:0:26152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.475859:0:26152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c64 expref: -99 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.475877:0:26152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.475885:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144380.475888:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144380.475892:0:26152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 7 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.475916:0:26152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475919:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.475935:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.475937:0:26152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 7 pid: 8437 timeout: 3014 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.475960:0:26152:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:26152:1869759501354368:192.168.203.4@tcp:104: 00010000:00010000:1.0:1783144380.475975:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783144380.476020:0:26152:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1783144380.476033:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.476039:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476046:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.476050:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.476053:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476061:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476069:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476076:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476084:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783144380.476116:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.476121:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476127:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.476135:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.476139:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476148:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476155:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476162:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476170:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783144380.476206:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.476212:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476213:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783144380.476221:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476223:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.476227:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144380.476232:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.476235:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476240:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144380.476241:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476247:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476251:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.476258:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476267:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476279:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476293:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476305:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476307:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476310:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476330:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a423048a75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476334:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423048a67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476336:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476357:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144380.476362:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.476362:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476370:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.476372:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.476375:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476384:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476387:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.476394:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476397:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.476403:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144380.476414:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476416:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476420:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476439:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.476441:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a423048a7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476444:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476444:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.476453:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476468:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.476469:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a423048a83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476472:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.476473:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476476:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.476485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.476491:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476508:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476527:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.476561:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783144380.476563:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144380.476566:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476570:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476571:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.476575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.476576:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.476580:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.476583:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476591:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.476595:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.476600:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.476601:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476607:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476615:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476629:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a423048a8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476641:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.476644:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.476646:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.476656:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476665:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476672:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476688:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783144380.476752:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.476758:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476766:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.476769:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.476773:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144380.476774:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476781:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476787:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476792:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.476797:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476810:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476819:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476825:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476831:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.476837:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a423048a91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476855:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144380.476856:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.476861:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476875:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783144380.476894:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.476899:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476906:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.476909:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.476912:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476921:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476928:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476935:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.476958:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.476966:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.476972:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476982:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.476986:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.476995:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.476995:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.477005:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477012:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477012:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.477015:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.477022:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477029:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a77ac1a0/0xad8e53a423048a9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477033:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477046:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477051:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477054:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.477058:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.477062:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477062:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144380.477085:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.477089:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.477093:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.477101:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477102:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477115:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:2.0:1783144380.477123:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477123:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.477129:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477138:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9b4bf32/0xad8e53a423048aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477142:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477153:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477158:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.477158:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477162:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.477165:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.477175:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.477182:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.477188:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477195:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.477198:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477206:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.477213:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.477223:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477226:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477235:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.477240:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144380.477242:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354870b6/0xad8e53a423048aad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477244:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477266:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477272:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.477272:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477275:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.477277:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144380.477284:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477294:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144380.477300:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144380.477305:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477313:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144380.477316:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144380.477319:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783144380.477327:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477330:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477332:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:1.0:1783144380.477339:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144380.477346:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477350:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477353:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477365:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000475aac8/0xad8e53a423048ab4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477366:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.477382:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.477398:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.477400:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144380.477402:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.477619:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.477622:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.477630:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.477641:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.477648:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007edc1837/0xad8e53a423048a98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.477663:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.477666:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.477668:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.477672:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.478056:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144380.478081:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144380.478087:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478107:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519200 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:0.0:1783144380.478108:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144380.478111:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.478116:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478125:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.478128:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=2914s v=(0 0) 00010000:00010000:0.0:1783144380.478137:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144380.478143:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478146:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478155:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3df8ebe/0xad8e53a423048abb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.478178:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478185:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.478188:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.478189:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478191:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.478199:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.478215:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144380.478224:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144380.478229:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478237:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144380.478241:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478249:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478269:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478277:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da2a500a/0xad8e53a423048ac2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478292:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144380.478295:0:26152:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:26152:1869759501354368:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144380.478296:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.478301:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144380.478306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1783144380.478329:0:26152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 7 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.478336:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481696768 00000100:00100000:3.0:1783144380.478343:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481696768 00010000:00010000:1.0:1783144380.478361:0:26152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47cc00, rc 0) 00000100:00100000:1.0:1783144380.478421:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:70903:x1869759481696640:12345-192.168.203.4@tcp:101:cp.0 Request processed in 2582us (2658us total) trans 0 rc 0/0 00010000:00010000:3.0:1783144380.478426:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 8 pid: 8437 timeout: 3014 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144380.478438:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4971 00000100:00100000:3.0:1783144380.478466:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2548 00000100:00100000:3.0:1783144380.478479:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481696768:12345-192.168.203.4@tcp:103:ldlm_bl.0 00002000:00080000:0.0:1783144380.478503:0:8435:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1795 00000100:00100000:0.0:1783144380.478552:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:92289:x1869759501353728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18999us (19317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.478560:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968 00010000:00010000:3.0:1783144380.478562:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144380.478580:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 7 pid: 8437 timeout: 3014 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144380.478593:0:92289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92289:1869759501353728:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1783144380.478595:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 7 pid: 8437 timeout: 3014 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783144380.478607:0:92289:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x703:0x0] 00010000:00010000:3.0:1783144380.478617:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eea59d1/0xad8e53a42304899c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c5d expref: 7 pid: 8437 timeout: 3014 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478642:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144380.478645:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144380.478653:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 6 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.478663:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 6 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144380.478674:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501354496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144380.478675:0:92289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92289:1869759501354624:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1783144380.478691:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 6 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.478704:0:6507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1869759501354752:192.168.203.4@tcp:105: 00000100:00100000:1.0:1783144380.478759:0:92289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144380.479103:0:92289:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144380.479114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.479123:0:6507:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783144380.479153:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501354624 00000100:00100000:1.0:1783144380.479158:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501354624 00000100:00100000:0.0:1783144380.479161:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501354496 00000100:00100000:0.0:1783144380.479167:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501354496 00000100:00100000:1.0:1783144380.479192:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4972 00000100:00100000:1.0:1783144380.479203:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:92289:x1869759501354624:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783144380.479206:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1783144380.479218:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501354496:12345-0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1783144380.479236:0:26145:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00002000:00000024:0.0:1783144380.479237:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144380.479421:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501354496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.479429:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:2.0:1783144380.479481:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501354496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144380.480288:0:6507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1869759501354752:192.168.203.4@tcp:105: 00010000:00010000:3.0:1783144380.480302:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144380.480333:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2403:x1869759481696768:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1857us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.480346:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2548 00000100:00100000:0.0:1783144380.480911:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.480986:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481697024 00000100:00100000:3.0:1783144380.480991:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481697024 00000100:00100000:3.0:1783144380.481054:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:3.0:1783144380.481064:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:70903:x1869759481697024:12345-192.168.203.4@tcp:35:cp.0 00000100:00100000:1.0:1783144380.481079:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:92289:x1869759501354624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1877us (2355us total) trans 4294968828 rc 0/0 00000100:00100000:1.0:1783144380.481087:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4972 00000100:00100000:2.0:1783144380.481112:0:92289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92289:1869759501354624:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783144380.481123:0:92289:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00000001:00080000:3.0:1783144380.481235:0:66115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 81604378742 00000100:00100000:3.0:1783144380.481292:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:70903:x1869759481697024:12345-192.168.203.4@tcp:35:cp.0 Request processed in 230us (382us total) trans 81604378743 rc 0/0 00000100:00100000:3.0:1783144380.481305:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 228 00000020:00080000:3.0:1783144380.481309:0:66115:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783144380.489638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.489799:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481697152 00000100:00100000:3.0:1783144380.489808:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481697152 00000100:00100000:3.0:1783144380.489875:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1227 00000100:00100000:3.0:1783144380.489886:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71168:x1869759481697152:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1783144380.489906:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.489928:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47dc00/0xad8e53a423048ac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c6b expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144380.491474:0:81077:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1498us 00010000:00010000:3.0:1783144380.499643:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.499675:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.499685:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.499698:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.499704:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.499710:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.499856:0:81077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:81077:1869759501354880:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783144380.499927:0:81077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.499953:0:81077:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144380.500018:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501354880 00000100:00100000:0.0:1783144380.500025:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501354880 00000100:00100000:0.0:1783144380.500073:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:0.0:1783144380.500082:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:81077:x1869759501354880:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783144380.500167:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:81077:x1869759501354880:12345-0@lo:1000:mdt00_005.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.500175:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1783144380.500435:0:81077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:81077:1869759501354880:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783144380.500474:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048ade lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500483:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048ade lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500501:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048ade lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144380.500534:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048ade lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500546:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500552:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500558:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500565:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144380.500569:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500576:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500586:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144380.500596:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144380.500602:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500609:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47c400/0xad8e53a423048ad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500623:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500629:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500634:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500639:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47de00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144380.500642:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500648:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500666:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2ae00b1600) 00010000:00010000:3.0:1783144380.500668:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144380.500671:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500675:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47de00/0xad8e53a423048ad7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500710:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47dc00/0xad8e53a423048ac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c6b expref: 9 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500766:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048ade lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c6b expref: 8 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.500774:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2ae00b1100) 00010000:00010000:3.0:1783144380.500776:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144380.500778:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee47d000, rc 0) 00000100:00100000:3.0:1783144380.500825:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71168:x1869759481697152:12345-192.168.203.4@tcp:101:rm.0 Request processed in 10941us (11197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.500832:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1227 00000100:00100000:2.0:1783144380.503285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144380.503355:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481697280 00000100:00100000:0.0:1783144380.503361:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481697280 00000100:00100000:0.0:1783144380.503484:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1228 00000100:00100000:0.0:1783144380.503492:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:71168:x1869759481697280:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1783144380.503521:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144380.503538:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ae5 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c72 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.503581:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048aec lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.503593:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048aec lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.503602:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048aec lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144380.503641:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783144380.503644:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783144380.503681:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ae5 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c72 expref: 14 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.503715:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048aec lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c72 expref: 13 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.503767:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:0.0:1783144380.503770:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783144380.503774:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6ec00, rc 0) 00000100:00100000:0.0:1783144380.503820:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71168:x1869759481697280:12345-192.168.203.4@tcp:101:rm.0 Request processed in 328us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.503826:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1228 00000100:00100000:2.0:1783144380.507277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.508622:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481697536 00000100:00100000:3.0:1783144380.508633:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481697536 00000100:00100000:3.0:1783144380.508688:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1229 00000100:00100000:3.0:1783144380.508699:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71168:x1869759481697536:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1783144380.508719:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.508773:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c79 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144380.508871:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783144380.508966:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048af3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c79 expref: 15 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.508981:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2ae00b1d00) 00010000:00010000:3.0:1783144380.508985:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144380.508990:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c79 expref: 15 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.509023:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01600, rc 0) 00000100:00100000:3.0:1783144380.509083:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71168:x1869759481697536:12345-192.168.203.4@tcp:101:rm.0 Request processed in 385us (1813us total) trans 81604378744 rc 301/301 00000100:00100000:3.0:1783144380.509090:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1229 00000100:00100000:2.0:1783144380.513322:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.513378:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481697664 00000100:00100000:3.0:1783144380.513386:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481697664 00000100:00100000:3.0:1783144380.513427:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:3.0:1783144380.513436:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71168:x1869759481697664:12345-192.168.203.4@tcp:37:rm.0 00000100:00100000:0.0:1783144380.514175:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144380.514286:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144380.514347:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481697920 00000100:00100000:1.0:1783144380.514353:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481697920 00000100:00100000:1.0:1783144380.514400:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4973 00000100:00100000:1.0:1783144380.514410:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2402:x1869759481697920:12345-192.168.203.4@tcp:9:kworker.0 00000100:00080000:2.0:1783144380.514426:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1783144380.514432:0:26143:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230485f9 00000100:00080000:1.0:1783144380.514440:0:26143:0:(import.c:65:import_set_state_nolock()) ffff9c29c443b800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783144380.514461:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481697792 00000100:00100000:3.0:1783144380.514466:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481697792 00000100:00100000:3.0:1783144380.514498:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:3.0:1783144380.514506:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2403:x1869759481697792:12345-192.168.203.4@tcp:400:kworker.0 00000001:00000004:1.0:1783144380.514514:0:26143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968829 00010000:00010000:2.0:1783144380.514553:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144380.514642:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+2:2402:x1869759481697920:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 232us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.514650:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2403:x1869759481697792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 142us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144380.514657:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4973 00000100:00100000:3.0:1783144380.514665:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:0.0:1783144380.516593:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71168:x1869759481697664:12345-192.168.203.4@tcp:37:rm.0 Request processed in 3153us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.516602:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 229 00000100:00100000:0.0:1783144380.520460:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.521073:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481698176 00000100:00100000:3.0:1783144380.521082:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481698176 00000100:00100000:3.0:1783144380.521126:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:3.0:1783144380.521135:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71168:x1869759481698176:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1783144380.521341:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:71168:x1869759481698176:12345-192.168.203.4@tcp:35:rm.0 Request processed in 206us (888us total) trans 81604378745 rc 0/0 00000100:00100000:3.0:1783144380.521350:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 230 00000100:00100000:1.0:1783144380.523405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144380.523491:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481698432 00000100:00100000:2.0:1783144380.523498:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481698432 00000100:00100000:2.0:1783144380.523553:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1230 00000100:00100000:2.0:1783144380.523566:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:71168:x1869759481698432:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1783144380.523587:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144380.523609:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048b01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c80 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.523702:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517200/0xad8e53a423048b08 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.523771:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517200/0xad8e53a423048b08 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.523783:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517200/0xad8e53a423048b08 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144380.523795:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783144380.523879:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048b01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c80 expref: 18 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.523896:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517200/0xad8e53a423048b08 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c80 expref: 17 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.523905:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144380.523908:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783144380.523911:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517200, rc 0) 00000100:00100000:2.0:1783144380.523956:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:71168:x1869759481698432:12345-192.168.203.4@tcp:101:rm.0 Request processed in 394us (558us total) trans 81604378746 rc 0/0 00000100:00100000:2.0:1783144380.523962:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1230 00000100:00100000:2.0:1783144380.526389:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.526538:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481698560 00000100:00100000:3.0:1783144380.526546:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481698560 00000100:00100000:3.0:1783144380.527077:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1231 00000100:00100000:3.0:1783144380.527089:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:71168:x1869759481698560:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1783144380.527111:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.527127:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b16 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c87 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.527185:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048b1d lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.527198:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048b1d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.527209:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048b1d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144380.527249:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1783144380.527253:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144380.527272:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048b1d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.527296:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b16 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c87 expref: 19 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.527311:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048b1d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c87 expref: 18 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.527319:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:3.0:1783144380.527322:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144380.527325:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01000, rc 0) 00000100:00100000:3.0:1783144380.527421:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:71168:x1869759481698560:12345-192.168.203.4@tcp:101:rm.0 Request processed in 334us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.527435:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1231 00000100:00100000:0.0:1783144380.530990:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144380.531151:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481698816 00000100:00100000:2.0:1783144380.531160:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481698816 00000100:00100000:2.0:1783144380.531212:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1232 00000100:00100000:2.0:1783144380.531223:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:71168:x1869759481698816:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1783144380.531242:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144380.531259:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048b24 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c8e expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144380.531366:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1783144380.531454:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048b24 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c8e expref: 20 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.531468:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144380.531472:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783144380.531477:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048b24 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c8e expref: 20 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.531489:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516600, rc 0) 00000100:00100000:2.0:1783144380.531543:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:71168:x1869759481698816:12345-192.168.203.4@tcp:101:rm.0 Request processed in 322us (561us total) trans 81604378747 rc 301/301 00000100:00100000:2.0:1783144380.531549:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1232 00000100:00100000:1.0:1783144380.533904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144380.533977:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481698944 00000100:00100000:0.0:1783144380.533985:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481698944 00000100:00100000:0.0:1783144380.534025:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:0.0:1783144380.534035:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:71168:x1869759481698944:12345-192.168.203.4@tcp:37:rm.0 00000100:00100000:2.0:1783144380.536516:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:71168:x1869759481698944:12345-192.168.203.4@tcp:37:rm.0 Request processed in 2475us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144380.536528:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 231 00000100:00100000:2.0:1783144380.538812:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.538877:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481699200 00000100:00100000:3.0:1783144380.538885:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481699200 00000100:00100000:3.0:1783144380.538934:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:3.0:1783144380.538945:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:71168:x1869759481699200:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1783144380.539163:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:71168:x1869759481699200:12345-192.168.203.4@tcp:35:rm.0 Request processed in 219us (357us total) trans 81604378748 rc 0/0 00000100:00100000:3.0:1783144380.539172:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 232 00000100:00100000:1.0:1783144380.541127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.541198:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481699456 00000100:00100000:3.0:1783144380.541206:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481699456 00000100:00100000:3.0:1783144380.541249:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1233 00000100:00100000:3.0:1783144380.541260:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:71168:x1869759481699456:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1783144380.541282:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.541301:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b32 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c95 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.541392:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00000/0xad8e53a423048b39 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.541406:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00000/0xad8e53a423048b39 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.541417:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00000/0xad8e53a423048b39 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144380.541427:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1783144380.541511:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b32 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c95 expref: 23 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.541548:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00000/0xad8e53a423048b39 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c95 expref: 22 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.541556:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:3.0:1783144380.541559:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783144380.541562:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00000, rc 0) 00000100:00100000:3.0:1783144380.541611:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:71168:x1869759481699456:12345-192.168.203.4@tcp:101:rm.0 Request processed in 353us (487us total) trans 81604378749 rc 0/0 00000100:00100000:3.0:1783144380.541618:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1233 00000100:00100000:0.0:1783144380.546218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144380.546807:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481699584 00000100:00100000:2.0:1783144380.546816:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481699584 00000100:00100000:2.0:1783144380.546879:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1234 00000100:00100000:2.0:1783144380.546893:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71168:x1869759481699584:12345-192.168.203.4@tcp:41:rm.0 00000004:00000024:2.0:1783144380.546940:0:66112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382962176 00000100:00100000:2.0:1783144380.547014:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71168:x1869759481699584:12345-192.168.203.4@tcp:41:rm.0 Request processed in 125us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144380.547021:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1234 00000100:00100000:2.0:1783144380.550231:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.550313:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481699840 00000100:00100000:3.0:1783144380.550322:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481699840 00000100:00100000:3.0:1783144380.550374:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1235 00000100:00100000:3.0:1783144380.550383:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:71168:x1869759481699840:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1783144380.550428:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783144380.550449:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516400/0xad8e53a423048902 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c56 expref: 22 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550465:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c2afa089400) 00010000:00010000:3.0:1783144380.550478:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048b1d lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c87 expref: 21 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550485:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:3.0:1783144380.550487:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144380.550500:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550522:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550528:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550535:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550539:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550543:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550623:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550631:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550638:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783144380.550877:0:66143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4e:0x0].2, 64 off8320 00000004:00080000:3.0:1783144380.550884:0:66143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 2914904161894ns, next at 2915904160554ns, rc = 0 00010000:00010000:3.0:1783144380.550915:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550921:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550933:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550939:0:66143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550943:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550946:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550956:0:66143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144380.550967:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550971:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550974:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550978:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144380.550980:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550984:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.550989:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c2ae00b1d00) 00010000:00010000:3.0:1783144380.550991:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783144380.550997:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551001:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b55 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551010:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551014:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 2/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551017:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551020:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144380.551021:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551024:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551028:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:3.0:1783144380.551029:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144380.551031:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551034:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01200/0xad8e53a423048b47 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144380.551038:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000109e2812 reply state 00000000bc9fcfa9 transno 81604378750 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551062:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.551066:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xb1bed465 (ffff9c2afa089c00) 00010000:00010000:3.0:1783144380.551067:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144380.551069:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783144380.551123:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:71168:x1869759481699840:12345-192.168.203.4@tcp:36:rm.0 Request processed in 742us (900us total) trans 81604378750 rc 0/0 00000100:00100000:3.0:1783144380.551128:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1235 00010000:00010000:0.0:1783144380.551200:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144380.551208:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.551214:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144380.551223:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.551228:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.551234:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c2ae00b1d00) 00010000:00010000:0.0:1783144380.551235:0:9525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783144380.551237:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 1/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.551240:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048b5c lrc: 0/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.551250:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.551251:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.551252:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144380.555172:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144380.555329:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481700096 00000100:00100000:2.0:1783144380.555338:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481700096 00000100:00100000:2.0:1783144380.555388:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:2.0:1783144380.555398:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:71168:x1869759481700096:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:2.0:1783144380.555596:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:71168:x1869759481700096:12345-192.168.203.4@tcp:35:rm.0 Request processed in 200us (433us total) trans 81604378751 rc 0/0 00000100:00100000:2.0:1783144380.555605:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 233 00000100:00100000:2.0:1783144380.557347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144380.557402:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481700352 00000100:00100000:1.0:1783144380.557408:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481700352 00000100:00100000:1.0:1783144380.557449:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1236 00000100:00100000:1.0:1783144380.557459:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:71168:x1869759481700352:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:1.0:1783144380.557507:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783144380.557533:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00000/0xad8e53a423048b39 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c95 expref: 23 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557556:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0000/0xad8e53a423048654 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c25 expref: 22 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557569:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c2ac3bccf00) 00010000:00010000:1.0:1783144380.557583:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048aec lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c72 expref: 21 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557593:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:1.0:1783144380.557596:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144380.557615:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557646:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557655:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557672:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,1 mode: --/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557680:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557687:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557798:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557807:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.557817:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144380.558035:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1783144380.558049:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558056:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558063:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558076:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144380.558080:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558088:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558097:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9c29ca602600) 00010000:00010000:1.0:1783144380.558100:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783144380.558104:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558110:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519000/0xad8e53a423048b71 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558129:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558135:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558141:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558147:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558152:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144380.558155:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558172:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558194:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:1.0:1783144380.558197:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144380.558200:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558207:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1518800/0xad8e53a423048b63 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144380.558219:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006eddb794 reply state 000000000ea26dcc transno 81604378752 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558230:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.558237:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xf7117594 (ffff9c29ca602000) 00010000:00010000:1.0:1783144380.558240:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144380.558242:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144380.558316:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:71168:x1869759481700352:12345-192.168.203.4@tcp:36:rm.0 Request processed in 858us (971us total) trans 81604378752 rc 0/0 00000100:00100000:1.0:1783144380.558324:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1236 00000100:00100000:0.0:1783144380.561006:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144380.561041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.561062:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481700480 00000100:00100000:3.0:1783144380.561071:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481700480 00000100:00100000:1.0:1783144380.561082:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481700736 00000100:00100000:1.0:1783144380.561088:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481700736 00000100:00100000:1.0:1783144380.561119:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:3.0:1783144380.561124:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 706 00000100:00100000:3.0:1783144380.561136:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2403:x1869759481700480:12345-192.168.203.4@tcp:103:rm.0 00010000:00010000:3.0:1783144380.561151:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144380.561181:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d000/0xad8e53a423048ade lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c6b expref: 8 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.561198:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2ae00b1100) 00010000:00010000:3.0:1783144380.561206:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144380.561251:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481700480:12345-192.168.203.4@tcp:103:rm.0 Request processed in 118us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.561259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 706 00000100:00100000:1.0:1783144380.561372:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:71168:x1869759481700736:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:1.0:1783144380.561534:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:71168:x1869759481700736:12345-192.168.203.4@tcp:35:rm.0 Request processed in 407us (492us total) trans 81604378753 rc 0/0 00000100:00100000:1.0:1783144380.561555:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 234 00000100:00100000:0.0:1783144380.564337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144380.564504:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481700992 00000100:00100000:3.0:1783144380.564513:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481700992 00000100:00100000:3.0:1783144380.564559:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1237 00000100:00100000:3.0:1783144380.564567:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:71168:x1869759481700992:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:3.0:1783144380.564637:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783144380.564659:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517200/0xad8e53a423048b08 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c80 expref: 23 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.564676:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517000/0xad8e53a423048638 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c1e expref: 22 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.564686:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:3.0:1783144380.564695:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144380.564772:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.564781:0:66112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.564790:0:66112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.564810:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355008:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1783144380.564865:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.564889:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac1377cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.564918:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501355008 00000100:00100000:3.0:1783144380.564921:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501355008 00000100:00100000:3.0:1783144380.564955:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1783144380.564961:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66112:x1869759501355008:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783144380.564970:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.564981:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048b78 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.565529:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 6 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.565539:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.565562:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 6 pid: 92301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.565573:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 6 pid: 92301 timeout: 3014 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144380.565594:0:8446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8446:1869759501355136:192.168.203.4@tcp:104: 00000100:00100000:0.0:1783144380.566191:0:8446:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144380.568012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144380.568058:0:8446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8446:1869759501355136:192.168.203.4@tcp:104: 00000100:00100000:1.0:1783144380.568087:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481701120 00010000:00010000:0.0:1783144380.568089:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144380.568096:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481701120 00010000:00010000:0.0:1783144380.568104:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:0.0:1783144380.568108:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144380.568112:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.568121:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00e00, rc 0) 00010000:00010000:1.0:1783144380.568127:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 7 pid: 92301 timeout: 3014 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144380.568164:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2549 00000100:00100000:1.0:1783144380.568175:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481701120:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783144380.568183:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66112:x1869759501355008:12345-0@lo:101:mdt00_000.0 Request processed in 3220us (3315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.568190:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00010000:00010000:1.0:1783144380.568198:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144380.568206:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 7 pid: 92301 timeout: 3014 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.568218:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 7 pid: 92301 timeout: 3014 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.568239:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516000/0xad8e53a4230488c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c10 expref: 7 pid: 92301 timeout: 3014 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.568255:0:26153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:1.0:1783144380.568261:0:26153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.568270:0:26153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.568280:0:26153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144380.568301:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355008:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783144380.568318:0:66112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144380.568320:0:26153:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.568343:0:66112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144380.568347:0:26153:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26153:1869759501355264:0@lo:105: 00000100:00100000:1.0:1783144380.568382:0:26153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144380.568421:0:26153:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5f3c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.568441:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501355264 00000100:00100000:3.0:1783144380.568447:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501355264 00000100:00100000:3.0:1783144380.568482:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783144380.568490:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:26153:x1869759501355264:12345-0@lo:105: 00010000:00010000:3.0:1783144380.568499:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.568507:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.568515:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.568522:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.568529:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.568550:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.568571:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c2aeed01200) 00000100:00100000:3.0:1783144380.568610:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:26153:x1869759501355264:12345-0@lo:105: Request processed in 121us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.568617:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1783144380.568808:0:26153:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26153:1869759501355264:0@lo:105: 00010000:00010000:1.0:1783144380.568819:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144380.568855:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2404:x1869759481701120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 683us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144380.568862:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2549 00010000:00010000:2.0:1783144380.569363:0:66112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.569374:0:66112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144380.569446:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783144380.569481:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.569488:0:66112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.569497:0:66112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144380.569512:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355392:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1783144380.569539:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.569560:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.569569:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501355392 00000100:00100000:3.0:1783144380.569574:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501355392 00000100:00100000:3.0:1783144380.569610:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1783144380.569617:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66112:x1869759501355392:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783144380.569631:0:23926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144380.569641:0:23926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048b8d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048b86 expref: -99 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.569654:0:23926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048b8d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048b86 expref: 10 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.569661:0:23926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048b8d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048b86 expref: 10 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.569666:0:23926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2ae00b1100) 00010000:00010000:3.0:1783144380.569668:0:23926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144380.569669:0:23926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01000, rc 0) 00000100:00100000:3.0:1783144380.569694:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501355392:12345-0@lo:101:mdt00_000.0 Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.569705:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:2.0:1783144380.569851:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355392:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783144380.569863:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.569872:0:66112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144380.569883:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1783144380.569910:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355520:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144380.569935:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.569984:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016900 going to sleep for 11 seconds 00000100:00100000:1.0:1783144380.570066:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501355520 00000100:00100000:1.0:1783144380.570071:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501355520 00000100:00100000:1.0:1783144380.570102:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:1.0:1783144380.570108:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501355520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783144380.570245:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501355520:12345-0@lo:1000:mdt00_000.0 Request processed in 136us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144380.570252:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:2.0:1783144380.570291:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355520:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144380.570326:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144380.570345:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.570362:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144380.570372:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501355648 00000100:00100000:3.0:1783144380.570377:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501355648 00000100:00100000:3.0:1783144380.570401:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1783144380.570406:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501355648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783144380.570492:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501355648:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (145us total) trans 0 rc 1/1 00000100:00100000:3.0:1783144380.570497:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:2.0:1783144380.570522:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355648:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783144380.570558:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.570565:0:66112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.570572:0:66112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144380.570582:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355776:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1783144380.570602:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144380.570656:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:0.0:1783144380.570694:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501355776 00000100:00100000:0.0:1783144380.570698:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501355776 00000100:00100000:0.0:1783144380.570880:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:0.0:1783144380.570888:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501355776:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1783144380.570902:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144380.570916:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6f400/0xad8e53a423048b9b lrc: 2/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048b94 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.570930:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6f400/0xad8e53a423048b9b lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048b94 expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.570951:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6f400/0xad8e53a423048b9b lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048b94 expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.570958:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2ad48e8600) 00010000:00010000:0.0:1783144380.570960:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144380.570963:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6f400, rc 0) 00000100:00100000:0.0:1783144380.571037:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501355776:12345-0@lo:101:mdt00_000.0 Request processed in 150us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.571043:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:2.0:1783144380.571164:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501355776:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783144380.571174:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.571182:0:66112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.571202:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.571210:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.571217:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783144380.571543:0:66112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].2, 432 off34200 00000040:00080000:2.0:1783144380.571585:0:66112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].2, 512 off34432 00000004:00080000:2.0:1783144380.571591:0:66112:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2b01016540 with version 9 00000004:00080000:3.0:1783144380.571624:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 9 rpc_version 9 00000020:00100000:3.0:1783144380.571646:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783144380.571653:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2af5511880 x1869759501356032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144380.571667:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501356032:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783144380.571697:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.571793:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac1377cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144380.572164:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501356032 00000100:00100000:0.0:1783144380.572169:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501356032 00000100:00100000:0.0:1783144380.572203:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:0.0:1783144380.572209:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75523:x1869759501356032:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783144380.575176:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75523:x1869759501356032:12345-0@lo:1000:osp_up0-1.0 Request processed in 2961us (3472us total) trans 115964116994 rc 0/0 00000100:00100000:0.0:1783144380.575190:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1783144380.575234:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501356032:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1783144380.575704:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783144380.575752:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575762:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575769:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575775:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144380.575780:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575794:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575808:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2afa089800) 00010000:00010000:2.0:1783144380.575810:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144380.575815:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575820:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423048ba2 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575835:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575842:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575848:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575874:0:66112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783144380.575886:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783144380.575890:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575897:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575903:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575924:0:66112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1783144380.575928:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783144380.575933:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144380.575940:0:66112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.576078:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144380.576085:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.576092:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517400 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:0.0:1783144380.576096:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144380.576103:0:9527:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.576139:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.576145:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144380.576326:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144380.576332:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.576338:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:3.0:1783144380.576342:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144380.576349:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.576376:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.576381:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144380.576399:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.576405:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01200/0xad8e53a423048b78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b7f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.576415:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.576416:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144380.576418:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144380.576430:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501356288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144380.576470:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144380.576512:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501356288 00000100:00100000:3.0:1783144380.576521:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501356288 00000100:00100000:2.0:1783144380.576538:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:71168:x1869759481700992:12345-192.168.203.4@tcp:36:rm.0 Request processed in 11967us (12205us total) trans 81604378754 rc 0/0 00000100:00100000:2.0:1783144380.576548:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1237 00000100:00100000:3.0:1783144380.576564:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1783144380.576574:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3650:x1869759501356288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144380.576587:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144380.576601:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048b7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048b78 expref: 12 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144380.576611:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144380.576615:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144380.576644:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3650:x1869759501356288:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144380.576658:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1783144380.576674:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501356288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144380.576714:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 1/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.576753:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7517400/0xad8e53a423048b94 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b9b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144380.576760:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501356160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144380.576766:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.576769:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144380.576772:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144380.576793:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144380.576914:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501356160 00000100:00100000:0.0:1783144380.576918:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501356160 00000100:00100000:0.0:1783144380.577131:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1783144380.577140:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3649:x1869759501356160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144380.577148:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144380.577159:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6f400/0xad8e53a423048b9b lrc: 0/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048b94 expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144380.577171:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2ad48e8600) 00010000:00010000:0.0:1783144380.577177:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144380.577206:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3649:x1869759501356160:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144380.577212:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1783144380.577235:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501356160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144381.391048:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783144381.966813:0:75528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 2916320088189ns, next at 2917320085961ns, rc = 0 00000100:00100000:0.0:1783144381.966842:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501356416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144381.966947:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144381.968553:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501356416 00000100:00100000:2.0:1783144381.968560:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501356416 00000100:00100000:2.0:1783144381.968921:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:2.0:1783144381.968930:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501356416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144381.968956:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144381.969006:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501356416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144381.969013:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:2.0:1783144381.969039:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501356544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144381.969095:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144381.969142:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501356544 00000100:00100000:2.0:1783144381.969146:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501356544 00000100:00100000:2.0:1783144381.969168:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:2.0:1783144381.969174:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501356544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144381.969188:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144381.969220:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501356544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144381.969226:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00100000:2.0:1783144381.969264:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501356544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144381.969299:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501356416:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783144382.414279:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783144383.359632:0:92851:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 01:53:02 (1783144382) 00010000:00010000:0.0:1783144383.437809:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783144383.750188:0:92899:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd2d020090 20000000:00000080:3.0:1783144383.750203:0:92899:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c29c6000400 uarg=0000000000000000 00000040:00100000:3.0:1783144383.750718:0:92899:0:(llog.c:1067:llog_reverse_process()) index 51 : idx 49 00000040:00100000:3.0:1783144383.750743:0:92899:0:(llog.c:1067:llog_reverse_process()) index 47 : idx 1 00000040:00080000:3.0:1783144383.750887:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:3.0:1783144383.750906:0:92899:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783144383.750921:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:3.0:1783144383.750935:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:3.0:1783144383.750989:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:3.0:1783144383.750996:0:92899:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783144383.751008:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:3.0:1783144383.751141:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:3.0:1783144383.751509:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:3.0:1783144383.751519:0:92899:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783144383.751533:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:3.0:1783144383.751612:0:92899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:3.0:1783144383.751624:0:92899:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783144383.751641:0:92899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751656:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230486cb expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751663:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304879d expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751669:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751685:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751691:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304881b expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751697:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048829 expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751716:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048845 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751843:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048853 expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751850:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304887d expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751859:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 9 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751865:0:92899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 9 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751872:0:92899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751907:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 9 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.751928:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 9 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.751940:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501356672:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144383.752067:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 9 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.752075:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 9 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.752083:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501356800:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144383.752110:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304887d expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.752118:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304887d expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.752125:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501356928:0@lo:104: 00000100:00100000:3.0:1783144383.752159:0:92899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783144383.752205:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048853 expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.752206:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501356928 00000100:00100000:1.0:1783144383.752214:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501356928 00010000:00010000:3.0:1783144383.752216:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048853 expref: 23 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.752233:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357056:0@lo:104: 00000100:00100000:3.0:1783144383.752254:0:92899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783144383.752282:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048845 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.752286:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357056 00010000:00010000:3.0:1783144383.752292:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048845 expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.752292:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357056 00000100:00100000:3.0:1783144383.752302:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357184:0@lo:104: 00000100:00100000:1.0:1783144383.752313:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1783144383.752324:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:92899:x1869759501356928:12345-0@lo:104: 00000100:00100000:3.0:1783144383.752332:0:92899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144383.752341:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.752348:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048829 expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.752368:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048829 expref: 23 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.752376:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357312:0@lo:104: 00010000:00010000:3.0:1783144383.752405:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304881b expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.752412:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304881b expref: 23 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.752420:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357440:0@lo:104: 00000100:00100000:0.0:1783144383.752438:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1783144383.752444:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.752453:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.752461:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357568:0@lo:104: 00000100:00100000:0.0:1783144383.752467:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144383.752489:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144383.752516:0:92899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144383.752516:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357184 00010000:00010000:1.0:1783144383.752518:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783144383.752521:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357184 00000100:00100000:1.0:1783144383.752529:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:92899:x1869759501356928:12345-0@lo:104: Request processed in 206us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144383.752538:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:3.0:1783144383.752549:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.752550:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357312 00000100:00100000:0.0:1783144383.752554:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357312 00000100:00100000:1.0:1783144383.752559:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357440 00010000:00010000:3.0:1783144383.752563:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 23 pid: 92275 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.752564:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357440 00000100:00100000:0.0:1783144383.752574:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357568 00000100:00100000:3.0:1783144383.752576:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357696:0@lo:104: 00000100:00100000:0.0:1783144383.752579:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357568 00000100:00100000:1.0:1783144383.752588:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1783144383.752598:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:92899:x1869759501357056:12345-0@lo:104: 00000100:00100000:3.0:1783144383.752606:0:92899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144383.752607:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.752616:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357696 00000100:00100000:0.0:1783144383.752621:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357696 00010000:00010000:3.0:1783144383.752627:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304879d expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.752638:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304879d expref: 23 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.752644:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783144383.752653:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357824:0@lo:104: 00010000:00010000:1.0:1783144383.752653:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783144383.752659:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4a86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92899:x1869759501357184:12345-0@lo:104: 00000100:00100000:1.0:1783144383.752665:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92899:x1869759501357056:12345-0@lo:104: Request processed in 67us (407us total) trans 0 rc 0/0 00010000:00010000:0.0:1783144383.752672:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.752673:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783144383.752684:0:92899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144383.752691:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357824 00000100:00100000:1.0:1783144383.752695:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357824 00010000:00010000:3.0:1783144383.752741:0:92899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230486cb expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.752752:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00010000:00010000:3.0:1783144383.752753:0:92899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230486cb expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.752764:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783144383.752774:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4a86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92899:x1869759501357184:12345-0@lo:104: Request processed in 120us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144383.752775:0:92899:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357952:0@lo:104: 00000100:00100000:1.0:1783144383.752804:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92899:x1869759501357312:12345-0@lo:104: 00010000:00010000:1.0:1783144383.752813:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.752823:0:92899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144383.752842:0:92899:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af69a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144383.752861:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501356928:0@lo:104: 00010000:00010000:1.0:1783144383.752872:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783144383.752873:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357056:0@lo:104: 00000100:00100000:1.0:1783144383.752885:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92899:x1869759501357312:12345-0@lo:104: Request processed in 80us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144383.752886:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357184:0@lo:104: 00000100:00100000:3.0:1783144383.752898:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357312:0@lo:104: 00000100:00100000:0.0:1783144383.752917:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1783144383.752963:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501357952 00000100:00100000:0.0:1783144383.752967:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501357952 00000100:00100000:0.0:1783144383.752983:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1783144383.752989:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:92899:x1869759501357440:12345-0@lo:104: 00000100:00100000:1.0:1783144383.752995:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:0.0:1783144383.753005:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.753016:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1783144383.753033:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:92899:x1869759501357568:12345-0@lo:104: 00010000:00010000:1.0:1783144383.753042:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.753053:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783144383.753061:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:92899:x1869759501357440:12345-0@lo:104: Request processed in 71us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.753068:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:1.0:1783144383.753080:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1783144383.753089:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:92899:x1869759501357568:12345-0@lo:104: Request processed in 56us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.753089:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1783144383.753100:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783144383.753102:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:92899:x1869759501357696:12345-0@lo:104: 00010000:00010000:0.0:1783144383.753112:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.753119:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1783144383.753128:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:92899:x1869759501357824:12345-0@lo:104: 00010000:00010000:1.0:1783144383.753135:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.753149:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783144383.753156:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:92899:x1869759501357696:12345-0@lo:104: Request processed in 58us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.753163:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:1.0:1783144383.753169:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1783144383.753177:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:92899:x1869759501357824:12345-0@lo:104: Request processed in 50us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.753183:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783144383.753191:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:92899:x1869759501357952:12345-0@lo:104: 00010000:00010000:0.0:1783144383.753199:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.753229:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357440:0@lo:104: 00010000:00010000:0.0:1783144383.753240:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1783144383.753243:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357568:0@lo:104: 00000100:00100000:0.0:1783144383.753249:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:92899:x1869759501357952:12345-0@lo:104: Request processed in 57us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144383.753256:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357696:0@lo:104: 00000100:00100000:3.0:1783144383.753263:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357824:0@lo:104: 00000100:00100000:3.0:1783144383.753269:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501357952:0@lo:104: 00000100:00100000:1.0:1783144383.753555:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1783144383.753562:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:2.0:1783144383.753563:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783144383.753571:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753579:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c200 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:1.0:1783144383.753579:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 10000000:00010000:2.0:1783144383.753588:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753588:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.753590:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783144383.753608:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35200 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:2.0:1783144383.753609:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144383.753612:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144383.753629:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753630:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144383.753644:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1783144383.753647:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144383.753660:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144383.753670:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753676:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144383.753680:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753689:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144383.753717:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753720:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753742:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3c200/0xad8e53a42304887d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048884 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753755:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35200/0xad8e53a423048853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304885a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753773:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783144383.753773:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783144383.753776:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753779:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753791:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1000 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144383.753794:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753797:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47ca00 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:2.0:1783144383.753801:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144383.753803:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144383.753817:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753819:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144383.753828:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1783144383.753835:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144383.753840:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144383.753846:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753853:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144383.753860:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753863:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753868:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1000/0xad8e53a42304881b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048822 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753872:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144383.753893:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783144383.753896:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753897:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753914:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d600 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:1.0:1783144383.753914:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47ca00/0xad8e53a423048829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048830 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144383.753919:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.753926:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753930:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753932:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144383.753939:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144383.753940:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.753952:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d400 already unused, calling callback (ffffffffc1204c20) 10000000:01000000:2.0:1783144383.753960:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144383.753960:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144383.753960:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144383.753967:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.753974:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.753977:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753979:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144383.753991:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144383.753997:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.753998:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144383.754006:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144383.754007:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783144383.754013:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144383.754022:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3d600/0xad8e53a4230487f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.754030:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.754032:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144383.754036:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.754038:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.754045:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144383.754054:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.754056:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144383.754065:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.754069:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47d400/0xad8e53a423048845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304884c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.754079:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34a00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144383.754085:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.754087:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1e00/0xad8e53a4230487d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.754092:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144383.754099:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.754100:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.754107:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144383.754118:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144383.754118:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144383.754119:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.754122:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1783144383.754125:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.754131:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783144383.754134:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144383.754152:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.754155:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.754161:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501358208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144383.754162:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144383.754170:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144383.754172:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.754184:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34a00/0xad8e53a42304879d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230487a4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144383.754185:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783144383.754198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144383.754199:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144383.754203:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144383.754206:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144383.754206:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.754214:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144383.754222:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144383.754223:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501358464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144383.754233:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501358720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144383.754235:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af6f35e00/0xad8e53a4230486cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230486d2 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.754254:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144383.754256:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144383.754258:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144383.754278:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501358080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144383.754914:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501358336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144383.755171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144383.755212:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358208 00000100:00100000:1.0:1783144383.755216:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358208 00010000:00010000:1.0:1783144383.755236:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048853 expref: 24 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.755255:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358720 00000100:00100000:1.0:1783144383.755258:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358720 00010000:00010000:1.0:1783144383.755267:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048845 expref: 25 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.755293:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:1.0:1783144383.755300:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3650:x1869759501358208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144383.755310:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144383.755315:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048853 expref: 25 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.755323:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048853 expref: 25 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.755335:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c000/0xad8e53a42304885a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048853 expref: 25 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.755347:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144383.755380:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501358208:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144383.755387:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:1.0:1783144383.755399:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1783144383.755521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144383.755532:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3650:x1869759501358720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144383.755543:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144383.755547:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501358976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144383.755549:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048845 expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.755562:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048845 expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.755569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144383.755581:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af6f35a00/0xad8e53a42304884c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048845 expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.755590:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144383.755627:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3650:x1869759501358720:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144383.755628:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144383.755637:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:1.0:1783144383.755682:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358464 00000100:00100000:1.0:1783144383.755686:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358464 00000100:00100000:3.0:1783144383.755688:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501358848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144383.755709:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048829 expref: 22 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.755716:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501358592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144383.755743:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358080 00000100:00100000:3.0:1783144383.755745:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144383.755748:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358080 00010000:00010000:1.0:1783144383.755763:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304887d expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.755777:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144383.755782:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358336 00000100:00100000:1.0:1783144383.755792:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358336 00000100:00100000:0.0:1783144383.755799:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501359104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144383.755806:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304881b expref: 24 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.755822:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358848 00000100:00100000:1.0:1783144383.755826:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358848 00000100:00100000:0.0:1783144383.755826:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144383.755839:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 25 pid: 92275 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.755851:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358592 00000100:00100000:1.0:1783144383.755853:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358592 00010000:00010000:1.0:1783144383.755864:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 26 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144383.755873:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501359104 00000100:00100000:1.0:1783144383.755880:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1783144383.755886:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501359104 00000100:00100000:1.0:1783144383.755889:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3648:x1869759501358464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144383.755898:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144383.755903:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048829 expref: 27 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.755909:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230486cb expref: 27 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.755914:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048829 expref: 27 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.755929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1783144383.755935:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3d800/0xad8e53a423048830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048829 expref: 27 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144383.755939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00010000:00010000:1.0:1783144383.755952:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144383.755953:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3649:x1869759501358080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144383.755963:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783144383.755969:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1783144383.755971:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304887d expref: 26 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.755983:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304887d expref: 26 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.755988:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3648:x1869759501358464:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144383.755998:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00010000:00010000:2.0:1783144383.756000:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47da00/0xad8e53a423048884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304887d expref: 26 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.756004:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481701248 00000100:00100000:0.0:1783144383.756010:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481701248 00010000:00010000:2.0:1783144383.756015:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144383.756032:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 10 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.756044:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481701376 00000100:00100000:1.0:1783144383.756053:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481701376 00000100:00100000:2.0:1783144383.756056:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501358080:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.756056:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:2.0:1783144383.756067:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1783144383.756070:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501358336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144383.756072:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 11 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.756081:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144383.756088:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00010000:00010000:0.0:1783144383.756089:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304881b expref: 23 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.756097:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:2.0:1783144383.756101:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3651:x1869759501358848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144383.756108:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304881b expref: 23 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.756111:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783144383.756111:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3649:x1869759501358592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144383.756120:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 23 pid: 92275 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.756126:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144383.756130:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1600/0xad8e53a423048822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304881b expref: 23 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.756132:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 23 pid: 92275 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.756134:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 23 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.756155:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144383.756161:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0400/0xad8e53a4230487dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230487d5 expref: 22 pid: 92275 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.756162:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 22 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.756175:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1c00/0xad8e53a4230487f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230487f1 expref: 22 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144383.756179:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144383.756189:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144383.756195:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3651:x1869759501358336:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.756204:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:2.0:1783144383.756214:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3651:x1869759501358848:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144383.756223:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1783144383.756228:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3649:x1869759501358592:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.756237:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1783144383.756244:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1783144383.756248:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3649:x1869759501359104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144383.756258:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783144383.756262:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2558 00010000:00010000:0.0:1783144383.756265:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230486cb expref: 18 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144383.756274:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2404:x1869759481701248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144383.756279:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230486cb expref: 18 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.756281:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501356672:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144383.756293:0:92899:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92899:1869759501356800:192.168.203.4@tcp:104: 00010000:00010000:0.0:1783144383.756301:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517e00/0xad8e53a4230486d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230486cb expref: 18 pid: 92277 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.756313:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144383.756338:0:92899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144383.756338:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783144383.756346:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:3649:x1869759501359104:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (518us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144383.756347:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 11 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.756363:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00010000:00010000:1.0:1783144383.756367:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 11 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.756384:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2559 00010000:00010000:1.0:1783144383.756392:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c800/0xad8e53a4230488a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c4f expref: 11 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.756397:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2403:x1869759481701376:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144383.756409:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144383.756410:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783144383.756416:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 10 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.756426:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 10 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.756437:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47d800/0xad8e53a423048892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c41 expref: 10 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.756445:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144383.756464:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144383.756479:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501358464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144383.756485:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:2403:x1869759481701376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 90us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144383.756494:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:2404:x1869759481701248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 220us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144383.756498:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2559 00000100:00100000:2.0:1783144383.756510:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501358080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144383.756511:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2558 00000100:00100000:0.0:1783144383.756516:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501358976 00000100:00100000:0.0:1783144383.756521:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501358976 00000100:00100000:2.0:1783144383.756527:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501358592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144383.756539:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304879d expref: 16 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144383.756545:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501359104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144383.757474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1783144383.757484:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:3648:x1869759501358976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144383.757495:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144383.757501:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304879d expref: 16 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757514:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304879d expref: 16 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757526:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0e00/0xad8e53a4230487a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304879d expref: 16 pid: 92276 timeout: 3018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757547:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.757549:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501358208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144383.757562:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144383.757567:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501358720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144383.757576:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757584:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757590:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757597:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757602:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144383.757606:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757614:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757630:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144383.757637:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144383.757661:0:92899:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144383.757670:0:92899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.757675:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:3648:x1869759501358976:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (1264us total) trans 0 rc 0/0 00010000:00010000:0.0:1783144383.757681:0:92899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01200/0xad8e53a423048ba9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144383.757709:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1783144383.757709:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501358976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144383.757806:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501358336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144383.757814:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501358848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144384.462009:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144385.315401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144385.315515:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481701504 00000100:00100000:1.0:1783144385.315524:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481701504 00000100:00100000:1.0:1783144385.315612:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:1.0:1783144385.315622:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481701504:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144385.315636:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144385.315653:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41c9c expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.315678:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 9 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.315701:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 9 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.315753:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1518800, rc 0) 00000100:00100000:1.0:1783144385.315819:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481701504:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 198us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.315826:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:1.0:1783144385.318335:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144385.318394:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481701632 00000100:00100000:3.0:1783144385.318401:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481701632 00000100:00100000:3.0:1783144385.318457:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:3.0:1783144385.318468:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481701632:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.318593:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481701632:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 127us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.318600:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:0.0:1783144385.321275:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144385.321359:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481701760 00000100:00100000:1.0:1783144385.321366:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481701760 00000100:00100000:1.0:1783144385.321448:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1783144385.321456:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481701760:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.321578:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481701760:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 122us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.321585:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1783144385.323878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144385.324376:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481701888 00000100:00100000:2.0:1783144385.324383:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481701888 00000100:00100000:2.0:1783144385.324460:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1783144385.324470:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71758:x1869759481701888:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783144385.324598:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71758:x1869759481701888:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 129us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.324606:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1783144385.325998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144385.326307:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702016 00000100:00100000:1.0:1783144385.326314:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702016 00000100:00100000:1.0:1783144385.326384:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1783144385.326393:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71758:x1869759481702016:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783144385.326494:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71758:x1869759481702016:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 102us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.326502:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:0.0:1783144385.328431:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144385.328810:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702144 00000100:00100000:2.0:1783144385.328818:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702144 00000100:00100000:2.0:1783144385.328904:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1783144385.328913:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481702144:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144385.328926:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144385.328950:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ca3 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.328985:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 10 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.328995:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 10 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.329003:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516000, rc 0) 00000100:00100000:2.0:1783144385.329053:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481702144:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 142us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.329060:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1783144385.330548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144385.330615:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702272 00000100:00100000:1.0:1783144385.330621:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702272 00000100:00100000:1.0:1783144385.330697:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:1.0:1783144385.330706:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481702272:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.330830:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481702272:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 125us (285us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783144385.330837:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 10000000:01000000:1.0:1783144385.358814:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144385.358822:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2aefdd9000 from 52 10000000:01000000:1.0:1783144385.358827:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144385.358874:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.358887:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.358898:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144385.358924:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.358990:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.359041:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.359747:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501359232 00000100:00100000:2.0:1783144385.359755:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501359232 00000100:00100000:2.0:1783144385.359810:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783144385.359820:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501359232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144385.359833:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144385.359846:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048bbe expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.359869:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048bbe expref: 16 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.359879:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bbe expref: 16 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.359889:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517000, rc 0) 00000100:00100000:2.0:1783144385.359950:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501359232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.359958:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783144385.360075:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144385.360089:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.360099:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144385.360158:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.360187:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.360275:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.362784:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501359360 00000100:00100000:0.0:1783144385.362796:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501359360 00000100:00100000:0.0:1783144385.362849:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783144385.362859:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501359360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.363077:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501359360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.363085:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783144385.366805:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.366872:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.366946:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.366995:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.368098:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501359488 00000100:00100000:3.0:1783144385.368107:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501359488 00000100:00100000:3.0:1783144385.368160:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783144385.368170:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501359488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.368295:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501359488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.368303:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783144385.368768:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.369979:0:92900:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92900:1869759501359616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.370036:0:92900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.370075:0:92900:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3d2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.370759:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501359616 00000100:00100000:0.0:1783144385.370766:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501359616 00000100:00100000:0.0:1783144385.370816:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783144385.370825:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:92900:x1869759501359616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144385.370957:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:92900:x1869759501359616:12345-0@lo:502:llog_process_th.0 Request processed in 133us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.370974:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783144385.371009:0:92900:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92900:1869759501359616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.371052:0:92900:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92900:1869759501359744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.371086:0:92900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.371115:0:92900:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3d2f000 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.371213:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501359744 00000100:00100000:3.0:1783144385.371218:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501359744 00000100:00100000:3.0:1783144385.371250:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783144385.371258:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:92900:x1869759501359744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.371333:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:92900:x1869759501359744:12345-0@lo:502:llog_process_th.0 Request processed in 75us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.371340:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783144385.371410:0:92900:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92900:1869759501359744:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783144385.371429:0:92900:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1783144385.371784:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1783144385.371808:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144385.371818:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.371827:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144385.371835:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783144385.371838:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:1.0:1783144385.371840:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783144385.371861:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.371868:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.371876:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144385.371887:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.371913:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.371947:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.371993:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501359872 00000100:00100000:0.0:1783144385.371997:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501359872 00000100:00100000:0.0:1783144385.372029:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783144385.372036:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501359872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144385.372044:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144385.372055:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048bcc expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.372074:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048bcc expref: 17 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.372084:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bcc expref: 17 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.372092:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6f800, rc 0) 00000100:00100000:0.0:1783144385.372205:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501359872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.372212:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783144385.372265:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501359872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144385.372276:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.372285:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144385.372329:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.372353:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.372414:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.372449:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360000 00000100:00100000:0.0:1783144385.372453:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360000 00000100:00100000:0.0:1783144385.372507:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783144385.372515:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501360000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.372611:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501360000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.372618:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783144385.372675:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.372710:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.372769:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.372914:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.372997:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360128 00000100:00100000:2.0:1783144385.373001:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360128 00000100:00100000:2.0:1783144385.373023:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783144385.373030:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501360128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.373112:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501360128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.373120:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783144385.373220:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.373569:0:92901:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92901:1869759501360256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144385.373603:0:92901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.373653:0:92901:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6ee3240 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.373684:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360256 00000100:00100000:3.0:1783144385.373697:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360256 00000100:00100000:2.0:1783144385.373753:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783144385.373761:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:92901:x1869759501360256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.373839:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:92901:x1869759501360256:12345-0@lo:502:llog_process_th.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.373846:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783144385.373925:0:92901:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92901:1869759501360256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144385.373947:0:92901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144385.373956:0:92901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144385.373959:0:92901:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:1.0:1783144385.373965:0:92901:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1783144385.374021:0:92901:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:1.0:1783144385.374601:0:92901:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00000001:00080000:2.0:1783144385.376418:0:92270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00080000:10000000:1.0:1783144385.376825:0:92901:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:1.0:1783144385.378619:0:92901:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00000100:00100000:1.0:1783144385.379859:0:92901:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92901:1869759501360384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144385.379931:0:92901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.379965:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360384 00000100:00100000:1.0:1783144385.379972:0:92901:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5196840 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.379973:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360384 00000100:00100000:2.0:1783144385.380018:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783144385.380026:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:92901:x1869759501360384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.380123:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:92901:x1869759501360384:12345-0@lo:502:llog_process_th.0 Request processed in 97us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.380131:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783144385.380169:0:92901:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92901:1869759501360384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144385.380207:0:92901:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92901:1869759501360512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144385.380240:0:92901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.380262:0:92901:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5196840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.380297:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360512 00000100:00100000:3.0:1783144385.380301:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360512 00000100:00100000:3.0:1783144385.380333:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783144385.380338:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:92901:x1869759501360512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.380400:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:92901:x1869759501360512:12345-0@lo:502:llog_process_th.0 Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.380404:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783144385.380450:0:92901:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92901:1869759501360512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144385.380473:0:92901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144385.380481:0:92901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144385.380483:0:92901:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:1.0:1783144385.380486:0:92901:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:2.0:1783144385.380544:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:2.0:1783144385.380568:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783144385.380578:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.380589:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144385.380599:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144385.380602:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 52 10000000:01000000:2.0:1783144385.380605:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144385.380624:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.380632:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.380641:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144385.380653:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.380684:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.380714:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3d2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.380744:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360640 00000100:00100000:3.0:1783144385.380750:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360640 00000100:00100000:3.0:1783144385.380837:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783144385.380845:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501360640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144385.380854:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144385.380865:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048bda expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.380886:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048bda expref: 18 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.380901:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bda expref: 18 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.380910:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00e00, rc 0) 00000100:00100000:3.0:1783144385.380944:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501360640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.380951:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783144385.380968:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144385.380981:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.380990:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144385.381031:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.381055:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.381087:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3d2f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.381133:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360768 00000100:00100000:0.0:1783144385.381142:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360768 00000100:00100000:0.0:1783144385.381169:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783144385.381176:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501360768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.381286:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501360768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.381293:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783144385.381345:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.381367:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.381397:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.381412:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3d2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.381429:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501360896 00000100:00100000:3.0:1783144385.381434:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501360896 00000100:00100000:3.0:1783144385.381465:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783144385.381473:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501360896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.381566:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501360896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.381580:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783144385.381617:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501360896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.382436:0:92902:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92902:1869759501361024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.382476:0:92902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.382505:0:92902:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b017cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.383023:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361024 00000100:00100000:0.0:1783144385.383027:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361024 00000100:00100000:0.0:1783144385.383068:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783144385.383077:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:92902:x1869759501361024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144385.383325:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:92902:x1869759501361024:12345-0@lo:502:llog_process_th.0 Request processed in 248us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.383334:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783144385.383355:0:92902:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92902:1869759501361024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144385.383407:0:92902:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92902:1869759501361152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144385.383448:0:92902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.383466:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361152 00000100:00100000:3.0:1783144385.383472:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361152 00000100:00100000:1.0:1783144385.383475:0:92902:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5196840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.383511:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783144385.383519:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:92902:x1869759501361152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.383601:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:92902:x1869759501361152:12345-0@lo:502:llog_process_th.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.383608:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783144385.383641:0:92902:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca2ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92902:1869759501361152:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144385.383664:0:92902:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1783144385.384282:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1783144385.384305:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144385.384314:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.384325:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144385.384334:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783144385.384343:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783144385.384346:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783144385.384368:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.384376:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.384385:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144385.384400:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501361280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.384676:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.384870:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad3febe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.384902:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361280 00000100:00100000:3.0:1783144385.384907:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361280 00000100:00100000:3.0:1783144385.384982:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783144385.384990:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501361280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144385.385001:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144385.385013:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048be8 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.385033:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048be8 expref: 19 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.385043:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048be8 expref: 19 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.385050:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01800, rc 0) 00000100:00100000:3.0:1783144385.385124:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501361280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.385138:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783144385.385508:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501361280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144385.385523:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.385532:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144385.385643:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501361408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.385669:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.385771:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad3febe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.386740:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361408 00000100:00100000:3.0:1783144385.386745:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361408 00000100:00100000:3.0:1783144385.386773:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783144385.386778:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501361408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.386882:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501361408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.386887:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783144385.386992:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501361408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.387019:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501361536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.387059:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.387081:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad3febe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.387101:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361536 00000100:00100000:3.0:1783144385.387107:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361536 00000100:00100000:3.0:1783144385.387136:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783144385.387142:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501361536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.387223:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501361536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.387231:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783144385.387246:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501361536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.387714:0:92903:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92903:1869759501361664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.387786:0:92903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.387812:0:92903:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad3febe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.387860:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361664 00000100:00100000:3.0:1783144385.387865:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361664 00000100:00100000:3.0:1783144385.387902:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783144385.387910:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:92903:x1869759501361664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.388425:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:92903:x1869759501361664:12345-0@lo:502:llog_process_th.0 Request processed in 515us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.388433:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783144385.388711:0:92903:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92903:1869759501361664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144385.388923:0:92903:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144385.388934:0:92903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144385.388937:0:92903:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:2.0:1783144385.388942:0:92903:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1783144385.388991:0:92903:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1783144385.389010:0:92903:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92903:1869759501361792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.389046:0:92903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.389071:0:92903:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.389089:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361792 00000100:00100000:3.0:1783144385.389095:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361792 00000100:00100000:3.0:1783144385.389129:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783144385.389136:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:92903:x1869759501361792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.389218:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:92903:x1869759501361792:12345-0@lo:502:llog_process_th.0 Request processed in 82us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.389225:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783144385.389247:0:92903:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92903:1869759501361792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.389282:0:92903:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92903:1869759501361920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.389315:0:92903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.389332:0:92903:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b0102a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.389352:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501361920 00000100:00100000:3.0:1783144385.389357:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501361920 00000100:00100000:3.0:1783144385.389541:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783144385.389548:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:92903:x1869759501361920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.389604:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:92903:x1869759501361920:12345-0@lo:502:llog_process_th.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.389609:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783144385.389646:0:92903:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92903:1869759501361920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144385.389664:0:92903:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144385.389669:0:92903:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144385.389670:0:92903:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:2.0:1783144385.389674:0:92903:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:3.0:1783144385.389801:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:3.0:1783144385.389826:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783144385.389835:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.389844:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144385.389851:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144385.389853:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 52 10000000:01000000:3.0:1783144385.389855:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144385.389876:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.389884:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.389904:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144385.389928:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.389954:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.389977:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f97000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.390001:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362048 00000100:00100000:0.0:1783144385.390006:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362048 00000100:00100000:0.0:1783144385.390036:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783144385.390044:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501362048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144385.390052:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144385.390064:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048bf6 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.390085:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 20 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.390095:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 20 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.390103:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6fc00, rc 0) 00000100:00100000:0.0:1783144385.390145:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501362048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.390151:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783144385.390202:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144385.390214:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.390224:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144385.390266:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.390290:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.390310:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f97000 going to sleep for 11 seconds 00000100:00100000:1.0:1783144385.390633:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362176 00000100:00100000:1.0:1783144385.390638:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362176 00000100:00100000:1.0:1783144385.390677:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783144385.390686:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501362176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.390850:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501362176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.390857:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783144385.390885:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.390916:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.390952:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.390974:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ae0a0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.390983:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362304 00000100:00100000:3.0:1783144385.390987:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362304 00000100:00100000:3.0:1783144385.391014:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783144385.391021:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501362304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.391088:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501362304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.391095:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783144385.391114:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.391872:0:92904:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92904:1869759501362432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.391903:0:92904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.391922:0:92904:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.391940:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362432 00000100:00100000:2.0:1783144385.391945:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362432 00000100:00100000:2.0:1783144385.391974:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783144385.391982:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:92904:x1869759501362432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.392129:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:92904:x1869759501362432:12345-0@lo:502:llog_process_th.0 Request processed in 147us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.392136:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783144385.392163:0:92904:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92904:1869759501362432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.392207:0:92904:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92904:1869759501362560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.392237:0:92904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.392258:0:92904:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144385.392492:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362560 00000100:00100000:1.0:1783144385.392497:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362560 00000100:00100000:1.0:1783144385.392523:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783144385.392529:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:92904:x1869759501362560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144385.392615:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:92904:x1869759501362560:12345-0@lo:502:llog_process_th.0 Request processed in 86us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.392622:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783144385.392649:0:92904:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92904:1869759501362560:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783144385.392665:0:92904:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1783144385.392777:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1783144385.392800:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144385.392808:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.392819:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144385.392828:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783144385.392831:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1783144385.392833:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783144385.392854:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.392862:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.392870:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144385.392894:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.392920:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.392955:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.393073:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362688 00000100:00100000:2.0:1783144385.393077:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362688 00000100:00100000:2.0:1783144385.393102:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783144385.393108:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501362688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144385.393116:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144385.393127:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c04 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.393145:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c04 expref: 21 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.393154:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c04 expref: 21 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.393162:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517c00, rc 0) 00000100:00100000:2.0:1783144385.393196:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501362688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.393203:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783144385.393263:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144385.393275:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.393282:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144385.393313:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.393330:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.393346:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1783144385.393574:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362816 00000100:00100000:1.0:1783144385.393578:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362816 00000100:00100000:1.0:1783144385.393604:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783144385.393611:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501362816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144385.393715:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501362816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.393795:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783144385.394310:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.394340:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.394378:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.394409:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.394817:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501362944 00000100:00100000:2.0:1783144385.394823:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501362944 00000100:00100000:2.0:1783144385.394862:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783144385.394870:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501362944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.394960:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501362944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.394978:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783144385.395118:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501362944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144385.396098:0:92905:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783144385.396205:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783144385.396228:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783144385.396236:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.396245:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144385.396266:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783144385.396268:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 52 10000000:01000000:0.0:1783144385.396271:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783144385.396291:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.396299:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.396307:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144385.396321:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.396355:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.396382:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144385.396447:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363072 00000100:00100000:1.0:1783144385.396452:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363072 00000100:00100000:1.0:1783144385.396484:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783144385.396491:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501363072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144385.396501:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144385.396513:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c12 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.396531:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c12 expref: 22 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.396547:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c12 expref: 22 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144385.396555:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1518200, rc 0) 00000100:00100000:1.0:1783144385.396590:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501363072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.396598:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783144385.396632:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144385.396645:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.396655:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144385.396739:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.396766:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.396786:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.397011:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363200 00000100:00100000:3.0:1783144385.397016:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363200 00000100:00100000:3.0:1783144385.397047:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783144385.397063:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501363200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.397146:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501363200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.397161:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783144385.397271:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.397295:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.397333:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.397363:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.397459:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363328 00000100:00100000:2.0:1783144385.397463:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363328 00000100:00100000:2.0:1783144385.397488:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783144385.397495:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501363328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.397573:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501363328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.397579:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783144385.397664:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.398213:0:92906:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92906:1869759501363456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144385.398250:0:92906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.398279:0:92906:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.398324:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363456 00000100:00100000:2.0:1783144385.398328:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363456 00000100:00100000:2.0:1783144385.398363:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783144385.398370:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:92906:x1869759501363456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144385.398496:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:92906:x1869759501363456:12345-0@lo:502:llog_process_th.0 Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.398504:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783144385.398560:0:92906:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92906:1869759501363456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144385.398598:0:92906:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92906:1869759501363584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144385.398631:0:92906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.398863:0:92906:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.399201:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363584 00000100:00100000:3.0:1783144385.399205:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363584 00000100:00100000:3.0:1783144385.399233:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783144385.399243:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:92906:x1869759501363584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144385.399301:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:92906:x1869759501363584:12345-0@lo:502:llog_process_th.0 Request processed in 62us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.399307:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783144385.399376:0:92906:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:92906:1869759501363584:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783144385.399393:0:92906:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1783144385.399510:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1783144385.399529:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144385.399537:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.399558:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144385.399567:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783144385.399569:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783144385.399572:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783144385.399590:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.399598:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.399607:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144385.399619:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.399644:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.399666:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f97000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.399789:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363712 00000100:00100000:0.0:1783144385.399793:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363712 00000100:00100000:0.0:1783144385.399820:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783144385.399828:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501363712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144385.399836:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144385.399846:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c20 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.399864:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c20 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.399874:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c20 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.399892:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6e000, rc 0) 00000100:00100000:0.0:1783144385.399921:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501363712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.399927:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783144385.399948:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144385.399962:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.399971:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144385.400011:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.400036:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.400069:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f97000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.400395:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363840 00000100:00100000:0.0:1783144385.400399:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363840 00000100:00100000:0.0:1783144385.400426:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783144385.400432:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501363840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.400518:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501363840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.400525:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783144385.400545:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.400574:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144385.400607:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.400623:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9f97000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144385.400640:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501363968 00000100:00100000:0.0:1783144385.400645:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501363968 00000100:00100000:0.0:1783144385.400667:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783144385.400751:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501363968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.400827:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501363968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.400834:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783144385.400868:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501363968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144385.401382:0:92907:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783144385.401430:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783144385.401449:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783144385.401456:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.401465:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144385.401484:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783144385.401486:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144385.401488:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783144385.401505:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.401512:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.401520:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144385.401533:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501364096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.401560:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.401586:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364096 00000100:00100000:3.0:1783144385.401590:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364096 00000100:00100000:0.0:1783144385.401590:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144385.401618:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783144385.401626:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501364096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144385.401633:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144385.401642:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c2e expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.401657:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c2e expref: 24 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.401666:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c2e expref: 24 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144385.401673:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01c00, rc 0) 00000100:00100000:3.0:1783144385.401751:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501364096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.401759:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783144385.401781:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501364096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144385.401792:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.401800:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144385.401835:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501364224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144385.401864:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.401901:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364224 00000100:00100000:0.0:1783144385.401904:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af96b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783144385.401906:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364224 00000100:00100000:2.0:1783144385.401936:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783144385.401944:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501364224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.402020:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501364224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (139us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783144385.402024:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501364224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144385.402031:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 10000000:01000000:0.0:1783144385.402054:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783144385.402065:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144385.402073:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144385.486020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144385.550117:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501364480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144385.550194:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501364864:0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.550237:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.550274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.550288:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501364992:0@lo:400:kworker.0 00000100:00100000:3.0:1783144385.550317:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501364608:0@lo:400:kworker.0 00000100:00100000:2.0:1783144385.550415:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501365248:0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.550417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.550443:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364864 00000100:00100000:3.0:1783144385.550462:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364864 00000100:00100000:1.0:1783144385.550463:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501365376:0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.550475:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501364736:0@lo:400:kworker.0 00000100:00100000:2.0:1783144385.550482:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.550525:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364992 00000100:00100000:1.0:1783144385.550530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.550531:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364992 00000100:00100000:0.0:1783144385.550535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144385.550547:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501365760:0@lo:400:kworker.0 00000100:00100000:3.0:1783144385.550562:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364736 00000100:00100000:3.0:1783144385.550566:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364736 00000100:00100000:0.0:1783144385.550569:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501365120:0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.550582:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501365888:0@lo:400:kworker.0 00000100:00100000:2.0:1783144385.550601:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.550606:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1783144385.550616:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.550621:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501364864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.550626:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.550655:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501365632:0@lo:400:kworker.0 00000100:00100000:2.0:1783144385.550685:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1783144385.550703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144385.550715:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501364864:12345-0@lo:400:kworker.0 Request processed in 95us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.550716:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501364992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.550718:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364480 00000100:00100000:1.0:1783144385.550750:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364480 00000100:00100000:0.0:1783144385.550756:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501366144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144385.550800:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501365120 00000100:00100000:1.0:1783144385.550804:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501365120 00000100:00100000:0.0:1783144385.550809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.550835:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501365632 00000100:00100000:1.0:1783144385.550839:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501365632 00000100:00100000:2.0:1783144385.550865:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869759501364992:12345-0@lo:400:kworker.0 Request processed in 157us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.550866:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1783144385.550882:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3650:x1869759501364480:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144385.550885:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501365248 00000100:00100000:0.0:1783144385.550890:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501365248 00000004:00000024:1.0:1783144385.550916:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444904960 avail 1298665472 00000100:00100000:3.0:1783144385.550919:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1783144385.550919:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501365376 00000100:00100000:0.0:1783144385.550924:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501365376 00000100:00100000:0.0:1783144385.550947:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501365760 00000100:00100000:0.0:1783144385.550950:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501365760 00000100:00100000:1.0:1783144385.550965:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3650:x1869759501364480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.550970:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501365888 00000100:00100000:0.0:1783144385.550974:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501365888 00000100:00100000:1.0:1783144385.550983:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:0.0:1783144385.550997:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1783144385.551002:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1783144385.551006:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501365248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.551011:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1869759501365120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.551052:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1869759501365120:12345-0@lo:400:kworker.0 Request processed in 44us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.551052:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501365248:12345-0@lo:400:kworker.0 Request processed in 46us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.551069:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1783144385.551070:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1783144385.551080:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1783144385.551087:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501365632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.551091:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1783144385.551106:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501365632:12345-0@lo:400:kworker.0 Request processed in 20us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.551108:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501365376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.551115:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:0.0:1783144385.551145:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501365376:12345-0@lo:400:kworker.0 Request processed in 40us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.551151:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:2.0:1783144385.551159:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1783144385.551174:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1783144385.551182:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501365760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144385.551193:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1783144385.551209:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501364736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.551218:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501365760:12345-0@lo:400:kworker.0 Request processed in 35us (618us total) trans 0 rc 0/0 00000100:00080000:3.0:1783144385.551222:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144385.551227:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00080000:3.0:1783144385.551229:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783144385.551235:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783144385.551238:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144385.551275:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501364736:12345-0@lo:400:kworker.0 Request processed in 70us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.551284:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1783144385.551300:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1783144385.551307:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501365888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144385.551405:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501365888:12345-0@lo:400:kworker.0 Request processed in 57us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.551415:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:3.0:1783144385.551448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.551453:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501366144 00000100:00100000:0.0:1783144385.551458:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501366144 00000100:00100000:3.0:1783144385.551473:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501364352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783144385.551491:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1783144385.551504:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501366144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144385.551506:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783144385.551529:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783144385.551541:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501365504:0@lo:400:kworker.0 00000100:00100000:3.0:1783144385.551581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.551582:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501366144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.551590:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1783144385.551603:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364608 00000100:00100000:3.0:1783144385.551608:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501366016:0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.551611:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364608 00000100:00100000:0.0:1783144385.551615:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501364352 00000100:00100000:0.0:1783144385.551619:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501364352 00000100:00100000:3.0:1783144385.551638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144385.551651:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:0.0:1783144385.551660:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501364352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783144385.551685:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144385.551698:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501365504 00000100:00100000:1.0:1783144385.551704:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501365504 00000100:00100000:2.0:1783144385.551705:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501366272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144385.551716:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501366016 00000100:00100000:3.0:1783144385.551744:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501366016 00000100:00100000:0.0:1783144385.551760:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501364352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.551769:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1783144385.551775:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1783144385.551806:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144385.551830:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501364608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144385.551846:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1783144385.551855:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501365504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.551876:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501364608:12345-0@lo:400:kworker.0 Request processed in 92us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.551883:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1783144385.551899:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501365504:12345-0@lo:400:kworker.0 Request processed in 44us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.551905:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1783144385.551916:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501366016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144385.551919:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1783144385.551936:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501364736:0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.551960:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501366016:12345-0@lo:400:kworker.0 Request processed in 45us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.551961:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501364608:0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.551963:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116994 gen 3 00000004:00080000:0.0:1783144385.551971:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116993 committed transno 115964116994 00000100:00100000:1.0:1783144385.551976:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1783144385.551988:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501364352:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783144385.551992:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116994 committed transno 115964116994 00000100:00100000:3.0:1783144385.552002:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501365504:0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.552011:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501365120:0@lo:400:kworker.0 00000100:00100000:3.0:1783144385.552016:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501366016:0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.552032:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501365632:0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.552034:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501366272 00000100:00100000:1.0:1783144385.552041:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501366272 00000100:00100000:0.0:1783144385.552058:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501366144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144385.552080:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:1.0:1783144385.552089:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501366272:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783144385.552100:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144385.552104:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501365248:0@lo:400:kworker.0 00000004:00000024:1.0:1783144385.552111:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445253120 avail 1299013632 00000100:00100000:2.0:1783144385.552142:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501365760:0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.552146:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1869759501364992:0@lo:400:kworker.0 00000100:00100000:2.0:1783144385.552170:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501364864:0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.552175:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501365376:0@lo:400:kworker.0 00000100:00100000:1.0:1783144385.552181:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501366272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144385.552193:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1783144385.552203:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501365888:0@lo:400:kworker.0 00000100:00100000:0.0:1783144385.552232:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501364480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144385.552244:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501366272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144385.635050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144385.635091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144385.635132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144385.635198:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702656 00000100:00100000:0.0:1783144385.635207:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702656 00000100:00100000:3.0:1783144385.635217:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702528 00000100:00100000:3.0:1783144385.635224:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702528 00000100:00100000:0.0:1783144385.635317:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2066 00000100:00100000:0.0:1783144385.635326:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2406:x1869759481702656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144385.635388:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2406:x1869759481702656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144385.635395:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2066 00000100:00100000:2.0:1783144385.635585:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702400 00000100:00100000:2.0:1783144385.635590:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702400 00000100:00100000:2.0:1783144385.637532:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 840 00000100:00100000:2.0:1783144385.637544:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2406:x1869759481702400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144385.637622:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2406:x1869759481702400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 79us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144385.637631:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 840 00000100:00080000:1.0:1783144385.637931:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783144385.637936:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144385.637939:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144385.638224:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 841 00000100:00100000:3.0:1783144385.638235:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2405:x1869759481702528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144385.638284:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2405:x1869759481702528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 50us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144385.638292:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 841 00010000:00010000:2.0:1783144386.509887:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783144386.579614:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968828 is committed 00000001:00100000:3.0:1783144386.579896:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000020:00000080:3.0:1783144386.579902:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2ac752c000/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00080000:3.0:1783144386.579921:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968829 is committed 00000020:00000080:0.0:1783144386.580141:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac752c000/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef for lustre-OST0000 00000020:00000080:0.0:1783144386.580189:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c443b800 for lustre-OST0000 00000004:00080000:2.0:1783144386.580559:0:75517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00010000:00010000:2.0:1783144386.580605:0:75517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144386.580624:0:75517:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144386.580662:0:75517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144386.580668:0:75517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144386.580698:0:75517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516600/0xad8e53a423048b86 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048b8d expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783144386.580716:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378754 is committed 00000020:00080000:2.0:1783144386.580744:0:75517:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c2b01016900 refcount 2 committed 0 result 0 batchid 77309411386 00000020:00080000:2.0:1783144386.580748:0:75517:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2acac20000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c2b01016540 00000020:00080000:2.0:1783144386.580752:0:75517:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].2 00000020:00080000:2.0:1783144386.580754:0:75517:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2acac20f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2af05a9000 00000020:00080000:2.0:1783144386.580757:0:75517:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].2 00000004:00080000:2.0:1783144386.580773:0:75517:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000020:00080000:2.0:1783144386.580806:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411386 committed batchid 77309411385 00000100:00100000:0.0:1783144386.580854:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501366400:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:2.0:1783144386.580857:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411385 00000100:00100000:0.0:1783144386.580932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144386.580984:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144386.580991:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501366528:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1783144386.581004:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501366400 00000100:00100000:2.0:1783144386.581011:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501366400 00000100:00100000:0.0:1783144386.581022:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144386.581078:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1783144386.581088:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3650:x1869759501366400:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1783144386.581096:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144386.581102:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144386.581106:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581115:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144386.581121:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048b8d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048b86 expref: 8 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581138:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144386.581143:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581154:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144386.581158:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2ae00b1100) 00010000:00010000:3.0:1783144386.581165:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xb1bed465 (ffff9c2afa089c00) 00010000:00010000:2.0:1783144386.581168:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144386.581180:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144386.581185:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581192:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517600/0xad8e53a4230488e6 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581207:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144386.581210:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1869759501366400:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 122us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1783144386.581219:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144386.581224:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00010000:00010000:3.0:1783144386.581228:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581232:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144386.581235:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581240:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581258:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xb1bed465 (ffff9c2afa089c00) 00010000:00010000:3.0:1783144386.581260:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144386.581263:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581269:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed00c00/0xad8e53a423048b4e lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581289:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581295:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581300:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581305:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144386.581307:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581312:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581318:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xf7117594 (ffff9c29ca602000) 00010000:00010000:3.0:1783144386.581320:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144386.581323:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581331:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519600/0xad8e53a423048b6a lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144386.581366:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501366528 00000100:00100000:3.0:1783144386.581371:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501366528 00000100:00100000:3.0:1783144386.581411:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974 00000100:00100000:3.0:1783144386.581419:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501366528:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783144386.581441:0:26147:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:578 count 1 00010000:00010000:3.0:1783144386.581459:0:26147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581482:0:26147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 5 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581490:0:26147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x242:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1783144386.581494:0:26147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783144386.581498:0:26147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581524:0:26147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 5 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.581536:0:26147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 5 pid: 26152 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144386.581548:0:26147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:26147:1869759501366656:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144386.581609:0:26147:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144386.581849:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501366400:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1783144386.584095:0:26147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:26147:1869759501366656:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144386.584582:0:26147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144386.585326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144386.585524:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702784 00000100:00100000:0.0:1783144386.585593:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702784 00010000:00010000:0.0:1783144386.585638:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 6 pid: 26152 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.585688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2561 00000100:00100000:0.0:1783144386.585699:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2404:x1869759481702784:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144386.585715:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144386.585741:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 6 pid: 26152 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586125:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 6 pid: 26152 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586149:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5c0a56d/0xad8e53a423048a6e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c64 expref: 6 pid: 26152 timeout: 3020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586165:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783144386.586170:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783144386.586176:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586208:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586282:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144386.586338:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481702784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 639us (1013us total) trans 0 rc 0/0 00010000:00010000:3.0:1783144386.586342:0:26147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.586348:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2561 00010000:00010000:3.0:1783144386.586360:0:26147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.586372:0:26147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.586381:0:26147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.586403:0:26147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144386.586425:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144386.586433:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586442:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144386.586447:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586456:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586468:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586476:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a2d6424/0xad8e53a423048c3c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.586494:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144386.586502:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144386.586504:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144386.586613:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+6:3650:x1869759501366528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5194us (5589us total) trans 4294968829 rc 0/0 00000004:00080000:0.0:1783144386.586653:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c2ad05d0700/2, rc 0, transno 4294968829 00000100:00100000:0.0:1783144386.586661:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501366528:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783144386.586950:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974 00000020:00000080:0.0:1783144386.715886:0:93005:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd7a85f360 20000000:00000080:0.0:1783144386.715902:0:93005:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c2af9f32000 uarg=0000000000000000 00000040:00100000:0.0:1783144386.717116:0:93005:0:(llog.c:1067:llog_reverse_process()) index 54 : idx 49 20000000:01000000:0.0:1783144386.717123:0:93005:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:0.0:1783144386.717217:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:0.0:1783144386.717235:0:93005:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783144386.717253:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:0.0:1783144386.717270:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:0.0:1783144386.717330:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:0.0:1783144386.717339:0:93005:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783144386.717612:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:0.0:1783144386.717636:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:0.0:1783144386.717707:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:0.0:1783144386.717715:0:93005:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783144386.717762:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:0.0:1783144386.717784:0:93005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:0.0:1783144386.717796:0:93005:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783144386.717813:0:93005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717831:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 9 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717839:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 9 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717848:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bbe expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717866:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bcc expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717873:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bda expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717880:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048be8 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717886:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717892:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c04 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717899:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c12 expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717906:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c20 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717911:0:93005:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c2e expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717918:0:93005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717954:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048c2e expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.717979:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048c2e expref: 23 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.717993:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501366784:0@lo:104: 00000100:00100000:0.0:1783144386.718146:0:93005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783144386.718238:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048c20 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718246:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048c20 expref: 23 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718255:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501366912:0@lo:104: 00010000:00010000:0.0:1783144386.718279:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048c12 expref: 23 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718287:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048c12 expref: 23 pid: 92276 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718295:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367040:0@lo:104: 00010000:00010000:0.0:1783144386.718318:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048c04 expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718326:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048c04 expref: 23 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718334:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367168:0@lo:104: 00010000:00010000:0.0:1783144386.718369:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718389:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 23 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718398:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367296:0@lo:104: 00010000:00010000:0.0:1783144386.718423:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048be8 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718431:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048be8 expref: 23 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718438:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367424:0@lo:104: 00010000:00010000:0.0:1783144386.718460:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048bda expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718468:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048bda expref: 23 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718476:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367552:0@lo:104: 00010000:00010000:0.0:1783144386.718497:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048bcc expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718504:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048bcc expref: 23 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718511:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367680:0@lo:104: 00010000:00010000:0.0:1783144386.718533:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048bbe expref: 23 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718564:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048bbe expref: 23 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718572:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367808:0@lo:104: 00010000:00010000:0.0:1783144386.718601:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 9 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718609:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 9 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718619:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367936:192.168.203.4@tcp:104: 00010000:00010000:0.0:1783144386.718693:0:93005:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 9 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.718702:0:93005:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 9 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.718710:0:93005:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501368064:192.168.203.4@tcp:104: 00000100:00100000:0.0:1783144386.718761:0:93005:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016780 going to sleep for 11 seconds 00000100:00100000:1.0:1783144386.718928:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783144386.718949:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.719006:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.719132:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144386.719149:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501366784 00000100:00100000:0.0:1783144386.719156:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501366784 00000100:00100000:2.0:1783144386.719175:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501366912 00000100:00100000:2.0:1783144386.719181:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501366912 00000100:00100000:0.0:1783144386.719197:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501367040 00000100:00100000:0.0:1783144386.719202:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501367040 00000100:00100000:2.0:1783144386.719210:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783144386.719222:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac2ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:93005:x1869759501366784:12345-0@lo:104: 00000100:00100000:0.0:1783144386.719226:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783144386.719237:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:93005:x1869759501366912:12345-0@lo:104: 00010000:00010000:2.0:1783144386.719238:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.719250:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.719338:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.719361:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.719372:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.719381:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.719388:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1783144386.719394:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:3.0:1783144386.719425:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501366784:0@lo:104: 00000100:00100000:3.0:1783144386.719436:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501366912:0@lo:104: 00010000:00010000:2.0:1783144386.719477:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783144386.719485:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac2ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:93005:x1869759501366784:12345-0@lo:104: Request processed in 266us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144386.719493:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783144386.719537:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144386.719549:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501367168 00000100:00100000:2.0:1783144386.719552:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501367168 00000100:00100000:2.0:1783144386.719566:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501367296 00000100:00100000:2.0:1783144386.719575:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501367296 00000100:00100000:2.0:1783144386.719589:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501367424 00000100:00100000:2.0:1783144386.719591:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501367424 00000100:00100000:2.0:1783144386.719600:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501367552 00000100:00100000:2.0:1783144386.719603:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501367552 00000100:00100000:2.0:1783144386.719613:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501367680 00000100:00100000:2.0:1783144386.719615:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501367680 00000100:00100000:2.0:1783144386.719623:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501367808 00000100:00100000:2.0:1783144386.719626:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501367808 00000100:00100000:2.0:1783144386.719643:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783144386.719650:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:93005:x1869759501367040:12345-0@lo:104: 00010000:00010000:2.0:1783144386.719658:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.719864:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367040:0@lo:104: 00010000:00010000:0.0:1783144386.720269:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1783144386.720275:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783144386.720278:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:93005:x1869759501366912:12345-0@lo:104: Request processed in 1042us (1327us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144386.720283:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720288:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:1.0:1783144386.720298:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fe00 already unused, calling callback (ffffffffc1204c20) 00000100:00100000:0.0:1783144386.720309:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 10000000:00010000:1.0:1783144386.720310:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720320:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:93005:x1869759501367168:12345-0@lo:104: 00010000:00010000:1.0:1783144386.720323:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720330:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144386.720333:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144386.720361:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144386.720388:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783144386.720392:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:93005:x1869759501367168:12345-0@lo:104: Request processed in 77us (1261us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144386.720396:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720399:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:1.0:1783144386.720407:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783144386.720413:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783144386.720419:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:93005:x1869759501367296:12345-0@lo:104: 00010000:00010000:0.0:1783144386.720426:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720432:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720441:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a423048c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c35 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720451:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1783144386.720454:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1783144386.720458:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:93005:x1869759501367296:12345-0@lo:104: Request processed in 38us (1120us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144386.720461:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720465:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:1.0:1783144386.720473:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144386.720477:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720477:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783144386.720485:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:93005:x1869759501367424:12345-0@lo:104: 00010000:00010000:1.0:1783144386.720496:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720497:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144386.720522:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144386.720528:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144386.720544:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720551:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783144386.720556:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:93005:x1869759501367424:12345-0@lo:104: Request processed in 72us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144386.720562:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00010000:1.0:1783144386.720563:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144386.720573:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720575:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783144386.720583:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:93005:x1869759501367552:12345-0@lo:104: 00010000:00010000:1.0:1783144386.720587:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423048c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c27 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720590:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720608:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783144386.720613:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720620:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fa00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144386.720623:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720630:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144386.720636:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144386.720641:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144386.720660:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720666:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144386.720692:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720699:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fa00/0xad8e53a423048c12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c19 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720707:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144386.720709:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720714:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ea00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144386.720717:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720738:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144386.720744:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144386.720748:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144386.720759:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720765:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144386.720771:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720797:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a423048c04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048c0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720800:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783144386.720810:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:93005:x1869759501367552:12345-0@lo:104: Request processed in 227us (1436us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144386.720812:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144386.720816:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720822:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144386.720828:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720830:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:1.0:1783144386.720841:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144386.720848:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720849:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 10000000:01000000:1.0:1783144386.720858:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783144386.720860:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af6ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:93005:x1869759501367680:12345-0@lo:104: 00010000:00010000:0.0:1783144386.720871:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720879:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720887:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144386.720894:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720900:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1783144386.720901:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a423048bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bfd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720907:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af6ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:93005:x1869759501367680:12345-0@lo:104: Request processed in 48us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144386.720917:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:1.0:1783144386.720920:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1783144386.720930:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00010000:00010000:1.0:1783144386.720931:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.720940:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:93005:x1869759501367808:12345-0@lo:104: 00010000:00010000:1.0:1783144386.720942:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144386.720948:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.720950:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.720955:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144386.720977:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144386.720982:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144386.720999:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.721004:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144386.721010:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721010:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783144386.721021:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:93005:x1869759501367808:12345-0@lo:104: Request processed in 83us (1481us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144386.721022:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516e00/0xad8e53a423048be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721031:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783144386.721065:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144386.721094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144386.721122:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144386.721142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144386.721161:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783144386.721166:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144386.721187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144386.721213:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144386.721244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783144386.721265:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783144386.721269:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721276:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517200 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144386.721280:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721288:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144386.721295:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144386.721310:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144386.721328:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721334:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144386.721340:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721346:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a423048bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048be1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721356:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144386.721359:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721364:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144386.721367:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721374:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144386.721380:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144386.721386:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144386.721401:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721420:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144386.721432:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144386.721433:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.721438:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721445:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518e00/0xad8e53a423048bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bd3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.721449:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144386.721456:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.721462:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144386.721465:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144386.721467:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144386.721477:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721480:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501368448:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1783144386.721491:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144386.721497:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144386.721515:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.721521:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783144386.721526:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144386.721537:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.721651:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048bc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.721664:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144386.721666:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144386.721667:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144386.721687:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501368576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144386.721696:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501368960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.721742:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.721773:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501369088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144386.721786:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.721813:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144386.721814:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501368192 00000100:00100000:0.0:1783144386.721819:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501368192 00010000:00010000:0.0:1783144386.721839:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c2e expref: 24 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721853:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501368704 00000100:00100000:0.0:1783144386.721855:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501368704 00010000:00010000:0.0:1783144386.721862:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 25 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721869:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501368320 00000100:00100000:0.0:1783144386.721871:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501368320 00010000:00010000:0.0:1783144386.721877:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c20 expref: 26 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721884:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501368832 00000100:00100000:0.0:1783144386.721886:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501368832 00010000:00010000:0.0:1783144386.721893:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048be8 expref: 27 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721907:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501368448 00000100:00100000:0.0:1783144386.721909:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501368448 00010000:00010000:0.0:1783144386.721917:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c12 expref: 28 pid: 92276 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721924:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501368576 00000100:00100000:0.0:1783144386.721926:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501368576 00010000:00010000:0.0:1783144386.721932:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c04 expref: 29 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501368960 00000100:00100000:0.0:1783144386.721940:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501368960 00010000:00010000:0.0:1783144386.721946:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bda expref: 30 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721953:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369088 00000100:00100000:0.0:1783144386.721955:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369088 00010000:00010000:0.0:1783144386.721963:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bcc expref: 31 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.721975:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:0.0:1783144386.721981:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+31:3648:x1869759501368192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144386.721992:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144386.721996:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c2e expref: 31 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722006:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048c2e expref: 31 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722017:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048c2e expref: 31 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722032:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144386.722053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+30:3648:x1869759501368192:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144386.722059:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:0.0:1783144386.722070:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:0.0:1783144386.722075:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+29:3648:x1869759501368704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144386.722081:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144386.722085:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 29 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722093:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 29 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722102:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144386.722123:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367168:0@lo:104: 00000100:00100000:0.0:1783144386.722140:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+29:3648:x1869759501368704:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (995us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144386.722141:0:93005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a423048bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048bf6 expref: 29 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.722154:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:0.0:1783144386.722166:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:0.0:1783144386.722174:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+27:3648:x1869759501368320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144386.722181:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783144386.722185:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367296:0@lo:104: 00010000:00010000:0.0:1783144386.722187:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c20 expref: 27 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722199:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048c20 expref: 27 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.722208:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367424:0@lo:104: 00010000:00010000:0.0:1783144386.722211:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048c20 expref: 27 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.722220:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367552:0@lo:104: 00010000:00010000:0.0:1783144386.722227:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144386.722233:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367680:0@lo:104: 00000100:00100000:1.0:1783144386.722247:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367808:0@lo:104: 00000100:00100000:0.0:1783144386.722252:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3648:x1869759501368320:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144386.722258:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:1.0:1783144386.722297:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1783144386.722305:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1783144386.722310:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3648:x1869759501368832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144386.722317:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3650:x1869759501368448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144386.722321:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144386.722327:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144386.722328:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144386.722329:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048be8 expref: 25 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722336:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c12 expref: 25 pid: 92276 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.722346:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048be8 expref: 25 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.722368:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048c12 expref: 25 pid: 92276 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144386.722462:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00010000:00010000:1.0:1783144386.722472:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01800/0xad8e53a423048bef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048be8 expref: 25 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144386.722474:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3651:x1869759501368576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144386.722476:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac1518200/0xad8e53a423048c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048c12 expref: 25 pid: 92276 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.722491:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144386.722495:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144386.722505:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048c04 expref: 24 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.722517:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048c04 expref: 24 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.722526:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501368832:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (1280us total) trans 0 rc 0/0 00010000:00010000:3.0:1783144386.722531:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517c00/0xad8e53a423048c0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048c04 expref: 24 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.722537:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00010000:00010000:3.0:1783144386.722549:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144386.722554:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144386.722592:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3651:x1869759501368576:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144386.722599:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3650:x1869759501368448:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144386.722603:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:0.0:1783144386.722613:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1783144386.722623:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:1.0:1783144386.722633:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3650:x1869759501368960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144386.722641:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144386.722645:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:1.0:1783144386.722647:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bda expref: 20 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144386.722655:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:93005:x1869759501367040:12345-0@lo:104: Request processed in 3004us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144386.722669:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00010000:1.0:1783144386.722674:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048bda expref: 20 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.722700:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00e00/0xad8e53a423048be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048bda expref: 20 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.722711:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144386.722761:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3650:x1869759501368960:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144386.725014:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1783144386.725034:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:3651:x1869759501369088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144386.725048:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144386.725054:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bcc expref: 18 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.725069:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048bcc expref: 18 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.725083:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6f800/0xad8e53a423048bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048bcc expref: 18 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144386.725097:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144386.725235:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:3651:x1869759501369088:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144386.725243:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1783144386.725277:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144386.726016:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501369216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144386.726048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1783144386.726063:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144386.726132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144386.726184:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1783144386.726193:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501368576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144386.726205:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501369088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.726221:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481702912 00000100:00100000:0.0:1783144386.726226:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703040 00000100:00100000:1.0:1783144386.726229:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481702912 00000100:00100000:0.0:1783144386.726232:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703040 00010000:00010000:0.0:1783144386.726262:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 11 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.726263:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 11 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144386.726303:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2570 00000100:00100000:0.0:1783144386.726309:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2405:x1869759481703040:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144386.726324:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144386.726327:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 11 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.726334:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 11 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.726343:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144386.726369:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2405:x1869759481703040:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144386.726374:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2570 00000100:00100000:0.0:1783144386.726383:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2571 00000100:00100000:0.0:1783144386.726387:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481702912:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144386.726391:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144386.726394:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 10 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.726399:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 10 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144386.726404:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144386.726416:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481702912:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144386.726422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2571 00010000:00010000:1.0:1783144386.726667:0:93005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ca3 expref: 9 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.726691:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501367936:192.168.203.4@tcp:104: 00010000:00010000:1.0:1783144386.726703:0:93005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac1518800/0xad8e53a423048bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c9c expref: 8 pid: 92277 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.726713:0:93005:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93005:1869759501368064:192.168.203.4@tcp:104: 00010000:00010000:1.0:1783144386.726765:0:93005:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.726868:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.726879:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.726896:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.726904:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501368704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.726943:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501368448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.726951:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501368960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144386.726976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144386.727148:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369216 00000100:00100000:1.0:1783144386.727152:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369216 00010000:00010000:1.0:1783144386.727169:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bbe expref: 16 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144386.727189:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1783144386.727197:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:3649:x1869759501369216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144386.727206:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144386.727210:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048bbe expref: 16 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727220:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048bbe expref: 16 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727231:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048bbe expref: 16 pid: 92275 timeout: 3021 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727241:0:26153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727249:0:26153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727273:0:26153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727280:0:26153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727287:0:26153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727293:0:26153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727299:0:26153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144386.727303:0:26153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727310:0:26153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727323:0:26153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.727332:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144386.728069:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:3649:x1869759501369216:12345-0@lo:103:ldlm_bl.0 Request processed in 871us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144386.728077:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1783144386.728143:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501369216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144386.728167:0:93005:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.728187:0:93005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.728194:0:93005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6f600/0xad8e53a423048c43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144386.728901:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144387.085953:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501369344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144387.086038:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144387.086062:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501369472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144387.086090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144387.086126:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369472 00000100:00100000:0.0:1783144387.086127:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369344 00000100:00100000:3.0:1783144387.086133:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369472 00000100:00100000:0.0:1783144387.086133:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369344 00000100:00100000:3.0:1783144387.086181:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:3.0:1783144387.086191:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501369472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144387.086217:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144387.086257:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1869759501369472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144387.086264:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:3.0:1783144387.086305:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501369472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144387.086646:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:0.0:1783144387.086654:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501369344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144387.086751:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144387.086785:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501369344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144387.086791:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00080000:2.0:1783144387.086838:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144387.086843:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144387.086895:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501369344:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144387.534051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783144388.301899:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144388.301906:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2aefdd9000 from 55 10000000:01000000:1.0:1783144388.301911:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144388.301955:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.301966:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.301976:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.301998:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501369600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.302056:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.302101:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ae0a0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.302750:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369600 00000100:00100000:3.0:1783144388.302757:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369600 00000100:00100000:3.0:1783144388.302807:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783144388.302816:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501369600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144388.302827:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144388.302841:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423048c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c4a expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.302862:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423048c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c4a expref: 16 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.302890:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423048c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c4a expref: 16 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.302898:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00c00, rc 0) 00000100:00100000:3.0:1783144388.303000:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee667450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501369600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.303007:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783144388.303106:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501369600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144388.303119:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.303128:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144388.303179:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501369728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.303203:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.303273:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144388.304678:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369728 00000100:00100000:2.0:1783144388.304686:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369728 00000100:00100000:2.0:1783144388.304751:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783144388.304760:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501369728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144388.304892:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501369728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.304900:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783144388.304975:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501369728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.305010:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501369856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.305054:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.305128:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369856 00000100:00100000:1.0:1783144388.305133:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369856 00000100:00100000:0.0:1783144388.305144:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144388.305169:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783144388.305183:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501369856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.305267:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501369856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.305275:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783144388.305304:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501369856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.305659:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93007:1869759501369984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.305706:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.305751:0:93007:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783144388.305809:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501369984 00000100:00100000:1.0:1783144388.305814:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501369984 00000100:00100000:1.0:1783144388.305845:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783144388.305852:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:93007:x1869759501369984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144388.305969:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:93007:x1869759501369984:12345-0@lo:502:llog_process_th.0 Request processed in 117us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.305976:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783144388.306243:0:93007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93007:1869759501369984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.306279:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93007:1869759501370112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.306314:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.306369:0:93007:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.306388:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501370112 00000100:00100000:3.0:1783144388.306393:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501370112 00000100:00100000:3.0:1783144388.306429:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783144388.306436:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:93007:x1869759501370112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.306511:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:93007:x1869759501370112:12345-0@lo:502:llog_process_th.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.306518:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783144388.307289:0:93007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93007:1869759501370112:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783144388.307312:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1783144388.308336:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1783144388.308357:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144388.308366:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.308377:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144388.308386:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783144388.308388:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:1.0:1783144388.308391:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783144388.308416:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.308425:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.308433:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.308456:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.308493:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.308579:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144388.308616:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501370240 00000100:00100000:2.0:1783144388.308621:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501370240 00000100:00100000:2.0:1783144388.308704:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783144388.308713:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501370240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144388.308741:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144388.308752:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517400/0xad8e53a423048c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c58 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.308771:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517400/0xad8e53a423048c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c58 expref: 17 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.308781:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517400/0xad8e53a423048c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c58 expref: 17 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.308789:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517400, rc 0) 00000100:00100000:2.0:1783144388.308862:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501370240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.308869:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783144388.308973:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144388.308993:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.309002:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.309047:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.309070:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.309092:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.309112:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501370368 00000100:00100000:3.0:1783144388.309118:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501370368 00000100:00100000:3.0:1783144388.309271:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783144388.309278:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501370368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.309372:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501370368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.309379:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783144388.309403:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.309432:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.309467:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.309486:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144388.309531:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501370496 00000100:00100000:2.0:1783144388.309535:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501370496 00000100:00100000:2.0:1783144388.309586:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783144388.309592:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac7d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501370496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144388.309663:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac7d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501370496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.309681:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783144388.309751:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.310250:0:93008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93008:1869759501370624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.310283:0:93008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.310310:0:93008:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.310481:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501370624 00000100:00100000:3.0:1783144388.310485:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501370624 00000100:00100000:3.0:1783144388.310513:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783144388.310520:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:93008:x1869759501370624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.310644:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:93008:x1869759501370624:12345-0@lo:502:llog_process_th.0 Request processed in 124us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.310651:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783144388.310775:0:93008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93008:1869759501370624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144388.310794:0:93008:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144388.310804:0:93008:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144388.310806:0:93008:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1783144388.310810:0:93008:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1783144388.310826:0:93008:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1783144388.311335:0:93008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93008:1869759501370752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144388.311367:0:93008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.311397:0:93008:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac5561540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.311440:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501370752 00000100:00100000:3.0:1783144388.311444:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501370752 00000100:00100000:3.0:1783144388.311474:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783144388.311480:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:93008:x1869759501370752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.311548:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:93008:x1869759501370752:12345-0@lo:502:llog_process_th.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.311555:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783144388.311622:0:93008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93008:1869759501370752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144388.311640:0:93008:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144388.311644:0:93008:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144388.311645:0:93008:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1783144388.311649:0:93008:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1783144388.311792:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:3.0:1783144388.311817:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783144388.311825:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.311834:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144388.311842:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144388.311845:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 55 10000000:01000000:3.0:1783144388.311847:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144388.311866:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.311874:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.311881:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144388.311899:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.311923:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.311957:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501370880 00000100:00100000:3.0:1783144388.311960:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144388.311962:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501370880 00000100:00100000:0.0:1783144388.312004:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783144388.312014:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501370880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144388.312023:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144388.312033:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c66 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.312051:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c66 expref: 18 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.312059:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c66 expref: 18 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.312064:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6e000, rc 0) 00000020:01000004:2.0:1783144388.312086:0:93009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2aefdd9000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783144388.312092:0:93009:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefdd9000 4 00000100:00100000:0.0:1783144388.312099:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501370880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144388.312104:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783144388.312124:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501370880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144388.312138:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.312148:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.312191:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.312216:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.312234:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.312306:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371008 00000100:00100000:3.0:1783144388.312310:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371008 00000100:00100000:3.0:1783144388.312343:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783144388.312350:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501371008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.312456:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501371008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.312463:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783144388.312680:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.312704:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.312752:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.312766:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144388.312908:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371136 00000100:00100000:2.0:1783144388.312913:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371136 00000100:00100000:2.0:1783144388.312958:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783144388.312965:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501371136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144388.313030:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501371136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.313035:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783144388.313092:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.313479:0:93010:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93010:1869759501371264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144388.313512:0:93010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.313569:0:93010:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144388.313596:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371264 00000100:00100000:0.0:1783144388.313600:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371264 00000100:00100000:0.0:1783144388.313634:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783144388.313640:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:93010:x1869759501371264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.313823:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:93010:x1869759501371264:12345-0@lo:502:llog_process_th.0 Request processed in 182us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144388.313830:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783144388.313894:0:93010:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93010:1869759501371264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144388.313925:0:93010:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93010:1869759501371392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144388.314050:0:93010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.314106:0:93010:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9e26480 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.314736:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371392 00000100:00100000:3.0:1783144388.314741:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371392 00000100:00100000:3.0:1783144388.314905:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783144388.314916:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:93010:x1869759501371392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.315001:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:93010:x1869759501371392:12345-0@lo:502:llog_process_th.0 Request processed in 85us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.315008:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783144388.315079:0:93010:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93010:1869759501371392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144388.315099:0:93010:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1783144388.315166:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1783144388.315190:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144388.315199:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.315208:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144388.315216:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783144388.315218:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:0.0:1783144388.315221:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783144388.315240:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.315247:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.315255:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144388.315268:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.315295:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.315322:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.315325:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371520 00000100:00100000:3.0:1783144388.315331:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371520 00000100:00100000:3.0:1783144388.315387:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783144388.315394:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501371520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144388.315402:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144388.315412:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423048c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c74 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.315430:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423048c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c74 expref: 19 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.315447:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423048c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c74 expref: 19 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.315454:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01a00, rc 0) 00000100:00100000:3.0:1783144388.315490:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501371520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.315497:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783144388.315553:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144388.315571:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.315579:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144388.315619:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.315641:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.315662:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.315716:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371648 00000100:00100000:3.0:1783144388.315948:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371648 00000100:00100000:3.0:1783144388.315978:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783144388.315984:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501371648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.316370:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501371648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.316378:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783144388.316710:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.316770:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.316806:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.316823:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.316875:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371776 00000100:00100000:3.0:1783144388.316879:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371776 00000100:00100000:3.0:1783144388.316912:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783144388.316919:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501371776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.317016:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501371776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.317023:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783144388.317132:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501371776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.318282:0:93011:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93011:1869759501371904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.318325:0:93011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.318387:0:93011:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.318416:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501371904 00000100:00100000:3.0:1783144388.318420:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501371904 00000100:00100000:3.0:1783144388.318658:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783144388.318677:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:93011:x1869759501371904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.318859:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:93011:x1869759501371904:12345-0@lo:502:llog_process_th.0 Request processed in 193us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.318873:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783144388.318932:0:93011:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93011:1869759501371904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144388.318951:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783144388.318960:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144388.318962:0:93011:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1783144388.318968:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1783144388.318981:0:93011:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1783144388.319056:0:93011:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93011:1869759501372032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.319086:0:93011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.319148:0:93011:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.319174:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372032 00000100:00100000:3.0:1783144388.319178:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372032 00000100:00100000:3.0:1783144388.319238:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783144388.319245:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:93011:x1869759501372032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.319309:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:93011:x1869759501372032:12345-0@lo:502:llog_process_th.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.319315:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783144388.319366:0:93011:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93011:1869759501372032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144388.319381:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144388.319385:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144388.319386:0:93011:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783144388.319390:0:93011:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:1.0:1783144388.319697:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:1.0:1783144388.319753:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783144388.319820:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.319832:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144388.319841:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144388.319844:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 55 10000000:01000000:1.0:1783144388.319847:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144388.319868:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.319876:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.319885:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.320026:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.320184:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.320246:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.320276:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372160 00000100:00100000:3.0:1783144388.320280:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372160 00000100:00100000:3.0:1783144388.320344:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783144388.320353:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501372160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144388.320361:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144388.320372:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00400/0xad8e53a423048c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c82 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.320391:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00400/0xad8e53a423048c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c82 expref: 20 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.320402:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00400/0xad8e53a423048c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c82 expref: 20 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.320411:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00400, rc 0) 00000100:00100000:3.0:1783144388.320476:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501372160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.320482:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783144388.320538:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144388.320550:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.320558:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.320603:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.320627:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.320651:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144388.320699:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372288 00000100:00100000:0.0:1783144388.320703:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372288 00000100:00100000:0.0:1783144388.320883:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783144388.320891:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501372288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.320985:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501372288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144388.320993:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783144388.321009:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.321048:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.321085:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144388.321100:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372416 00000100:00100000:1.0:1783144388.321107:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.321112:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372416 00000100:00100000:3.0:1783144388.321133:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783144388.321139:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501372416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.321210:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501372416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.321217:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783144388.321229:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144388.321506:0:93012:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93012:1869759501372544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144388.321776:0:93012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144388.321796:0:93012:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.321841:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372544 00000100:00100000:3.0:1783144388.321845:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372544 00000100:00100000:3.0:1783144388.321871:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783144388.321879:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:93012:x1869759501372544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.321957:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:93012:x1869759501372544:12345-0@lo:502:llog_process_th.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.321964:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783144388.322100:0:93012:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93012:1869759501372544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144388.322136:0:93012:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93012:1869759501372672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.322152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144388.322173:0:93012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144388.322200:0:93012:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3d2f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.322412:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703168 00000100:00100000:3.0:1783144388.322417:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703168 00000100:00100000:3.0:1783144388.322444:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372672 00000100:00100000:3.0:1783144388.322447:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372672 00000100:00100000:3.0:1783144388.322461:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:3.0:1783144388.322466:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481703168:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144388.322474:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144388.322485:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00600/0xad8e53a423048c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41caa expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.322502:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00600/0xad8e53a423048c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41caa expref: 9 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.322512:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00600/0xad8e53a423048c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41caa expref: 9 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144388.322514:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783144388.322524:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:93012:x1869759501372672:12345-0@lo:502:llog_process_th.0 00010000:00010000:3.0:1783144388.322529:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00600, rc 0) 00000100:00100000:3.0:1783144388.322570:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481703168:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 102us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.322576:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 145 00000100:00100000:2.0:1783144388.322655:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:93012:x1869759501372672:12345-0@lo:502:llog_process_th.0 Request processed in 133us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.322662:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783144388.322753:0:93012:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93012:1869759501372672:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783144388.322818:0:93012:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1783144388.322875:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1783144388.322901:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144388.322910:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.322920:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144388.322928:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783144388.322945:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783144388.322948:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783144388.322961:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.322967:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.322971:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.322980:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.322999:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.323019:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9e26d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.323030:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372800 00000100:00100000:3.0:1783144388.323034:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372800 00000100:00100000:2.0:1783144388.323127:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783144388.323133:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501372800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144388.323140:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144388.323147:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516400/0xad8e53a423048c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048c97 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.323158:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516400/0xad8e53a423048c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048c97 expref: 21 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.323173:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516400/0xad8e53a423048c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048c97 expref: 21 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.323177:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516400, rc 0) 00000100:00100000:2.0:1783144388.323202:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501372800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.323206:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783144388.323240:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144388.323252:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.323261:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144388.323301:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.323326:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.323375:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9e26d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144388.323376:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501372928 00000100:00100000:0.0:1783144388.323380:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501372928 00000100:00100000:0.0:1783144388.323408:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783144388.323416:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501372928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.323491:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501372928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144388.323497:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783144388.323503:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501372928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.323526:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.323559:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.323575:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9e26d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144388.323582:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373056 00000100:00100000:2.0:1783144388.323585:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373056 00000100:00100000:2.0:1783144388.323606:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783144388.323611:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501373056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144388.323663:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501373056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.323679:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783144388.323700:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.323838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144388.323862:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703296 00000100:00100000:1.0:1783144388.323866:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703296 00000100:00100000:1.0:1783144388.323889:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 150 00000100:00100000:1.0:1783144388.323894:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481703296:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.323944:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481703296:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 51us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.323951:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 150 00000040:00080000:1.0:1783144388.325205:0:93013:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000100:00100000:3.0:1783144388.325424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144388.325457:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703424 00000100:00100000:2.0:1783144388.325462:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703424 00000100:00100000:2.0:1783144388.325492:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 151 00000100:00100000:2.0:1783144388.325498:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481703424:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000020:01000000:3.0:1783144388.325639:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783144388.325658:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783144388.325675:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.325686:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144388.325696:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144388.325698:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 55 10000000:01000000:3.0:1783144388.325702:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1783144388.325753:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481703424:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 252us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.325762:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 151 00010000:00010000:3.0:1783144388.325845:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.325854:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.325862:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144388.325886:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.325918:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144388.325951:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373184 00000100:00100000:2.0:1783144388.325955:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373184 00000100:00100000:2.0:1783144388.326033:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783144388.326041:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501373184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144388.326058:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144388.326069:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517200/0xad8e53a423048cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048ca5 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.326097:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517200/0xad8e53a423048cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048ca5 expref: 22 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.326107:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517200/0xad8e53a423048cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048ca5 expref: 22 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.326117:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517200, rc 0) 00000100:00100000:2.0:1783144388.326142:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501373184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.326148:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783144388.326588:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.326605:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144388.326619:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.326627:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048cac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144388.326688:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.326712:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144388.326749:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799840 going to sleep for 11 seconds 00000100:00100000:1.0:1783144388.326755:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373312 00000100:00100000:1.0:1783144388.326759:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373312 00000100:00100000:1.0:1783144388.326788:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783144388.326796:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501373312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.326876:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501373312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.326884:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783144388.327785:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.327820:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.327905:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144388.327930:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799840 going to sleep for 11 seconds 00000100:00100000:1.0:1783144388.328050:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373440 00000100:00100000:1.0:1783144388.328055:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373440 00000100:00100000:1.0:1783144388.328127:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783144388.328135:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501373440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.328208:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501373440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.328214:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783144388.328247:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.328596:0:93014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93014:1869759501373568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.328630:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144388.329286:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373568 00000100:00100000:1.0:1783144388.329292:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373568 00000100:00100000:3.0:1783144388.329303:0:93014:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799240 going to sleep for 11 seconds 00000100:00100000:1.0:1783144388.329321:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783144388.329335:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:93014:x1869759501373568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144388.329423:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:93014:x1869759501373568:12345-0@lo:502:llog_process_th.0 Request processed in 88us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.329430:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783144388.329468:0:93014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93014:1869759501373568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.329503:0:93014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93014:1869759501373696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144388.329539:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144388.329560:0:93014:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799240 going to sleep for 11 seconds 00000100:00100000:0.0:1783144388.329603:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373696 00000100:00100000:0.0:1783144388.329607:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373696 00000100:00100000:0.0:1783144388.329641:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783144388.329648:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:93014:x1869759501373696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144388.329772:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:93014:x1869759501373696:12345-0@lo:502:llog_process_th.0 Request processed in 124us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144388.329788:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783144388.329882:0:93014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:93014:1869759501373696:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783144388.329910:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1783144388.330003:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1783144388.330023:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144388.330031:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.330041:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144388.330050:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783144388.330052:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783144388.330055:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783144388.330075:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.330083:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.330091:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144388.330100:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.330120:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.330141:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783144388.330151:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373824 00000100:00100000:3.0:1783144388.330155:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373824 00000100:00100000:3.0:1783144388.330184:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783144388.330191:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501373824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144388.330200:0:92277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144388.330210:0:92277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048cb3 expref: -99 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.330341:0:92277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048cb3 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.330350:0:92277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048cb3 expref: 23 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.330357:0:92277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01c00, rc 0) 00000100:00100000:3.0:1783144388.330391:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501373824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144388.330398:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783144388.330765:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144388.330778:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.330796:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144388.330838:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.330859:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.330876:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ddf240 going to sleep for 11 seconds 00000100:00100000:2.0:1783144388.331059:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501373952 00000100:00100000:2.0:1783144388.331065:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501373952 00000100:00100000:2.0:1783144388.331091:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783144388.331100:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501373952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.331111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144388.331166:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703552 00000100:00100000:0.0:1783144388.331170:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703552 00000100:00100000:0.0:1783144388.331201:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:0.0:1783144388.331208:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71802:x1869759481703552:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783144388.331219:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501373952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.331227:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783144388.331252:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501373952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.331276:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501374080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.331534:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71802:x1869759481703552:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 325us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144388.331541:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 159 00000100:00100000:3.0:1783144388.331686:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144388.332323:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144388.332373:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374080 00000100:00100000:1.0:1783144388.332378:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374080 00000100:00100000:1.0:1783144388.332416:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783144388.332424:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501374080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144388.332645:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501374080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.332652:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783144388.333343:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501374080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.333643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144388.333980:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703680 00000100:00100000:1.0:1783144388.333985:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703680 00000100:00100000:1.0:1783144388.334021:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 161 00000100:00100000:1.0:1783144388.334029:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71802:x1869759481703680:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783144388.334122:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:71802:x1869759481703680:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 92us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.334129:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 161 00000040:00080000:3.0:1783144388.335637:0:93015:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783144388.335870:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783144388.335942:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783144388.335953:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.335963:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144388.335972:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783144388.335975:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144388.335977:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783144388.336006:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.336025:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144388.336035:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144388.336055:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501374208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144388.336103:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144388.336171:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2affdbd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144388.336297:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374208 00000100:00100000:1.0:1783144388.336303:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374208 00000100:00100000:1.0:1783144388.336380:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783144388.336390:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501374208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144388.336400:0:92275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144388.336411:0:92275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac1518a00/0xad8e53a423048cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048cc1 expref: -99 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.336442:0:92275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac1518a00/0xad8e53a423048cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048cc1 expref: 24 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.336452:0:92275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac1518a00/0xad8e53a423048cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048cc1 expref: 24 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144388.336460:0:92275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1518a00, rc 0) 00000100:00100000:1.0:1783144388.336499:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501374208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144388.336506:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783144388.336646:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501374208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144388.336658:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.336677:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048cc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144388.336748:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501374336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144388.336773:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144388.336881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144388.337920:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144388.338264:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374336 00000100:00100000:2.0:1783144388.338267:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703808 00000100:00100000:0.0:1783144388.338271:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374336 00000100:00100000:2.0:1783144388.338273:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703808 00000100:00100000:2.0:1783144388.338311:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:2.0:1783144388.338318:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481703808:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144388.338329:0:92276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783144388.338340:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00010000:00010000:2.0:1783144388.338349:0:92276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cb1 expref: -99 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144388.338353:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501374336:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:2.0:1783144388.338377:0:92276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cb1 expref: 10 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.338387:0:92276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cb1 expref: 10 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144388.338394:0:92276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516000, rc 0) 00000100:00100000:2.0:1783144388.338446:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481703808:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 127us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144388.338453:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 163 00000100:00100000:0.0:1783144388.338868:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501374336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 517us (2091us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783144388.338876:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783144388.338910:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501374336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783144388.338954:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783144388.338961:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144388.338969:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048cc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144388.341475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144388.341537:0:92276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481703936 00000100:00100000:2.0:1783144388.341544:0:92276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481703936 00000100:00100000:2.0:1783144388.341590:0:92276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 165 00000100:00100000:2.0:1783144388.341598:0:92276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481703936:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144388.341700:0:92276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481703936:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 102us (230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144388.341708:0:92276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 165 00010000:00010000:3.0:1783144388.557968:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144389.252176:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.252234:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481704064 00000100:00100000:3.0:1783144389.252242:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481704064 00000100:00080000:2.0:1783144389.252310:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144389.252320:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1238 00000100:00100000:3.0:1783144389.252334:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:71822:x1869759481704064:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1783144389.252359:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.252376:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cb8 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.252444:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048cdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.252458:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.252470:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144389.252517:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144389.252521:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144389.252553:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.252575:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cb8 expref: 8 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.252591:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048cdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cb8 expref: 7 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.252867:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144389.252871:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144389.252875:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00e00, rc 0) 00000100:00100000:3.0:1783144389.252985:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481704064:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 603us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.252993:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1238 00000100:00100000:3.0:1783144389.255750:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.255917:0:66121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481704192 00000100:00100000:2.0:1783144389.255926:0:66121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481704192 00000100:00100000:2.0:1783144389.256059:0:66121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1783144389.256070:0:66121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481704192:12345-192.168.203.4@tcp:700:mkdir.0 00000100:00100000:2.0:1783144389.256153:0:66121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481704192:12345-192.168.203.4@tcp:700:mkdir.0 Request processed in 85us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.256172:0:66121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1783144389.258416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.258480:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481704448 00000100:00100000:2.0:1783144389.258488:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481704448 00000100:00100000:2.0:1783144389.258534:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1239 00000100:00100000:2.0:1783144389.258543:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481704448:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:2.0:1783144389.258588:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144389.258613:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048cdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cb8 expref: 7 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.258629:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144389.258634:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144389.258697:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.258710:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.258745:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.258760:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.258768:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.258774:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261623:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261646:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261657:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144389.261684:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002248ab1f reply state 00000000ed62af3d transno 115964116995 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261696:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261704:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:2.0:1783144389.261708:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144389.261711:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783144389.261716:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783144389.261785:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261793:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261800:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261867:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144389.261872:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261880:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261900:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144389.261903:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.261907:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261913:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048ce4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144389.261927:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002248ab1f reply state 00000000ed62af3d transno 115964116995 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261936:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.261942:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c29cd29e700) 00010000:00010000:2.0:1783144389.261945:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144389.261947:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783144389.262066:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71822:x1869759481704448:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 3520us (3652us total) trans 115964116995 rc 0/0 00000100:00100000:2.0:1783144389.262074:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1239 00000100:00100000:0.0:1783144389.266946:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.268865:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481704576 00000100:00100000:2.0:1783144389.268876:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481704576 00000100:00100000:2.0:1783144389.268931:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1240 00000100:00100000:2.0:1783144389.268941:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71822:x1869759481704576:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1783144389.268961:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144389.268978:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cbf expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.269032:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a423048d00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.269051:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a423048d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.269061:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a423048d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144389.269101:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144389.269105:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144389.269122:0:66112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a423048d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.269147:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cbf expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.269164:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a423048d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cbf expref: 9 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.269173:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144389.269176:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144389.269179:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517a00, rc 0) 00000100:00100000:2.0:1783144389.270502:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71822:x1869759481704576:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 1557us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.270512:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1240 00000100:00100000:3.0:1783144389.275236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.275271:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481704832 00000100:00100000:3.0:1783144389.275280:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481704832 00000100:00100000:3.0:1783144389.275329:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1241 00000100:00100000:3.0:1783144389.275339:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71822:x1869759481704832:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1783144389.275359:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.275379:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048d07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cc6 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275449:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275459:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275467:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275475:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275480:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275483:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144389.275565:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783144389.275625:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275643:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275650:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275657:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275677:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.275682:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275691:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275702:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144389.275706:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144389.275710:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275716:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275746:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275752:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275758:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275769:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.275773:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275779:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275787:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c29cd29e700) 00010000:00010000:3.0:1783144389.275790:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144389.275793:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275799:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275829:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048d07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cc6 expref: 11 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275840:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144389.275842:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144389.275846:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048d07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cc6 expref: 11 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.275857:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01800, rc 0) 00000100:00100000:3.0:1783144389.275910:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71822:x1869759481704832:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 572us (680us total) trans 115964116996 rc 301/301 00000100:00100000:3.0:1783144389.275918:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1241 00000100:00100000:3.0:1783144389.281158:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.281262:0:69845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481704960 00000100:00100000:3.0:1783144389.281270:0:69845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481704960 00000100:00080000:1.0:1783144389.281360:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144389.281379:0:69845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1783144389.281391:0:69845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71822:x1869759481704960:12345-192.168.203.4@tcp:900:mkdir.0 00000100:00100000:3.0:1783144389.281466:0:69845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71822:x1869759481704960:12345-192.168.203.4@tcp:900:mkdir.0 Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.281475:0:69845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1783144389.284114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.284148:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481705216 00000100:00100000:2.0:1783144389.284156:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481705216 00000100:00100000:2.0:1783144389.284202:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:2.0:1783144389.284212:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71822:x1869759481705216:12345-192.168.203.4@tcp:35:mkdir.0 00000100:00100000:2.0:1783144389.284401:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71822:x1869759481705216:12345-192.168.203.4@tcp:35:mkdir.0 Request processed in 189us (293us total) trans 115964116997 rc 0/0 00000100:00100000:2.0:1783144389.285488:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 235 00000100:00100000:1.0:1783144389.286242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.286326:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481705472 00000100:00100000:3.0:1783144389.286335:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481705472 00000100:00100000:3.0:1783144389.286386:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1242 00000100:00100000:3.0:1783144389.286394:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71822:x1869759481705472:12345-192.168.203.4@tcp:36:mkdir.0 00000100:00100000:3.0:1783144389.286499:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374464:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.286540:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.286570:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b017cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.286579:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374464 00000100:00100000:1.0:1783144389.286585:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374464 00000100:00100000:1.0:1783144389.286621:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:1.0:1783144389.286628:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501374464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783144389.287375:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501374464:12345-0@lo:1000:mdt00_002.0 Request processed in 745us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.287384:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:3.0:1783144389.287396:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374464:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.287454:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374592:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.287481:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.287506:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13a66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144389.287741:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374592 00000100:00100000:2.0:1783144389.287746:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374592 00000100:00100000:2.0:1783144389.287775:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:2.0:1783144389.287782:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501374592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.287863:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501374592:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.287871:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:3.0:1783144389.287898:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374592:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.287932:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374720:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.287955:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.287980:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13a66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144389.288001:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374720 00000100:00100000:2.0:1783144389.288005:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374720 00000100:00100000:2.0:1783144389.288030:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1783144389.288038:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501374720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.288098:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501374720:12345-0@lo:1000:mdt00_002.0 Request processed in 62us (142us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144389.288106:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:3.0:1783144389.288119:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374720:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783144389.288157:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.288169:0:66114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.288177:0:66114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144389.288184:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374848:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1783144389.288200:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.288221:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13a6900 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.288290:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374848 00000100:00100000:1.0:1783144389.288295:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374848 00000100:00100000:1.0:1783144389.288327:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:1.0:1783144389.288332:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66114:x1869759501374848:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1783144389.288339:0:78024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144389.288350:0:78024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048d23 expref: -99 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.288374:0:78024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 2/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.288380:0:78024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 8 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.288390:0:78024:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1783144389.288409:0:78024:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1783144389.288435:0:78024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 8 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.288442:0:78024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144389.288445:0:78024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144389.288447:0:78024:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 8 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.288452:0:78024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1518e00, rc 0) 00000100:00100000:1.0:1783144389.288477:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501374848:12345-0@lo:101:mdt00_002.0 Request processed in 145us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.288481:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1783144389.288655:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501374848:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783144389.288677:0:66114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.288687:0:66114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783144389.290647:0:92270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00010000:00010000:1.0:1783144389.290671:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290684:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290703:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290710:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144389.290714:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290741:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290756:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c29cd29e700) 00010000:00010000:1.0:1783144389.290759:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144389.290763:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290770:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048ceb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290790:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290796:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290800:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290805:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144389.290809:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290824:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290832:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144389.290834:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144389.290838:0:3634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 7 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290847:0:3634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 7 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290854:0:3634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 7 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.290883:0:3634:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 7 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.290952:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3634:1869759501374976:0@lo:105: 00000100:00100000:1.0:1783144389.291002:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144389.291044:0:3634:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.291135:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501374976 00000100:00100000:3.0:1783144389.291141:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501374976 00000100:00100000:3.0:1783144389.291190:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783144389.291200:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3634:x1869759501374976:12345-0@lo:105: 00010000:00010000:3.0:1783144389.291210:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291222:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291243:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291251:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291259:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291269:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291294:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c2aeed01800) 00010000:00010000:1.0:1783144389.291312:0:66114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.291320:0:66114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144389.291340:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3634:x1869759501374976:12345-0@lo:105: Request processed in 141us (341us total) trans 0 rc 0/0 00000004:00080000:1.0:1783144389.291340:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1783144389.291350:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:1.0:1783144389.291370:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.291380:0:66114:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.291387:0:66114:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.291399:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375104:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1783144389.291427:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144389.291451:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3182540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.291475:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501375104 00000100:00100000:3.0:1783144389.291481:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501375104 00000100:00100000:1.0:1783144389.291482:0:3634:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3634:1869759501374976:0@lo:105: 00010000:00010000:1.0:1783144389.291499:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.291506:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048cf2 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144389.291515:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:3.0:1783144389.291525:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66114:x1869759501375104:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783144389.291537:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.291550:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d38 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048d31 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291570:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d38 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048d31 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291649:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d38 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d31 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291656:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c2af71eaf00) 00010000:00010000:3.0:1783144389.291659:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144389.291741:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01e00, rc 0) 00000100:00100000:3.0:1783144389.291781:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375104:12345-0@lo:101:mdt00_002.0 Request processed in 259us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.291787:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:3.0:1783144389.291815:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375104:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783144389.291827:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.291836:0:66114:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144389.291847:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1783144389.291875:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375232:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.291899:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.291913:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13a66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.291926:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501375232 00000100:00100000:3.0:1783144389.291929:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501375232 00000100:00100000:3.0:1783144389.291952:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:3.0:1783144389.291958:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.292012:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375232:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.292025:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:3.0:1783144389.292053:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375232:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.292087:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375360:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.292108:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.292121:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b017cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.292131:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501375360 00000100:00100000:3.0:1783144389.292134:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501375360 00000100:00100000:3.0:1783144389.292152:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:3.0:1783144389.292158:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.292222:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375360:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (112us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144389.292230:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:3.0:1783144389.292263:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375360:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.292312:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375488:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.292328:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.292349:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13a66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144389.292378:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501375488 00000100:00100000:2.0:1783144389.292384:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501375488 00000100:00100000:2.0:1783144389.292413:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1783144389.292420:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.292481:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375488:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (150us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144389.292488:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1783144389.292513:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c50e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375488:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.292554:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.292577:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.292603:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.292645:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501375616 00000100:00100000:3.0:1783144389.292649:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501375616 00000100:00100000:3.0:1783144389.292695:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1783144389.292704:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.292904:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375616:12345-0@lo:1000:mdt00_002.0 Request processed in 201us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.292911:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:2.0:1783144389.292986:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.293022:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.293042:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.293062:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.293090:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501375744 00000100:00100000:3.0:1783144389.293095:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501375744 00000100:00100000:3.0:1783144389.293136:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1783144389.293144:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.293198:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375744:12345-0@lo:1000:mdt00_002.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.293204:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:2.0:1783144389.294925:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.294975:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144389.295006:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.295028:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.295045:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501375872 00000100:00100000:3.0:1783144389.295051:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501375872 00000100:00100000:3.0:1783144389.295091:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1783144389.295100:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.295164:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66114:x1869759501375872:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.295171:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:2.0:1783144389.295382:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66114:1869759501375872:0@lo:1000:mdt00_002.0 00000040:00080000:2.0:1783144389.295802:0:66114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].3, 968 off35168 00000040:00080000:3.0:1783144389.297085:0:66114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].3, 1120 off35552 00000004:00080000:3.0:1783144389.297095:0:66114:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c29c4a99840 with version 10 00000004:00080000:2.0:1783144389.297578:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 10 rpc_version 10 00000020:00100000:2.0:1783144389.297606:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783144389.297615:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c29c9e8ed80 x1869759501376128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144389.297635:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501376128:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144389.297694:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.297744:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.297774:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501376128 00000100:00100000:3.0:1783144389.297781:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501376128 00000100:00100000:2.0:1783144389.297893:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:2.0:1783144389.297912:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75523:x1869759501376128:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144389.298281:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75523:x1869759501376128:12345-0@lo:1000:osp_up0-1.0 Request processed in 365us (580us total) trans 115964116998 rc 0/0 00000100:00100000:2.0:1783144389.298289:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:2.0:1783144389.298335:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501376128:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783144389.298403:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298423:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298440:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144389.298457:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005856de7c reply state 000000007b78126e transno 81604378755 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298469:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298477:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144389.298480:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144389.298483:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783144389.298488:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00080000:2.0:1783144389.298494:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1783144389.298503:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298512:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298520:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298536:0:66114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783144389.298540:0:66114:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1783144389.298544:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.298562:0:66114:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144389.298627:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481705472:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 12232us (12388us total) trans 81604378755 rc 0/0 00000100:00100000:2.0:1783144389.298635:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1242 00010000:00010000:3.0:1783144389.299174:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144389.299192:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.299202:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01800 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:3.0:1783144389.299208:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144389.299217:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.299245:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.299259:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144389.299291:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.299299:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2aeed01800/0xad8e53a423048d23 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048d2a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.299319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144389.299322:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144389.299324:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144389.299332:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144389.299347:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501376256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144389.299388:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.299425:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501376256 00000100:00100000:3.0:1783144389.299430:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501376256 00000100:00100000:1.0:1783144389.299946:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1783144389.299957:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3650:x1869759501376256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144389.299969:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144389.299985:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048d2a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048d23 expref: 10 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.300002:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144389.300011:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144389.300042:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3650:x1869759501376256:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.300049:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1783144389.300195:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501376256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144389.302769:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.302835:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481705728 00000100:00100000:3.0:1783144389.302843:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481705728 00000100:00100000:3.0:1783144389.302895:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1243 00000100:00100000:3.0:1783144389.302906:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481705728:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:3.0:1783144389.302958:0:81077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144389.302982:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a423048d00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cbf expref: 7 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.302999:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144389.303003:0:81077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144389.303108:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:71822:x1869759481705728:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 205us (346us total) trans 0 rc -17/-17 00000100:00100000:3.0:1783144389.303124:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1243 00000100:00100000:2.0:1783144389.306599:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.306719:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481705856 00000100:00100000:3.0:1783144389.306818:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481705856 00000100:00100000:3.0:1783144389.306875:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1244 00000100:00100000:3.0:1783144389.306886:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:71822:x1869759481705856:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1783144389.306904:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.306921:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ccd expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.306988:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.307002:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.307013:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144389.307051:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144389.307054:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144389.307070:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.307091:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ccd expref: 8 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.307105:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ccd expref: 7 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.307129:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144389.307132:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144389.307135:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00800, rc 0) 00000100:00100000:3.0:1783144389.307190:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481705856:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 306us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.307198:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1244 00000100:00100000:1.0:1783144389.309168:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.309265:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481705984 00000100:00100000:2.0:1783144389.309273:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481705984 00000100:00100000:2.0:1783144389.309315:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1245 00000100:00100000:2.0:1783144389.309326:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481705984:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:2.0:1783144389.309341:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144389.309354:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516e00/0xad8e53a423048d54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cd4 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309399:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309425:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309434:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309448:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309465:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309472:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309542:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309550:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309558:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144389.309584:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144389.309588:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144389.309602:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309613:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309619:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309625:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309631:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144389.309635:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309648:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309658:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144389.309673:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.309678:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309830:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048d5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309846:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309852:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309858:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309863:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144389.309865:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309871:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309878:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c29cd29ec00) 00010000:00010000:2.0:1783144389.309881:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.309884:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309901:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048d62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309929:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516e00/0xad8e53a423048d54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 9 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309943:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 8 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.309950:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29e000) 00010000:00010000:2.0:1783144389.309953:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144389.309955:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517600, rc 0) 00000100:00100000:2.0:1783144389.310043:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71822:x1869759481705984:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 719us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.310050:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1245 00000100:00100000:1.0:1783144389.312244:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.312316:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481706240 00000100:00100000:2.0:1783144389.312322:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481706240 00000100:00100000:2.0:1783144389.312355:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1246 00000100:00100000:2.0:1783144389.312362:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71822:x1869759481706240:12345-192.168.203.4@tcp:36:mkdir.0 00000100:00100000:2.0:1783144389.312555:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab13800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501376384:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144389.312592:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.312617:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.312655:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501376384 00000100:00100000:3.0:1783144389.312658:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501376384 00000100:00100000:3.0:1783144389.312782:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1783144389.312789:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66112:x1869759501376384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783144389.312865:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66112:x1869759501376384:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.312873:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1783144389.312910:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab13800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501376384:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.312961:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab13800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501376512:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.312991:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144389.315826:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501376512 00000100:00100000:1.0:1783144389.315838:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501376512 00000100:00100000:2.0:1783144389.315890:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:2.0:1783144389.315903:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66112:x1869759501376512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144389.316164:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66112:x1869759501376512:12345-0@lo:1000:mdt00_000.0 Request processed in 264us (3171us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783144389.316177:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:0.0:1783144389.316198:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab13800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501376512:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783144389.316256:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.316272:0:66112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.316282:0:66112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144389.316299:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501376640:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1783144389.316328:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.316380:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.316428:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501376640 00000100:00100000:1.0:1783144389.316432:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501376640 00000100:00100000:1.0:1783144389.316456:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:1.0:1783144389.316463:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501376640:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1783144389.316473:0:78024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144389.316488:0:78024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048d70 expref: -99 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.316512:0:78024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 7 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.316523:0:78024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 11 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.316544:0:78024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 7 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.316556:0:78024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 7 pid: 66143 timeout: 3023 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.316567:0:78024:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:78024:1869759501376768:192.168.203.4@tcp:104: 00000100:00100000:1.0:1783144389.316618:0:78024:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3182900 going to sleep for 11 seconds 00000100:00100000:2.0:1783144389.316702:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:2.0:1783144389.319774:0:78024:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:78024:1869759501376768:192.168.203.4@tcp:104: 00010000:00010000:2.0:1783144389.319811:0:78024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 10 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.319822:0:78024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29e000) 00010000:00010000:2.0:1783144389.319825:0:78024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.319829:0:78024:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 10 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.319837:0:78024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1519a00, rc 0) 00000100:00100000:3.0:1783144389.319979:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501376640:12345-0@lo:101:mdt00_000.0 Request processed in 3514us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.319989:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:0.0:1783144389.320016:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501376640:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1783144389.320035:0:66112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.320047:0:66112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.320141:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.320688:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481706368 00000100:00100000:3.0:1783144389.320695:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481706368 00010000:00010000:3.0:1783144389.320749:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 8 pid: 66143 timeout: 3023 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144389.320783:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2573 00000100:00100000:3.0:1783144389.320844:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2403:x1869759481706368:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783144389.320860:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144389.320868:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 8 pid: 66143 timeout: 3023 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.320900:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 8 pid: 66143 timeout: 3023 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.320921:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517600/0xad8e53a423048d69 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cd4 expref: 8 pid: 66143 timeout: 3023 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.320937:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29e000) 00010000:00010000:3.0:1783144389.320943:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 9 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.320953:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 9 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.320962:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 9 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.320991:0:9526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 9 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144389.321004:0:9526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9526:1869759501376896:0@lo:105: 00000100:00100000:3.0:1783144389.321037:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.321077:0:9526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13a66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.321314:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501376896 00000100:00100000:1.0:1783144389.321319:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501376896 00000100:00100000:1.0:1783144389.321353:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783144389.321361:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9526:x1869759501376896:12345-0@lo:105: 00010000:00010000:1.0:1783144389.321371:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.321381:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.321390:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.321397:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.321405:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.321516:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.321547:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c2af9f6ee00) 00000100:00100000:1.0:1783144389.321627:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9526:x1869759501376896:12345-0@lo:105: Request processed in 266us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.321634:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:0.0:1783144389.321636:0:66112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.321648:0:66112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783144389.321681:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1783144389.321703:0:9526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9526:1869759501376896:0@lo:105: 00010000:00010000:3.0:1783144389.321715:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144389.321749:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.321758:0:66112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.321780:0:66112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.321852:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377024:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1783144389.321882:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144389.321914:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3182900 going to sleep for 11 seconds 00000100:00100000:2.0:1783144389.321965:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501377024 00000100:00100000:2.0:1783144389.321970:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501377024 00000100:00100000:2.0:1783144389.322037:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1783144389.322044:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66112:x1869759501377024:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783144389.322057:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144389.322070:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048d85 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a423048d7e expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.322087:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048d85 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048d7e expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.322098:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048d85 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d7e expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.322106:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c29cd29e900) 00010000:00010000:2.0:1783144389.322114:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.322116:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517e00, rc 0) 00000100:00100000:2.0:1783144389.322160:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377024:12345-0@lo:101:mdt00_000.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.322167:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1783144389.322226:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481706368:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1435us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.322243:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2573 00000100:00100000:0.0:1783144389.322255:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377024:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1783144389.322269:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.322279:0:66112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783144389.322292:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:0.0:1783144389.322322:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377152:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.322352:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.322496:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.322499:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501377152 00000100:00100000:1.0:1783144389.322504:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501377152 00000100:00100000:1.0:1783144389.322553:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:1.0:1783144389.322560:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783144389.322628:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377152:12345-0@lo:1000:mdt00_000.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.322635:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:0.0:1783144389.322709:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377152:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.322842:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377280:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.322865:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.322882:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.322902:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501377280 00000100:00100000:1.0:1783144389.322908:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501377280 00000100:00100000:1.0:1783144389.322965:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:1.0:1783144389.322973:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783144389.323044:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377280:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (177us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783144389.323051:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:0.0:1783144389.323070:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377280:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.323128:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377408:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.323149:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.323210:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501377408 00000100:00100000:0.0:1783144389.323215:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144389.323216:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501377408 00000100:00100000:2.0:1783144389.323247:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:2.0:1783144389.323256:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144389.323315:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377408:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (164us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144389.323323:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:0.0:1783144389.323334:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377408:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.323374:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377536:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.323401:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.323422:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.323493:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501377536 00000100:00100000:3.0:1783144389.323497:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501377536 00000100:00100000:3.0:1783144389.323530:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1783144389.323537:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783144389.323597:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377536:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.323603:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:0.0:1783144389.323634:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377536:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.323679:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.323701:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.330657:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.330857:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501377664 00000100:00100000:1.0:1783144389.330867:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501377664 00000100:00100000:1.0:1783144389.330936:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:1.0:1783144389.330946:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783144389.331097:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377664:12345-0@lo:1000:mdt00_000.0 Request processed in 152us (7394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.331107:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1783144389.331132:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.331201:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377792:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783144389.331233:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.331679:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.332492:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501377792 00000100:00100000:3.0:1783144389.332498:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501377792 00000100:00100000:3.0:1783144389.332546:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1783144389.332555:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377792:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783144389.332630:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66112:x1869759501377792:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.332637:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:1.0:1783144389.332754:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66112:1869759501377792:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1783144389.333602:0:66112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].4, 968 off36136 00000040:00080000:1.0:1783144389.333656:0:66112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].4, 1120 off36672 00000004:00080000:1.0:1783144389.333673:0:66112:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c29c3182900 with version 11 00000004:00080000:2.0:1783144389.333847:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 11 rpc_version 11 00000020:00100000:2.0:1783144389.333872:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783144389.333880:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2aeff04380 x1869759501378048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144389.333992:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff04380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501378048:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144389.334044:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.334072:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.334188:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378048 00000100:00100000:3.0:1783144389.334194:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378048 00000100:00100000:3.0:1783144389.334237:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1783144389.334245:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75523:x1869759501378048:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783144389.334752:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75523:x1869759501378048:12345-0@lo:1000:osp_up0-1.0 Request processed in 506us (706us total) trans 115964116999 rc 0/0 00000100:00100000:2.0:1783144389.334885:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff04380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501378048:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783144389.334934:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00010000:00010000:1.0:1783144389.334949:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.334972:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.334984:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144389.335002:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c659293 reply state 000000006abcfb83 transno 81604378756 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.335014:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.335021:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29c73fc600) 00010000:00010000:1.0:1783144389.335024:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144389.335028:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783144389.335034:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1783144389.335042:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1783144389.335054:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.335067:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.335075:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.335153:0:66112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783144389.335160:0:66112:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1783144389.335166:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.335183:0:66112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.335258:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71822:x1869759481706240:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 22893us (23017us total) trans 81604378756 rc 0/0 00000100:00100000:1.0:1783144389.335265:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1246 00010000:00010000:0.0:1783144389.335316:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144389.335324:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.335332:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ee00 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:0.0:1783144389.335338:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144389.335345:0:9525:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.335373:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.335379:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783144389.335428:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783144389.335448:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.335467:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6ee00/0xad8e53a423048d70 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xad8e53a423048d77 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.335485:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144389.335488:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144389.335490:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144389.335524:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501378176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144389.335558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.335791:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378176 00000100:00100000:0.0:1783144389.335795:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378176 00000100:00100000:0.0:1783144389.335825:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1783144389.335831:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3649:x1869759501378176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144389.335839:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144389.335850:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048d77 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048d70 expref: 12 pid: 78024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.335859:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd29e000) 00010000:00010000:0.0:1783144389.335865:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144389.335930:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3649:x1869759501378176:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144389.335937:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1783144389.335977:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501378176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144389.346047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.346098:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481706496 00000100:00100000:3.0:1783144389.346108:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481706496 00000100:00100000:3.0:1783144389.346167:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1247 00000100:00100000:3.0:1783144389.346178:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71823:x1869759481706496:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144389.346271:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.346289:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cdb expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346344:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346357:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346367:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346380:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346386:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346392:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346482:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423048da8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346489:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423048da8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346495:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423048da8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144389.346528:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144389.346641:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144389.346689:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423048da8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346702:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346708:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346713:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346800:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346807:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.346811:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346819:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346831:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144389.346834:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144389.346838:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346845:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423048d9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346857:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346873:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346879:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346884:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.346887:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346894:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346902:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c2af71ea700) 00010000:00010000:3.0:1783144389.346905:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144389.346908:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346914:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048da1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346942:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cdb expref: 9 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346955:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423048da8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cdb expref: 8 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.346960:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af71ea100) 00010000:00010000:3.0:1783144389.346961:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783144389.346968:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01200, rc 0) 00000100:00100000:3.0:1783144389.347048:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71823:x1869759481706496:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 873us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.347054:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1247 00000100:00100000:2.0:1783144389.350829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.351844:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481706624 00000100:00100000:3.0:1783144389.351856:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481706624 00000100:00100000:3.0:1783144389.352261:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1248 00000100:00100000:3.0:1783144389.352273:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71823:x1869759481706624:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144389.352294:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.352313:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048daf lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ce2 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352380:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352394:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352405:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352417:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352427:0:66114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d38 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d31 expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352435:0:66114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352469:0:66114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d38 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048d31 expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144389.352498:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66114:1869759501378304:0@lo:104: 00000100:00100000:3.0:1783144389.352551:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.352598:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad00c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144389.352715:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378304 00000100:00100000:0.0:1783144389.352737:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378304 00000100:00100000:0.0:1783144389.352771:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783144389.352779:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66114:x1869759501378304:12345-0@lo:104: 00010000:00010000:0.0:1783144389.352791:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.352849:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783144389.352862:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66114:x1869759501378304:12345-0@lo:104: Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144389.352870:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1783144389.352877:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66114:1869759501378304:0@lo:104: 00010000:00010000:1.0:1783144389.352886:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144389.352896:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.352899:0:66114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.352914:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519000 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:1.0:1783144389.352920:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144389.352929:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.352954:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.352960:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144389.352996:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.353005:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac1519000/0xad8e53a423048d31 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048d38 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.353069:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144389.353071:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144389.353073:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144389.353285:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501378432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144389.353321:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144389.353357:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378432 00000100:00100000:1.0:1783144389.353362:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378432 00010000:00010000:1.0:1783144389.353382:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d38 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xad8e53a423048d31 expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.353409:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1783144389.353416:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3649:x1869759501378432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144389.353426:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1783144389.355816:0:92270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116999 is committed 00010000:00010000:1.0:1783144389.356135:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048d38 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048d31 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.356155:0:26153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c2af71eaf00) 00010000:00010000:1.0:1783144389.356160:0:26153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.356170:0:26153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.356178:0:26153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.356241:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144389.356269:0:66114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.356281:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.356319:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3649:x1869759501378432:12345-0@lo:103:ldlm_bl.0 Request processed in 2902us (2997us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.356330:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1783144389.356383:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66114:1869759501378560:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144389.356427:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144389.356458:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b017cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1783144389.356780:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378560 00000100:00100000:0.0:1783144389.356788:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378560 00000100:00100000:2.0:1783144389.356800:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501378432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144389.356838:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:0.0:1783144389.356848:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66114:x1869759501378560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783144389.356923:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66114:x1869759501378560:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144389.356929:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:2.0:1783144389.357116:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66114:1869759501378560:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783144389.357160:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048dc4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357183:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048dc4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357192:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048dc4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144389.357216:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048dc4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357230:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357236:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357242:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357248:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357253:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144389.357258:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357264:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357274:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af71ea100) 00010000:00010000:2.0:1783144389.357276:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.357280:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357292:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048db6 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357303:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357309:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357315:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357319:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144389.357322:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357329:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357336:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c2af71eaf00) 00010000:00010000:2.0:1783144389.357338:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.357340:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357345:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048dbd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357381:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048daf lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ce2 expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357407:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048dc4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ce2 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.357414:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29ec00) 00010000:00010000:2.0:1783144389.357416:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783144389.357419:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517000, rc 0) 00000100:00100000:2.0:1783144389.357473:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71823:x1869759481706624:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 5203us (6653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.357481:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1248 00000100:00100000:0.0:1783144389.361438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.361547:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481706752 00000100:00100000:3.0:1783144389.361556:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481706752 00000100:00100000:3.0:1783144389.361614:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1249 00000100:00100000:3.0:1783144389.361623:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71823:x1869759481706752:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144389.361646:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.361674:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01800/0xad8e53a423048dcb lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ce9 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.361862:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517c00/0xad8e53a423048dd2 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.361877:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517c00/0xad8e53a423048dd2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.361889:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517c00/0xad8e53a423048dd2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144389.361936:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1783144389.361941:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783144389.361976:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01800/0xad8e53a423048dcb lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ce9 expref: 11 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.361993:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517c00/0xad8e53a423048dd2 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ce9 expref: 10 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.362002:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144389.362015:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783144389.362019:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517c00, rc 0) 00000100:00100000:2.0:1783144389.362075:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71823:x1869759481706752:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 453us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.362082:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1249 00000100:00100000:1.0:1783144389.367069:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144389.369632:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481707008 00000100:00100000:0.0:1783144389.369645:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481707008 00000100:00100000:0.0:1783144389.369744:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1250 00000100:00100000:0.0:1783144389.369755:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71823:x1869759481707008:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144389.369775:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144389.369798:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e800/0xad8e53a423048dd9 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cf0 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144389.369895:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783144389.369994:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e800/0xad8e53a423048dd9 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cf0 expref: 12 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.370007:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c29cd096600) 00010000:00010000:0.0:1783144389.370011:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144389.370016:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e800/0xad8e53a423048dd9 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cf0 expref: 12 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.370058:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6e800, rc 0) 00000100:00100000:0.0:1783144389.370121:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71823:x1869759481707008:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 368us (3057us total) trans 81604378757 rc 301/301 00000100:00100000:0.0:1783144389.370129:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1250 00000100:00100000:1.0:1783144389.372536:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.372582:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481707264 00000100:00100000:2.0:1783144389.372588:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481707264 00000100:00100000:2.0:1783144389.372628:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1251 00000100:00100000:2.0:1783144389.372638:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71823:x1869759481707264:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1783144389.372693:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144389.372718:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517c00/0xad8e53a423048dd2 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ce9 expref: 11 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.372763:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144389.372768:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144389.372787:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.372798:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.372808:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144389.372948:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f17200b3 reply state 000000006c784014 transno 81604378758 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.372961:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.372984:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144389.372987:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1783144389.372989:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783144389.372997:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000100:00100000:2.0:1783144389.373190:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:71823:x1869759481707264:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 550us (660us total) trans 81604378758 rc 0/0 00000100:00100000:2.0:1783144389.373198:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1251 00000100:00100000:3.0:1783144389.375077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144389.375137:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481707520 00000100:00100000:0.0:1783144389.375145:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481707520 00000100:00100000:0.0:1783144389.375201:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:0.0:1783144389.375213:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:71823:x1869759481707520:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1783144389.375522:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71823:x1869759481707520:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 312us (451us total) trans 81604378759 rc 0/0 00000100:00100000:0.0:1783144389.375531:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 236 00000100:00100000:1.0:1783144389.390338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144389.390473:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481707648 00000100:00100000:0.0:1783144389.390483:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481707648 00000100:00100000:0.0:1783144389.390546:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1252 00000100:00100000:0.0:1783144389.390556:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71824:x1869759481707648:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144389.390574:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144389.390592:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e800/0xad8e53a423048dee lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cf7 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.390651:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.390676:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.390686:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.390709:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.390718:0:66112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048d85 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048d7e expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.390872:0:66112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.391050:0:66112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048d85 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048d7e expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144389.391061:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66112:1869759501378688:0@lo:104: 00000100:00100000:1.0:1783144389.391097:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144389.391129:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3182540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.391264:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378688 00000100:00100000:3.0:1783144389.391269:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378688 00000100:00100000:3.0:1783144389.391313:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783144389.391320:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66112:x1869759501378688:12345-0@lo:104: 00010000:00010000:3.0:1783144389.391331:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144389.391418:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66112:1869759501378688:0@lo:104: 00010000:00010000:2.0:1783144389.391445:0:66112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.391855:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783144389.391862:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66112:x1869759501378688:12345-0@lo:104: Request processed in 543us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.391869:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:0.0:1783144389.392324:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144389.392331:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.392340:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f400 already unused, calling callback (ffffffffc1821eb0) 00010000:00010000:0.0:1783144389.392345:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144389.392354:0:9527:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.392381:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.392387:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144389.392418:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.392425:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2af9f6f400/0xad8e53a423048d7e lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048d85 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.392450:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144389.392452:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144389.392454:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144389.392486:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501378816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144389.392521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144389.392566:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378816 00000100:00100000:0.0:1783144389.392572:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378816 00010000:00010000:0.0:1783144389.392590:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048d85 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xad8e53a423048d7e expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144389.392618:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1783144389.392625:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3650:x1869759501378816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144389.392635:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144389.393132:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517e00/0xad8e53a423048d85 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048d7e expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.393146:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c29cd29e900) 00010000:00010000:0.0:1783144389.393151:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.393159:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.393165:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.393190:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144389.393232:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3650:x1869759501378816:12345-0@lo:103:ldlm_bl.0 Request processed in 607us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144389.393239:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1783144389.393317:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501378816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144389.393376:0:66112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.393384:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144389.393633:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66112:1869759501378944:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144389.393677:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.393768:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c6c47cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144389.394064:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501378944 00000100:00100000:1.0:1783144389.394069:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501378944 00000100:00100000:1.0:1783144389.394115:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:1.0:1783144389.394123:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66112:x1869759501378944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783144389.394284:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66112:x1869759501378944:12345-0@lo:1000:mdt00_000.0 Request processed in 161us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.394291:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:2.0:1783144389.394340:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66112:1869759501378944:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783144389.394381:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048e03 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394392:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048e03 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394406:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048e03 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144389.394425:0:66112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048e03 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394438:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394444:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394450:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394457:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394463:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144389.394467:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394473:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394481:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af71ea100) 00010000:00010000:2.0:1783144389.394484:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.394488:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394494:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ec00/0xad8e53a423048df5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394520:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394527:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394532:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394537:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144389.394540:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394547:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394555:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c29cd29e900) 00010000:00010000:2.0:1783144389.394557:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144389.394560:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394567:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e200/0xad8e53a423048dfc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394604:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6e800/0xad8e53a423048dee lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cf7 expref: 11 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394620:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048e03 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cf7 expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.394639:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd29e100) 00010000:00010000:2.0:1783144389.394642:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783144389.394644:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517c00, rc 0) 00000100:00100000:2.0:1783144389.394845:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71824:x1869759481707648:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 4289us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.394852:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1252 00000100:00100000:1.0:1783144389.396353:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.396491:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481707776 00000100:00100000:3.0:1783144389.396498:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481707776 00000100:00100000:3.0:1783144389.396575:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1253 00000100:00100000:3.0:1783144389.396585:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71824:x1869759481707776:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144389.396602:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.396616:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048e0a lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41cfe expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.396694:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01400/0xad8e53a423048e11 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.396706:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01400/0xad8e53a423048e11 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.396716:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01400/0xad8e53a423048e11 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144389.396896:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783144389.396900:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783144389.396931:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01000/0xad8e53a423048e0a lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cfe expref: 15 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.396956:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01400/0xad8e53a423048e11 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cfe expref: 14 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.396964:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29c73fc600) 00010000:00010000:3.0:1783144389.396967:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783144389.396970:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01400, rc 0) 00000100:00100000:3.0:1783144389.397022:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71824:x1869759481707776:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 439us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.397029:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1253 00000100:00100000:0.0:1783144389.400357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.400409:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481708032 00000100:00100000:3.0:1783144389.400415:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481708032 00000100:00100000:3.0:1783144389.400458:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1254 00000100:00100000:3.0:1783144389.400465:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71824:x1869759481708032:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144389.400478:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144389.400492:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01800/0xad8e53a423048e18 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d05 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144389.400568:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783144389.400678:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01800/0xad8e53a423048e18 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d05 expref: 16 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.400705:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2aee3db900) 00010000:00010000:3.0:1783144389.400707:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144389.400712:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01800/0xad8e53a423048e18 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d05 expref: 16 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.400755:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01800, rc 0) 00000100:00100000:3.0:1783144389.401055:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:71824:x1869759481708032:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 588us (705us total) trans 81604378760 rc 301/301 00000100:00100000:3.0:1783144389.401063:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1254 00000100:00100000:1.0:1783144389.404715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.405067:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481708288 00000100:00100000:2.0:1783144389.405076:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481708288 00000100:00100000:2.0:1783144389.405394:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1255 00000100:00100000:2.0:1783144389.405405:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:71824:x1869759481708288:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:2.0:1783144389.405456:0:81077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144389.405481:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01400/0xad8e53a423048e11 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cfe expref: 15 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.405498:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29c73fc600) 00010000:00010000:2.0:1783144389.405502:0:81077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144389.405520:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.405533:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.405543:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144389.405684:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b5cd8ca reply state 000000004d800b67 transno 81604378761 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.405715:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.405803:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29c73fc600) 00010000:00010000:2.0:1783144389.405806:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1783144389.405809:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783144389.405817:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1783144389.405904:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:71824:x1869759481708288:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 502us (1197us total) trans 81604378761 rc 0/0 00000100:00100000:2.0:1783144389.405910:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1255 00000100:00100000:1.0:1783144389.407891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.407949:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481708544 00000100:00100000:3.0:1783144389.407956:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481708544 00000100:00100000:3.0:1783144389.408017:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 237 00000100:00100000:3.0:1783144389.408027:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:71824:x1869759481708544:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:3.0:1783144389.408199:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:71824:x1869759481708544:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 173us (310us total) trans 81604378762 rc 0/0 00000100:00100000:3.0:1783144389.408206:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 237 00010000:00010000:3.0:1783144389.582137:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783144389.831716:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968829 is committed 00000001:00080000:2.0:1783144389.832664:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378762 is committed 00000020:00080000:2.0:1783144389.832686:0:75517:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411386 batchid updated 00000020:00080000:0.0:1783144389.832737:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00010000:00010000:3.0:1783144389.832783:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832796:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832804:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832812:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.832825:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832833:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832848:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:3.0:1783144389.832851:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144389.832854:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832859:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048d3f lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832876:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832881:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832885:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832887:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.832889:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832892:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832896:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29c73fc600) 00010000:00010000:3.0:1783144389.832898:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144389.832903:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832907:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac1519400/0xad8e53a423048d8c lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832914:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832918:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832922:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832925:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.832928:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832931:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832937:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:3.0:1783144389.832938:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144389.832940:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832944:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048de7 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783144389.832946:0:75537:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2ac6dd6900 with version 12 00010000:00010000:3.0:1783144389.832958:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832963:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783144389.832965:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411386 cancel update log [0x20000c751:0x1:0x0].2: rc = 0 00010000:00010000:3.0:1783144389.832976:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832980:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144389.832982:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832985:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832989:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29c73fc600) 00010000:00010000:3.0:1783144389.832991:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144389.832992:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144389.832996:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517e00/0xad8e53a423048e26 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144389.833039:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 12 rpc_version 12 00000020:00080000:0.0:1783144389.833043:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411386 cancel update log [0x2400090a4:0x1:0x0].2: rc = 0 00000020:00080000:0.0:1783144389.833055:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000020:00100000:2.0:1783144389.833064:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783144389.833073:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c29c3dfed80 x1869759501379200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144389.833091:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501379200:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144389.833139:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.833165:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144389.833219:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501379200 00000100:00100000:0.0:1783144389.833224:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501379200 00000100:00100000:0.0:1783144389.833266:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1783144389.833276:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75523:x1869759501379200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783144389.833419:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501379200:12345-0@lo:1000:osp_up0-1.0 Request processed in 145us (278us total) trans 115964117000 rc 0/0 00000100:00100000:0.0:1783144389.833425:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1783144389.833471:0:75523:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116999 gen 3 00000004:00080000:2.0:1783144389.833475:0:75523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116998 committed transno 115964116999 00000020:00080000:2.0:1783144389.833478:0:75523:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c29c4a99f00 refcount 2 committed 0 result 0 batchid 77309411387 00000020:00080000:2.0:1783144389.833481:0:75523:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2af5ed1c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c29c4a99840 00000020:00080000:2.0:1783144389.833483:0:75523:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].3 00000020:00080000:2.0:1783144389.833485:0:75523:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2af5ed1100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2aeedb2a00 00000020:00080000:2.0:1783144389.833487:0:75523:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].3 00000004:00080000:2.0:1783144389.833516:0:75523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116999 committed transno 115964116999 00000020:00080000:2.0:1783144389.833519:0:75523:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c2b01016540 refcount 2 committed 0 result 0 batchid 77309411388 00000020:00080000:2.0:1783144389.833521:0:75523:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2ac137d200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c29c3182900 00000020:00080000:2.0:1783144389.833523:0:75523:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].4 00000020:00080000:2.0:1783144389.833524:0:75523:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9c2ac137da00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2aef539a00 00000020:00080000:2.0:1783144389.833526:0:75523:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].4 00000020:00080000:0.0:1783144389.833535:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411388 committed batchid 77309411386 00000100:00100000:2.0:1783144389.833544:0:75523:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9c29c3dfed80 x1869759501379200/t115964117000(115964117000) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783144405 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144389.833564:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501379200:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1783144389.834319:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000001:00080000:0.0:1783144389.840525:0:92270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117000 is committed 00000020:00080000:2.0:1783144389.840685:0:75517:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411388 batchid updated 00000020:00080000:0.0:1783144389.840773:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411388 00000004:00080000:0.0:1783144389.840829:0:75537:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2ad3febe40 with version 13 00000020:00080000:0.0:1783144389.840836:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411387 cancel update log [0x20000c751:0x1:0x0].3: rc = 0 00000020:00080000:0.0:1783144389.840895:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411387 cancel update log [0x2400090a4:0x1:0x0].3: rc = 0 00000004:00080000:0.0:1783144389.840934:0:75537:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c29c6bdca80 with version 14 00000020:00080000:0.0:1783144389.840938:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411388 cancel update log [0x20000c751:0x1:0x0].4: rc = 0 00000020:00080000:0.0:1783144389.840960:0:75537:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411388 cancel update log [0x2400090a4:0x1:0x0].4: rc = 0 00000020:00080000:0.0:1783144389.840967:0:75537:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411388 00000004:00080000:2.0:1783144389.841010:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 13 rpc_version 13 00000020:00100000:2.0:1783144389.841040:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783144389.841049:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2aeff04380 x1869759501379456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144389.841072:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff04380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501379456:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144389.841134:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.841167:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.841267:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501379456 00000100:00100000:3.0:1783144389.841274:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501379456 00000100:00100000:3.0:1783144389.841321:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1783144389.841330:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75523:x1869759501379456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783144389.841475:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501379456:12345-0@lo:1000:osp_up0-1.0 Request processed in 145us (339us total) trans 115964117001 rc 0/0 00000100:00100000:3.0:1783144389.841483:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1783144389.841498:0:75523:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000004:00080000:2.0:1783144389.841504:0:75523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117000 committed transno 115964117000 00000100:00100000:2.0:1783144389.841524:0:75523:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9c2aeff04380 x1869759501379456/t115964117001(115964117001) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783144405 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144389.841540:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff04380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501379456:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1783144389.841549:0:75523:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2ac89f5180 version 14 rpc_version 14 00000020:00100000:2.0:1783144389.841560:0:75523:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783144389.841564:0:75523:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c29c3dfed80 x1869759501379712/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144389.841583:0:75523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501379712:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783144389.841608:0:75523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144389.841630:0:75523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144389.841678:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501379712 00000100:00100000:3.0:1783144389.841683:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501379712 00000100:00100000:3.0:1783144389.841746:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1783144389.841755:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75523:x1869759501379712:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783144389.842211:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75523:x1869759501379712:12345-0@lo:1000:osp_up0-1.0 Request processed in 456us (600us total) trans 115964117002 rc 0/0 00000100:00100000:3.0:1783144389.842218:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:2.0:1783144389.842273:0:75523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3dfed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75523:1869759501379712:0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1783144389.843527:0:92270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117001 is committed 00000001:00080000:2.0:1783144389.849261:0:92270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00000100:00100000:1.0:1783144389.875519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.875762:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481708672 00000100:00100000:3.0:1783144389.875835:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481708672 00000100:00100000:3.0:1783144389.875988:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1256 00000100:00100000:3.0:1783144389.875999:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71833:x1869759481708672:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1783144389.876031:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:3.0:1783144389.876197:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71833:x1869759481708672:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 199us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.876212:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1256 00000100:00100000:3.0:1783144389.880517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144389.880547:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481708800 00000100:00100000:3.0:1783144389.880555:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481708800 00000100:00100000:3.0:1783144389.880598:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1257 00000100:00100000:3.0:1783144389.880607:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71833:x1869759481708800:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1783144389.880641:0:66143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1783144389.880710:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71833:x1869759481708800:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 104us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144389.880718:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1257 00000100:00100000:1.0:1783144389.885300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.886263:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481708928 00000100:00100000:2.0:1783144389.886272:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481708928 00000100:00100000:2.0:1783144389.886306:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4975 00000100:00100000:2.0:1783144389.886314:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2402:x1869759481708928:12345-192.168.203.4@tcp:8:lfs.0 00010000:00080000:2.0:1783144389.886341:0:26151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp t0 exp 0000000000000000 cur 2924 last 0 00000020:00000080:2.0:1783144389.886365:0:26151:0:(genops.c:1406:class_connect()) connect: client 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef, cookie 0xad8e53a423048e2d 00002000:00100000:2.0:1783144389.886375:0:26151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef/ffff9c2ac9d67800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783144389.886391:0:26151:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783144389.886448:0:26151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783144389.886472:0:26151:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d65000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144389.886531:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481708928:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 217us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.886539:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4975 00000100:00100000:1.0:1783144389.891910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.894019:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709056 00000100:00100000:2.0:1783144389.894030:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709056 00000100:00080000:1.0:1783144389.894080:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144389.894097:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1650 00000100:00100000:2.0:1783144389.894107:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:71833:x1869759481709056:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144389.894138:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144389.894197:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:71833:x1869759481709056:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 91us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.894213:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1650 00000100:00100000:0.0:1783144389.896860:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144389.899928:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709184 00000100:00100000:1.0:1783144389.899938:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709184 00000100:00100000:1.0:1783144389.900002:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1651 00000100:00100000:1.0:1783144389.900014:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71833:x1869759481709184:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144389.900044:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144389.900164:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71833:x1869759481709184:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 152us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.900172:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1651 00000100:00080000:0.0:1783144389.900979:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144389.942072:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144389.942101:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709440 00000100:00100000:1.0:1783144389.942109:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709440 00000100:00100000:1.0:1783144389.942167:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1258 00000100:00100000:1.0:1783144389.942176:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71840:x1869759481709440:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00010000:1.0:1783144389.942221:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144389.942245:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423048d4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ccd expref: 10 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942262:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:1.0:1783144389.942267:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144389.942316:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942329:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942338:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942357:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942365:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942371:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942706:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942714:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942736:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942743:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942749:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144389.942753:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942761:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942771:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:1.0:1783144389.942774:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144389.942777:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942789:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e34 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144389.942801:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fa176e7 reply state 0000000055789802 transno 115964117003 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942812:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.942818:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29c3de4900) 00010000:00010000:1.0:1783144389.942821:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144389.942823:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144389.942901:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71840:x1869759481709440:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 725us (836us total) trans 115964117003 rc 0/0 00000100:00100000:1.0:1783144389.942908:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1258 00000100:00100000:2.0:1783144389.961285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144389.961321:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709568 00000100:00100000:2.0:1783144389.961331:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709568 00000100:00100000:2.0:1783144389.961379:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1259 00000100:00100000:2.0:1783144389.961390:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71843:x1869759481709568:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1783144389.961412:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144389.961430:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516600/0xad8e53a423048e42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d0c expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.961488:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048e49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.961502:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048e49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.961512:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048e49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144389.961555:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144389.961559:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144389.961577:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048e49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.961600:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516600/0xad8e53a423048e42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d0c expref: 13 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.961617:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048e49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d0c expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144389.961645:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144389.961648:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144389.961650:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516a00, rc 0) 00000100:00100000:2.0:1783144389.961714:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:71843:x1869759481709568:12345-192.168.203.4@tcp:101:rm.0 Request processed in 326us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144389.961737:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1259 00000100:00100000:1.0:1783144389.963840:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144389.963870:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709696 00000100:00100000:1.0:1783144389.963876:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709696 00000100:00100000:1.0:1783144389.963918:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1260 00000100:00100000:1.0:1783144389.963931:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:71843:x1869759481709696:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1783144389.963947:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144389.963962:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d13 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964007:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964020:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964038:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964050:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964058:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964064:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964134:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048e65 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964143:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048e65 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964150:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048e65 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144389.964184:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x3:0x0]: returning size 0 00000004:00200000:1.0:1783144389.964188:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144389.964218:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048e65 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964405:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048e65 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964482:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964499:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964506:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964513:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144389.964517:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964525:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964537:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:1.0:1783144389.964540:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144389.964545:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964551:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518200/0xad8e53a423048e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964566:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964572:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964578:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964583:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144389.964591:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964598:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964607:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29c3de4900) 00010000:00010000:1.0:1783144389.964610:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144389.964614:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964619:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519400/0xad8e53a423048e5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964646:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1518e00/0xad8e53a423048e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d13 expref: 14 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964670:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048e65 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d13 expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.964677:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c29c3de4000) 00010000:00010000:1.0:1783144389.964680:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144389.964683:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac1519a00, rc 0) 00000100:00100000:1.0:1783144389.964749:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71843:x1869759481709696:12345-192.168.203.4@tcp:101:rm.0 Request processed in 821us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144389.964758:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1260 00000100:00100000:2.0:1783144389.971226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144389.971492:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709952 00000100:00100000:1.0:1783144389.971501:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709952 00000100:00100000:1.0:1783144389.971562:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1261 00000100:00100000:1.0:1783144389.971572:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71843:x1869759481709952:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:1.0:1783144389.971634:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783144389.971666:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519a00/0xad8e53a423048e65 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d13 expref: 13 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971684:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c29c3de4000) 00010000:00010000:1.0:1783144389.971698:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7516a00/0xad8e53a423048e49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d0c expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971708:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:1.0:1783144389.971711:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144389.971745:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971758:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971767:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971777:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971784:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971791:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971858:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971876:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.971884:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972039:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972048:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972056:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972064:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972070:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972076:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972094:0:66112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144389.972108:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.972260:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144389.972266:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972290:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.972296:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.975470:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144389.975482:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.975497:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.975513:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c29c3de4100) 00010000:00010000:0.0:1783144389.975516:0:9525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783144389.975519:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.975526:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423048e81 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144389.975539:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144389.975541:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144389.975543:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144389.979204:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144389.979215:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979229:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979246:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c29c3de4100) 00010000:00010000:1.0:1783144389.979249:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783144389.979253:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979260:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048e7a lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979292:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979300:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979306:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979313:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979318:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144389.979321:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979669:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979679:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:1.0:1783144389.979682:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144389.979685:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979692:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423048e6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144389.979703:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c01d7e2 reply state 0000000082ba7e60 transno 115964117004 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979715:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144389.979834:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29c3de4900) 00010000:00010000:1.0:1783144389.979837:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144389.979841:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144389.979956:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71843:x1869759481709952:12345-192.168.203.4@tcp:36:rm.0 Request processed in 8382us (8734us total) trans 115964117004 rc 0/0 00000100:00100000:1.0:1783144389.979965:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1261 00010000:00010000:1.0:1783144390.605904:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144390.670862:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501379840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144390.670930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144390.671018:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501379840 00000100:00100000:2.0:1783144390.671024:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501379840 00000100:00100000:2.0:1783144390.671072:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:2.0:1783144390.671081:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afcbb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501379840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783144390.671111:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783144390.671152:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afcbb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501379840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144390.671158:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:0.0:1783144390.671312:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501379968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144390.671489:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501379840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144390.672669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.672700:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144390.672711:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501380096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144390.672759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.672793:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380096 00000100:00100000:0.0:1783144390.672799:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380096 00000100:00100000:0.0:1783144390.672865:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:0.0:1783144390.672874:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501380096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783144390.672892:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144390.672934:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501380096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.672943:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:1.0:1783144390.672989:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501379968 00000100:00100000:0.0:1783144390.673005:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501380480:0@lo:400:kworker.0 00000100:00100000:1.0:1783144390.673012:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501379968 00000100:00100000:0.0:1783144390.673037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.673061:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501380992:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.673084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.673113:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968829 gen 2 00000100:00100000:0.0:1783144390.673131:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501380096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144390.673143:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783144390.673147:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1783144390.673152:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501380608:0@lo:400:kworker.0 00000100:00100000:1.0:1783144390.673159:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501379968:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144390.673176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1783144390.673186:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444892672 avail 1298653184 00000100:00100000:0.0:1783144390.673196:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501381120:0@lo:400:kworker.0 00010000:00000080:1.0:1783144390.673201:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ad05d1500 x1869759501379968/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:501/0 lens 224/368 e 0 to 0 dl 1783144401 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144390.673220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144390.673424:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144390.673435:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501379968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144390.673463:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380480 00000100:00100000:0.0:1783144390.673467:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380480 00000100:00100000:0.0:1783144390.673498:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380608 00000100:00100000:0.0:1783144390.673501:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380608 00000100:00100000:0.0:1783144390.673520:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501381120 00000100:00100000:0.0:1783144390.673522:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501381120 00000100:00100000:0.0:1783144390.673543:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1783144390.673549:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501380480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.673594:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501380480:12345-0@lo:400:kworker.0 Request processed in 44us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.673601:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1783144390.673615:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1783144390.673621:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501380608:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783144390.673633:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ad05d0e00 x1869759501380608/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:501/0 lens 224/224 e 0 to 0 dl 1783144401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144390.673680:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869759501380608:12345-0@lo:400:kworker.0 Request processed in 59us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.673688:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1783144390.673702:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1783144390.673709:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501381120:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783144390.673719:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ad05d0a80 x1869759501381120/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:501/0 lens 224/224 e 0 to 0 dl 1783144401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144390.673924:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501381120:12345-0@lo:400:kworker.0 Request processed in 59us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.673935:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1783144390.673959:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380992 00000100:00100000:0.0:1783144390.673963:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380992 00000100:00100000:0.0:1783144390.673996:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1783144390.674004:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501380992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674034:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501380992:12345-0@lo:400:kworker.0 Request processed in 32us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.674040:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00080000:0.0:1783144390.674055:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144390.674064:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783144390.674067:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144390.674090:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501380608:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674104:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501381120:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674115:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501380480:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674126:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968829 gen 2 00000004:00080000:0.0:1783144390.674132:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c2ad05d0700, transno 4294968829 00000100:00100000:0.0:1783144390.674144:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501380992:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674270:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501380352:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674302:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.674415:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501380864:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674440:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.674457:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501381376:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.674501:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783144390.674509:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501380224:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.674558:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501380736:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674576:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.674591:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501381248:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674610:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.674632:0:92277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380224 00000100:00100000:0.0:1783144390.674635:0:92277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380224 00000100:00100000:0.0:1783144390.674672:0:92277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783144390.674684:0:92277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501380224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.674717:0:92277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501380224:12345-0@lo:400:kworker.0 Request processed in 33us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.674743:0:92277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783144390.674776:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380352 00000100:00100000:0.0:1783144390.674780:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380352 00000100:00100000:0.0:1783144390.674808:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501381376 00000100:00100000:0.0:1783144390.674811:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501381376 00000100:00100000:0.0:1783144390.674828:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380736 00000100:00100000:0.0:1783144390.674831:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380736 00000100:00100000:0.0:1783144390.674846:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1783144390.674853:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501380352:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783144390.674865:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ad05d0700 x1869759501380352/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:501/0 lens 224/224 e 0 to 0 dl 1783144401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144390.674895:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759501380352:12345-0@lo:400:kworker.0 Request processed in 43us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.674901:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1783144390.674914:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1783144390.674921:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501381376:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783144390.674934:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ad05d0000 x1869759501381376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:501/0 lens 224/224 e 0 to 0 dl 1783144401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144390.674959:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501381376:12345-0@lo:400:kworker.0 Request processed in 40us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.674965:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1783144390.674978:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1783144390.674985:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501380736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675019:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501380736:12345-0@lo:400:kworker.0 Request processed in 36us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.675025:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00080000:0.0:1783144390.675043:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783144390.675045:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144390.675059:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501380224:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675069:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501380736:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675077:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759501380352:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675085:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501381376:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675112:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501380864 00000100:00100000:0.0:1783144390.675115:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501380864 00000100:00100000:0.0:1783144390.675140:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501381248 00000100:00100000:0.0:1783144390.675143:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501381248 00000100:00100000:0.0:1783144390.675165:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1783144390.675172:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501380864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675205:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501380864:12345-0@lo:400:kworker.0 Request processed in 35us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.675210:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1783144390.675220:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1783144390.675225:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501381248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675249:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501381248:12345-0@lo:400:kworker.0 Request processed in 23us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.675254:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00080000:0.0:1783144390.675268:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144390.675270:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144390.675292:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968828 gen 2 00000100:00100000:0.0:1783144390.675302:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501381248:0@lo:400:kworker.0 00000100:00100000:0.0:1783144390.675315:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501380864:0@lo:400:kworker.0 00000100:00100000:3.0:1783144390.675349:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144390.675516:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501381504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144390.675547:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144390.675593:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501381504 00000100:00100000:0.0:1783144390.675598:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501381504 00000100:00100000:0.0:1783144390.675630:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1783144390.675638:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501381504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783144390.675661:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144390.675698:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501381504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.675704:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:1.0:1783144390.675923:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501379968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2766us (3255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144390.675933:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:3.0:1783144390.676996:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501381504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144390.754293:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144390.754336:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144390.754359:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710208 00000100:00100000:0.0:1783144390.754369:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710208 00000100:00100000:3.0:1783144390.754381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144390.754407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144390.754435:0:92275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710080 00000100:00100000:1.0:1783144390.754441:0:92275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710080 00000100:00100000:3.0:1783144390.754442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144390.754463:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710464 00000100:00100000:2.0:1783144390.754469:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710464 00000100:00100000:3.0:1783144390.754474:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710336 00000100:00100000:3.0:1783144390.754480:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710336 00000100:00100000:1.0:1783144390.754494:0:92275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1783144390.754507:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710592 00000100:00100000:2.0:1783144390.754513:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710592 00000100:00100000:1.0:1783144390.754513:0:92275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c4ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481710080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144390.754576:0:92275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c4ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481710080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144390.754584:0:92275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1783144390.754605:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2070 00000100:00100000:2.0:1783144390.754615:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2406:x1869759481710464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144390.754664:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2406:x1869759481710464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144390.754671:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2070 00000100:00100000:2.0:1783144390.754686:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2071 00000100:00100000:2.0:1783144390.754708:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481710592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144390.754917:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481710592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 209us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144390.754925:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2071 00000100:00100000:0.0:1783144390.756066:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 848 00000100:00100000:0.0:1783144390.756077:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2406:x1869759481710208:12345-192.168.203.4@tcp:400:kworker.0 00010000:00000080:0.0:1783144390.756101:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afaba4700 x1869759481710208/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:501/0 lens 224/224 e 0 to 0 dl 1783144401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144390.756147:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2406:x1869759481710208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 72us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144390.756154:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 848 00000100:00100000:3.0:1783144390.756735:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 849 00000100:00100000:3.0:1783144390.756746:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481710336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144390.756803:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481710336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 58us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144390.756814:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 849 00010000:00010000:1.0:1783144391.629848:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144392.207029:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144392.207059:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501381632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144392.207129:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144392.207582:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501381632 00000100:00100000:0.0:1783144392.207590:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501381632 00000100:00100000:0.0:1783144392.207651:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1783144392.207661:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501381632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144392.207689:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144392.208255:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501381632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 594us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144392.208263:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00080000:0.0:1783144392.208286:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783144392.209202:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501381632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144392.209979:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501381760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144392.210031:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144392.210073:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501381760 00000100:00100000:3.0:1783144392.210078:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501381760 00000100:00100000:3.0:1783144392.210121:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:3.0:1783144392.210129:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afad33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501381760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783144392.210153:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783144392.210192:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afad33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501381760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144392.210199:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00080000:3.0:1783144392.210435:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144392.210467:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501381760:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144392.653900:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783144393.046507:0:93462:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1783144393.079346:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144393.079444:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710720 00000100:00100000:3.0:1783144393.079453:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710720 00000100:00100000:3.0:1783144393.079557:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1262 00000100:00100000:3.0:1783144393.079568:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71910:x1869759481710720:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144393.079589:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144393.079608:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048e88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d1a expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.079680:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048e8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.079694:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.079704:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144393.079781:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144393.079785:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144393.079827:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.079851:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01800/0xad8e53a423048e88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d1a expref: 15 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.079867:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048e8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d1a expref: 14 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.079876:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144393.079879:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144393.079883:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01000, rc 0) 00010000:00000080:3.0:1783144393.079890:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aee572d80 x1869759481710720/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:504/0 lens 576/688 e 0 to 0 dl 1783144404 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144393.079955:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71910:x1869759481710720:12345-192.168.203.4@tcp:101:touch.0 Request processed in 389us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144393.079962:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1262 00000100:00080000:2.0:1783144393.080151:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144393.082950:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144393.083030:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710848 00000100:00100000:3.0:1783144393.083038:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710848 00000100:00100000:3.0:1783144393.083091:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1263 00000100:00100000:3.0:1783144393.083102:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71910:x1869759481710848:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144393.083119:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144393.083137:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048e96 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d21 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083192:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083204:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083213:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083229:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083237:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083243:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083297:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048eab lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083305:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048eab lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083311:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048eab lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144393.083328:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048eab lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083339:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083346:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083352:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083357:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144393.083361:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083368:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083378:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af71ea100) 00010000:00010000:3.0:1783144393.083381:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144393.083385:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083397:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00000/0xad8e53a423048e9d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083408:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083414:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083420:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083424:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144393.083427:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083432:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083438:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c2aee3dbd00) 00010000:00010000:3.0:1783144393.083439:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144393.083442:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083447:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00e00/0xad8e53a423048ea4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083472:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01e00/0xad8e53a423048e96 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d21 expref: 16 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083495:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048eab lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d21 expref: 15 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.083501:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29ec00) 00010000:00010000:3.0:1783144393.083503:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144393.083505:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01600, rc 0) 00010000:00000080:3.0:1783144393.083513:0:81077:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4e9f100 x1869759481710848/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:504/0 lens 576/584 e 0 to 0 dl 1783144404 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144393.083567:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:71910:x1869759481710848:12345-192.168.203.4@tcp:101:touch.0 Request processed in 468us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144393.083575:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1263 00000100:00100000:3.0:1783144393.087751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144393.087784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144393.087805:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481710976 00000100:00100000:3.0:1783144393.087806:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481711104 00000100:00100000:3.0:1783144393.087815:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481711104 00000100:00100000:0.0:1783144393.087815:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481710976 00000100:00100000:3.0:1783144393.087865:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 712 00000100:00100000:0.0:1783144393.087870:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1264 00000100:00100000:3.0:1783144393.087877:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:2404:x1869759481711104:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783144393.087884:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:71910:x1869759481710976:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144393.087891:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144393.087899:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144393.087918:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f600/0xad8e53a423048eb2 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d28 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.087922:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423048eab lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d21 expref: 15 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.087946:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd29ec00) 00010000:00010000:3.0:1783144393.087952:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144393.087972:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f800/0xad8e53a423048eb9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.087984:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f800/0xad8e53a423048eb9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.087994:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f800/0xad8e53a423048eb9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144393.088003:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:2404:x1869759481711104:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 126us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144393.088024:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 712 00000004:00200000:0.0:1783144393.088036:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1783144393.088041:0:66112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783144393.088082:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f600/0xad8e53a423048eb2 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d28 expref: 7 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.088096:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f800/0xad8e53a423048eb9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d28 expref: 6 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.088113:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd096a00) 00010000:00010000:0.0:1783144393.088116:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783144393.088118:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6f800, rc 0) 00000100:00100000:0.0:1783144393.088141:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:71910:x1869759481710976:12345-192.168.203.4@tcp:101:touch.0 Request processed in 263us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144393.088148:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1264 00000100:00080000:0.0:1783144393.088169:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144393.090983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144393.091543:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481711360 00000100:00100000:1.0:1783144393.091558:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481711360 00000100:00100000:1.0:1783144393.091623:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1265 00000100:00100000:1.0:1783144393.091641:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:71910:x1869759481711360:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1783144393.091659:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144393.091676:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048ec0 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d2f expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.091809:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.091822:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.091833:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.091846:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.091853:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.091860:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144393.092006:0:66143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66143:1869759501381888:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783144393.092056:0:66143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144393.092088:0:66143:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af6fb83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144393.092110:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501381888 00000100:00100000:2.0:1783144393.092115:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501381888 00000100:00100000:2.0:1783144393.092156:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1783144393.092166:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66143:x1869759501381888:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1783144393.092207:0:23926:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4e9f800 x1869759501381888/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:504/0 lens 328/4320 e 0 to 0 dl 1783144404 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144393.092256:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66143:x1869759501381888:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144393.092265:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:1.0:1783144393.092282:0:66143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66143:1869759501381888:0@lo:1000:mdt00_003.0 00000004:00080000:1.0:1783144393.092522:0:66143:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x243:0x0], index 1: 0 00010000:00010000:1.0:1783144393.092672:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1600/0xad8e53a423048ed5 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092682:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1600/0xad8e53a423048ed5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092689:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1600/0xad8e53a423048ed5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092789:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092796:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 2/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092802:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092807:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144393.092812:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092819:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092830:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd096a00) 00010000:00010000:1.0:1783144393.092833:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144393.092837:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092843:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1c00/0xad8e53a423048ec7 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144393.092864:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003b2615a reply state 0000000060c87139 transno 81604378763 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092874:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092881:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9c29c3de4000) 00010000:00010000:1.0:1783144393.092883:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144393.092885:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144393.092915:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1e00/0xad8e53a423048ec0 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d2f expref: 9 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092927:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1600/0xad8e53a423048ed5 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d2f expref: 8 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.092935:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c29c3de4600) 00010000:00010000:1.0:1783144393.092937:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144393.092940:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1600, rc 0) 00000100:00100000:1.0:1783144393.092995:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71910:x1869759481711360:12345-192.168.203.4@tcp:101:touch.0 Request processed in 1364us (2017us total) trans 81604378763 rc 0/0 00000100:00100000:1.0:1783144393.093002:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1265 00000100:00100000:1.0:1783144393.095356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144393.095413:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481711616 00000100:00100000:3.0:1783144393.095421:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481711616 00000100:00100000:3.0:1783144393.095470:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1266 00000100:00100000:3.0:1783144393.095480:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71910:x1869759481711616:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:3.0:1783144393.095526:0:81077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144393.095547:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe1600/0xad8e53a423048ed5 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d2f expref: 9 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.095562:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c29c3de4600) 00010000:00010000:3.0:1783144393.095579:0:81077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144393.095625:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.095648:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.095657:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144393.095770:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d54b147 reply state 0000000096383963 transno 81604378764 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.095782:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.095788:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2aee3dbd00) 00010000:00010000:3.0:1783144393.095791:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144393.095793:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783144393.095875:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71910:x1869759481711616:12345-192.168.203.4@tcp:36:touch.0 Request processed in 396us (523us total) trans 81604378764 rc 0/0 00000100:00100000:3.0:1783144393.095883:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1266 00000100:00100000:3.0:1783144393.097380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144393.097452:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481711744 00000100:00100000:0.0:1783144393.097459:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481711744 00000100:00100000:0.0:1783144393.097503:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1267 00000100:00100000:0.0:1783144393.097512:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71910:x1869759481711744:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144393.097529:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144393.097543:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f600/0xad8e53a423048eea lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d36 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.097588:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f600/0xad8e53a423048eea lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d36 expref: 11 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.097601:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f600/0xad8e53a423048eea lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d36 expref: 11 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.097616:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2aee3dbd00) 00010000:00010000:0.0:1783144393.097619:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783144393.097622:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6f600, rc 0) 00000100:00100000:0.0:1783144393.097671:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71910:x1869759481711744:12345-192.168.203.4@tcp:101:touch.0 Request processed in 160us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144393.097685:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1267 00000100:00100000:2.0:1783144393.099215:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144393.099259:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481711872 00000100:00100000:1.0:1783144393.099265:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481711872 00000100:00100000:1.0:1783144393.099321:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4976 00000100:00100000:1.0:1783144393.099330:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2403:x1869759481711872:12345-192.168.203.4@tcp:2:touch.0 00000100:00080000:0.0:1783144393.099530:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144393.099560:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2403:x1869759481711872:12345-192.168.203.4@tcp:2:touch.0 Request processed in 172us (288us total) trans 4294968830 rc 0/0 00000100:00100000:1.0:1783144393.099584:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4976 00000100:00100000:1.0:1783144393.101387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144393.101473:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481712128 00000100:00100000:0.0:1783144393.101478:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481712128 00000100:00100000:0.0:1783144393.101524:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:0.0:1783144393.101534:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71910:x1869759481712128:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144393.101949:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:71910:x1869759481712128:12345-192.168.203.4@tcp:35:touch.0 Request processed in 416us (565us total) trans 81604378765 rc 0/0 00000100:00100000:0.0:1783144393.101956:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:2.0:1783144393.112514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144393.112607:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481712256 00000100:00100000:0.0:1783144393.112617:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481712256 00000100:00100000:0.0:1783144393.112680:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1268 00000100:00100000:0.0:1783144393.112692:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:71911:x1869759481712256:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144393.112712:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144393.112762:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fc00/0xad8e53a423048ef1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d3d expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112823:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112839:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112850:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112865:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112880:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112888:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112943:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fe00/0xad8e53a423048f06 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112952:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fe00/0xad8e53a423048f06 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112960:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fe00/0xad8e53a423048f06 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144393.112983:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fe00/0xad8e53a423048f06 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.112997:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113003:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113009:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113016:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113022:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ea00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144393.113026:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113040:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113053:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af71ea100) 00010000:00010000:0.0:1783144393.113056:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144393.113060:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113067:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048ef8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113077:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113083:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113088:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113093:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fa00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144393.113096:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113102:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113108:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c29cd096300) 00010000:00010000:0.0:1783144393.113110:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144393.113113:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113129:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048eff lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113159:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fc00/0xad8e53a423048ef1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d3d expref: 16 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113172:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fe00/0xad8e53a423048f06 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d3d expref: 15 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.113180:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd29e100) 00010000:00010000:0.0:1783144393.113183:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144393.113186:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6fe00, rc 0) 00010000:00000080:0.0:1783144393.113193:0:66947:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aee573100 x1869759481712256/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:504/0 lens 576/584 e 0 to 0 dl 1783144404 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144393.113259:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:71911:x1869759481712256:12345-192.168.203.4@tcp:101:touch.0 Request processed in 569us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144393.113266:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1268 00000100:00100000:2.0:1783144393.115701:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144393.115789:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481712384 00000100:00100000:0.0:1783144393.115796:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481712384 00000100:00100000:0.0:1783144393.115840:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1269 00000100:00100000:0.0:1783144393.115850:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:71911:x1869759481712384:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144393.115879:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144393.115895:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f200/0xad8e53a423048f0d lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d44 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.115939:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ee00/0xad8e53a423048f14 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.115957:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ee00/0xad8e53a423048f14 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.115966:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ee00/0xad8e53a423048f14 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144393.116004:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783144393.116007:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783144393.116035:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6f200/0xad8e53a423048f0d lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d44 expref: 14 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.116048:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ee00/0xad8e53a423048f14 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d44 expref: 13 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.116055:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd096900) 00010000:00010000:0.0:1783144393.116057:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783144393.116059:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6ee00, rc 0) 00000100:00100000:0.0:1783144393.116101:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71911:x1869759481712384:12345-192.168.203.4@tcp:101:touch.0 Request processed in 253us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144393.116108:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1269 00000100:00100000:2.0:1783144393.116297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144393.116379:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481712512 00000100:00100000:1.0:1783144393.116386:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481712512 00000100:00100000:1.0:1783144393.116425:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 713 00000100:00100000:1.0:1783144393.116434:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:2403:x1869759481712512:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144393.116445:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144393.116459:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af9f6fe00/0xad8e53a423048f06 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d3d expref: 15 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.116472:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd29e100) 00010000:00010000:1.0:1783144393.116476:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144393.116507:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:2403:x1869759481712512:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144393.116513:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 713 00000100:00100000:1.0:1783144393.117823:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144393.118009:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481712768 00000100:00100000:0.0:1783144393.118015:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481712768 00000100:00100000:0.0:1783144393.118056:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1270 00000100:00100000:0.0:1783144393.118063:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:71911:x1869759481712768:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144393.118075:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144393.118087:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fc00/0xad8e53a423048f1b lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d4b expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118172:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118183:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118192:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118203:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118210:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118216:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783144393.118534:0:66112:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x244:0x0], index 1: 0 00010000:00010000:0.0:1783144393.118675:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e200/0xad8e53a423048f30 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118683:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e200/0xad8e53a423048f30 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118690:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e200/0xad8e53a423048f30 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118825:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118843:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118849:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118855:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118861:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fa00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144393.118865:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118871:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118882:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd096900) 00010000:00010000:0.0:1783144393.118885:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144393.118889:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118894:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fa00/0xad8e53a423048f22 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144393.118907:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044efa8fc reply state 000000009c4bb346 transno 81604378766 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118916:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118922:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9c29cd096300) 00010000:00010000:0.0:1783144393.118930:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144393.118932:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783144393.118958:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6fc00/0xad8e53a423048f1b lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d4b expref: 16 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118971:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e200/0xad8e53a423048f30 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d4b expref: 15 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.118979:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c29cd096800) 00010000:00010000:0.0:1783144393.118981:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144393.118984:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6e200, rc 0) 00000100:00100000:0.0:1783144393.119029:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:71911:x1869759481712768:12345-192.168.203.4@tcp:101:touch.0 Request processed in 966us (1209us total) trans 81604378766 rc 0/0 00000100:00100000:0.0:1783144393.119036:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1270 00000100:00100000:1.0:1783144393.121491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144393.121549:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481713024 00000100:00100000:2.0:1783144393.121555:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481713024 00000100:00100000:2.0:1783144393.121618:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1271 00000100:00100000:2.0:1783144393.121625:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:71911:x1869759481713024:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1783144393.121685:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144393.121709:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6e200/0xad8e53a423048f30 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d4b expref: 16 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.121752:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c29cd096800) 00010000:00010000:2.0:1783144393.121776:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144393.121824:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.121836:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.121844:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144393.121933:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b81dadf reply state 000000001455ec1d transno 81604378767 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.121945:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.121951:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2af71e9b00) 00010000:00010000:2.0:1783144393.121954:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144393.121956:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144393.122039:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:71911:x1869759481713024:12345-192.168.203.4@tcp:36:touch.0 Request processed in 413us (630us total) trans 81604378767 rc 0/0 00000100:00100000:2.0:1783144393.122053:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1271 00000100:00100000:2.0:1783144393.124611:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144393.124657:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481713152 00000100:00100000:2.0:1783144393.124665:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481713152 00000100:00100000:2.0:1783144393.124714:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1272 00000100:00100000:2.0:1783144393.124750:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:71911:x1869759481713152:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144393.124770:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144393.124789:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048f45 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d52 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.124848:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048f45 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d52 expref: 18 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.124862:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516600/0xad8e53a423048f45 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d52 expref: 18 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.124878:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2af71e9b00) 00010000:00010000:2.0:1783144393.124882:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144393.124886:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516600, rc 0) 00000100:00100000:2.0:1783144393.124930:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:71911:x1869759481713152:12345-192.168.203.4@tcp:101:touch.0 Request processed in 207us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144393.124938:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1272 00000100:00100000:2.0:1783144393.127474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144393.129027:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481713280 00000100:00100000:1.0:1783144393.129035:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481713280 00000100:00100000:1.0:1783144393.129073:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4977 00000100:00100000:1.0:1783144393.129081:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2404:x1869759481713280:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:1.0:1783144393.129230:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481713280:12345-192.168.203.4@tcp:2:touch.0 Request processed in 150us (1763us total) trans 4294968831 rc 0/0 00000100:00100000:1.0:1783144393.129235:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4977 00000100:00100000:2.0:1783144393.134035:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144393.134141:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481713536 00000100:00100000:0.0:1783144393.134150:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481713536 00000100:00100000:0.0:1783144393.134205:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:0.0:1783144393.134215:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:71911:x1869759481713536:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144393.134455:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:71911:x1869759481713536:12345-192.168.203.4@tcp:35:touch.0 Request processed in 242us (425us total) trans 81604378768 rc 0/0 00000100:00100000:0.0:1783144393.134462:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 239 00010000:00010000:0.0:1783144393.677884:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783144393.957525:0:93559:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783144393.957578:0:93559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.957591:0:93559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.957598:0:93559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.957604:0:93559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.957638:0:93559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783144393.957645:0:93559:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783144393.957670:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144393.957674:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783144393.957680:0:93559:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783144393.957702:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c29ca29f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783144393.958390:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144393.958402:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.958411:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1518800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:3.0:1783144393.958415:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.958424:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144393.958431:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144393.958437:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783144393.958440:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783144393.958442:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783144393.958465:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.958473:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144393.958491:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144393.959028:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144393.959046:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501382144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144393.959110:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144393.959169:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501382016:0@lo:39:umount.0 00000100:00100000:0.0:1783144393.959198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144393.959240:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382016 00000100:00100000:0.0:1783144393.959250:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382016 00000100:00100000:0.0:1783144393.959294:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1783144393.959303:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501382016:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783144393.959328:0:66114:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230488bc 00010000:00010000:3.0:1783144393.959547:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac1518800/0xad8e53a423048c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048c51 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.959572:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144393.959574:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144393.959577:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144393.959587:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382144 00000100:00100000:3.0:1783144393.959591:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382144 00000100:00100000:3.0:1783144393.959625:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1783144393.959642:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501382144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144393.959652:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144393.959665:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00c00/0xad8e53a423048c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048c4a expref: 24 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.959677:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144393.959715:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3650:x1869759501382144:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144393.959740:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1783144393.959782:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501382144:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783144393.959946:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2aee190800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1783144393.959975:0:66114:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ad05d3100 x1869759501382016/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:504/0 lens 224/224 e 0 to 0 dl 1783144404 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783144393.960047:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144393.960049:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1869759501382016:12345-0@lo:39:umount.0 Request processed in 746us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144393.960058:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000020:00000080:0.0:1783144393.960065:0:66114:0:(genops.c:906:class_export_put()) final put ffff9c2af5c49800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783144393.960099:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c49800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783144393.960143:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2aee190800 for lustre-MDT0000 00000100:00080000:3.0:1783144393.960163:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29ca29f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783144393.960175:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501382016:0@lo:39:umount.0 00000100:00080000:1.0:1783144393.960190:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144393.960194:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783144393.960198:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783144393.961273:0:93559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.961285:0:93559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.961304:0:93559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.961311:0:93559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.961386:0:93559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144393.961401:0:93559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.961408:0:93559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.961415:0:93559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.961421:0:93559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.961900:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144393.961907:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.961914:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144393.961918:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.961927:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144393.961934:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144393.961952:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783144393.961955:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783144393.961981:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.961988:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144393.962015:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.962023:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519e00/0xad8e53a423048c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048c5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144393.962034:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501382272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144393.962037:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144393.962042:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.962048:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144393.962051:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.962058:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144393.962065:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144393.962071:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783144393.962073:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:0.0:1783144393.962087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144393.962088:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.962099:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144393.962110:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.962120:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144393.962122:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144393.962125:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144393.962131:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144393.962138:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501382400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144393.962158:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144393.962224:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382272 00000100:00100000:3.0:1783144393.962230:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382272 00000100:00100000:3.0:1783144393.962271:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382400 00000100:00100000:3.0:1783144393.962275:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382400 00000100:00100000:3.0:1783144393.962300:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1783144393.962310:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501382272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144393.962317:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00010000:00010000:3.0:1783144393.962325:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144393.962331:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501382400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144393.962341:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144393.962351:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517400/0xad8e53a423048c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048c58 expref: 24 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.962354:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1800/0xad8e53a4230487ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230487c7 expref: 24 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.962368:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144393.962375:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144393.962414:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3648:x1869759501382272:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144393.962424:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1783144393.962459:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501382400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144393.962468:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501382272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144393.962474:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3648:x1869759501382400:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144393.962484:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00010000:00010000:0.0:1783144393.962663:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144393.962702:0:93559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783144393.962708:0:93559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0600/0xad8e53a4230487c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230487ce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144393.962717:0:93559:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783144393.963221:0:93559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963231:0:93559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963246:0:93559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963253:0:93559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963269:0:93559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783144393.963276:0:93559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963282:0:93559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963287:0:93559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963293:0:93559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144393.963306:0:93559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783144393.963310:0:93559:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783144393.963313:0:93559:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1783144393.963346:0:93559:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783144393.963351:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1783144393.963355:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1783144393.963360:0:93559:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1783144393.964028:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144393.964035:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964044:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0a00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144393.964048:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964062:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144393.964087:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144393.964093:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783144393.964096:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783144393.964098:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783144393.964127:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964133:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144393.964169:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964177:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0a00/0xad8e53a42304878f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423048796 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144393.964189:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501382528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144393.964190:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144393.964196:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964204:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34000 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144393.964208:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964215:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144393.964235:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144393.964284:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382528 00000100:00100000:2.0:1783144393.964290:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382528 00000100:00100000:2.0:1783144393.964325:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1783144393.964333:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3650:x1869759501382528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144393.964342:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144393.964353:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048796 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304878f expref: 21 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.964372:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144393.964413:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3650:x1869759501382528:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144393.964419:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1783144393.964493:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501382528:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1783144393.964617:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144393.964652:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783144393.964655:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783144393.964657:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783144393.964672:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964678:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783144393.964752:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964759:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af6f34000/0xad8e53a4230486bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a4230486c4 expref: -99 pid: 92269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144393.964768:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144393.964769:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144393.964771:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144393.964780:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501382656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144393.964806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144393.965483:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382656 00000100:00100000:3.0:1783144393.965489:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382656 00010000:00010000:0.0:1783144393.965524:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144393.965534:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1783144393.965544:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3651:x1869759501382656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144393.965554:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144393.965566:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a4230486c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230486bd expref: 20 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.965576:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144393.965611:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:3651:x1869759501382656:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144393.965618:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1783144393.965650:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501382656:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1783144393.966287:0:93559:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1783144393.966935:0:92270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117004 is committed 00010000:00010000:3.0:1783144393.966968:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.966982:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.966989:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967007:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac1519000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144393.967013:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967022:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967036:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29c3de4900) 00010000:00010000:3.0:1783144393.967040:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144393.967045:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967052:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac1519000/0xad8e53a423048e3b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967069:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967076:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967083:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.967088:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144393.967092:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783144393.967097:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:3.0:1783144393.967099:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783144393.967106:0:93559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2ac9c74800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783144393.967126:0:93559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2af5c48000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1783144393.967131:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29c3de4900) 00000020:00080000:1.0:1783144393.967132:0:93559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2ac91e3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1783144393.967138:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1783144393.967144:0:93559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2aefa78800 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 192.168.203.4@tcp 10 (0 0 4) 0 0 0 0: 0000000000000000 115964117004 stale:0 00010000:00010000:3.0:1783144393.967145:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783144393.967154:0:93559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2ac6d96000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 115964117002 stale:0 00000020:00080000:1.0:1783144393.967159:0:93559:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c2ac49fb380) has exports, disconnecting them 00000020:00080000:1.0:1783144393.967164:0:93559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2ac9c74800), last request at 1783144380 00000020:00000080:1.0:1783144393.967170:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230488b5 00000100:00080000:1.0:1783144393.967176:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c75000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783144393.967395:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423048e73 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.967709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783144393.967717:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac9c74800): rc 0 00000020:00000080:1.0:1783144393.967741:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ac9c74800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1783144393.967757:0:93559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2af5c48000), last request at 1783144390 00000020:00000080:1.0:1783144393.967761:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230488ae 00000100:00080000:1.0:1783144393.967767:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4a000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144393.967775:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9c74800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1783144393.967782:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2af5c48000): rc 0 00000020:00000080:1.0:1783144393.967785:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2af5c48000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1783144393.967855:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783144393.968642:0:93559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2ac91e3000), last request at 1783144390 00000020:00000080:1.0:1783144393.968646:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230488a7 00000100:00080000:1.0:1783144393.968657:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e1800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144393.968671:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac91e3000): rc 0 00000020:00000080:1.0:1783144393.968673:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ac91e3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783144393.968683:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9c75000 for lustre-MDT0000 00000020:00080000:1.0:1783144393.968688:0:93559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.4@tcp (ffff9c2aefa78800), last request at 1783144393 00000020:00000080:0.0:1783144393.968695:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c48000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783144393.968698:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048711 00000020:00010000:1.0:1783144393.968711:0:93559:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2aefa78800: total 2 00000100:00080000:1.0:1783144393.968713:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9c70000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783144393.968756:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac91e3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:1.0:1783144393.968775:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2aefa78800): rc 0 00000020:00080000:1.0:1783144393.968778:0:93559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2ac6d96000), last request at 1783144374 00000020:00000080:1.0:1783144393.968789:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304870a 00000020:00000080:0.0:1783144393.968792:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5c4a000 for lustre-MDT0000 00000020:00010000:1.0:1783144393.968794:0:93559:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ac6d96000: total 0 00000100:00080000:1.0:1783144393.968797:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2afa9bc800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783144393.968808:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac6d96000): rc 0 00000004:00000080:1.0:1783144393.968813:0:93559:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc16281cf7ae0 00000100:00080000:1.0:1783144393.968827:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783144393.968829:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:0.0:1783144393.968851:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac91e1800 for lustre-MDT0000 00000020:00010000:2.0:1783144393.968915:0:9527:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2aefa78800: total 0 00010000:00010000:0.0:1783144393.968916:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00010000:3.0:1783144393.968917:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ac6d96000: total 0 00010000:00010000:2.0:1783144393.968921:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144393.968995:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ac6d96000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783144393.968995:0:9527:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2aefa78800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783144393.969050:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee47d200/0xad8e53a4230488d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230488d1 expref: 2 pid: 23926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.969051:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517000/0xad8e53a423048dc4 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ce2 expref: 5 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144393.969079:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ac6d96000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1783144393.969093:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423048da8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cdb expref: 4 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.969112:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423048e8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d1a expref: 3 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.969136:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517c00/0xad8e53a423048e03 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cf7 expref: 2 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144393.969160:0:9527:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2aefa78800, canceled 4 locks, left on hash table 0. 00000100:00080000:1.0:1783144393.973431:0:93559:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783144393.973460:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2afa974800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783144393.973619:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783144393.973623:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968829 gen 3 00000004:00080000:1.0:1783144393.973644:0:93559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783144393.973983:0:93559:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783144393.973992:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783144393.973997:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783144393.973998:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968828 gen 3 00000004:00080000:1.0:1783144393.974009:0:93559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783144393.974438:0:93559:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783144393.974449:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2af720e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783144393.974490:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c2ac49fb380) has no exports 00000100:00100000:0.0:1783144393.974590:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501382784:0@lo:39:umount.0 00000100:00100000:0.0:1783144393.974666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144393.974702:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501382912:0@lo:9:umount.0 00000100:00100000:0.0:1783144393.974749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144393.974769:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501383040:0@lo:9:umount.0 00000100:00100000:0.0:1783144393.974789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144393.974834:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382912 00000100:00100000:0.0:1783144393.974840:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382912 00000100:00100000:0.0:1783144393.974887:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383040 00000100:00100000:0.0:1783144393.974890:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383040 00000100:00100000:0.0:1783144393.974914:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4978 00000100:00100000:0.0:1783144393.974922:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501382912:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783144393.974947:0:26149:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048765 00000100:00080000:0.0:1783144393.974956:0:26149:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a40000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783144393.974994:0:26149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968829 00000100:00100000:0.0:1783144393.975114:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501382912:12345-0@lo:9:umount.0 Request processed in 193us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144393.975121:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4978 00000100:00100000:0.0:1783144393.975138:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4979 00000100:00100000:0.0:1783144393.975144:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501383040:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783144393.975155:0:26149:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304877a 00000100:00080000:0.0:1783144393.975160:0:26149:0:(import.c:65:import_set_state_nolock()) ffff9c2af5c4d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783144393.975179:0:26149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968831 00000100:00100000:0.0:1783144393.975247:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3647:x1869759501383040:12345-0@lo:9:umount.0 Request processed in 103us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144393.975253:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4979 00000100:00080000:0.0:1783144393.975272:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144393.975289:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144393.975316:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783144393.975325:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783144393.975327:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144393.975330:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501382912:0@lo:9:umount.0 00000100:00080000:0.0:1783144393.975340:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af720e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783144393.975344:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783144393.975345:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783144393.975347:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501383040:0@lo:9:umount.0 00010000:00010000:0.0:1783144393.975370:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144393.976706:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501382784 00000100:00100000:1.0:1783144393.976714:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501382784 00000100:00100000:1.0:1783144393.976778:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1783144393.976787:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501382784:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783144393.976822:0:78024:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048750 00000100:00080000:1.0:1783144393.976828:0:78024:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783144393.976842:0:78024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378768 00000100:00100000:1.0:1783144393.976965:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1869759501382784:12345-0@lo:39:umount.0 Request processed in 178us (2297us total) trans 81604378769 rc 0/0 00000100:00100000:1.0:1783144393.976993:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00080000:0.0:1783144393.977367:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2afa974800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783144393.977375:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501382784:0@lo:39:umount.0 00010000:00010000:0.0:1783144393.977389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144393.977885:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783144393.978208:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c2ac49fb380) has no exports 00000020:00000080:3.0:1783144394.086206:0:6509:0:(genops.c:906:class_export_put()) final put ffff9c2ac6d96000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783144394.086272:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac6d96000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1783144394.086336:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2afa9bc800 for lustre-MDT0000 00010000:00010000:0.0:1783144394.086349:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144394.086351:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144394.086354:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144394.088411:0:9527:0:(genops.c:906:class_export_put()) final put ffff9c2aefa78800/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00010000:00010000:2.0:1783144394.088445:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144394.088464:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144394.088466:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783144394.088518:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa78800/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef for lustre-MDT0000 00000020:00000080:3.0:1783144394.088577:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9c70000 for lustre-MDT0000 00000020:00000080:1.0:1783144394.107776:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048726 00000020:00000080:1.0:1783144394.107792:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2afcbb9000/lustre-QMT0000_UUID 00000020:01000000:1.0:1783144394.107811:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783144394.107840:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afcbb9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783144394.107901:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144394.107913:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783144394.107918:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c29c2368000) has no exports 00000020:00000080:0.0:1783144394.108144:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304871f 00000020:00000080:0.0:1783144394.108151:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2afcbb8800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783144394.108191:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afcbb8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783144394.108210:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144394.108219:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783144394.108222:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2af5ddd800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783144394.108224:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5ddd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783144394.108231:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1783144394.108361:0:93559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af6ad4240 - data ffff9c2acfcd81b0/ffff9c2add706400 00000020:01000000:0.0:1783144394.108509:0:93559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af9d367e0 - data ffff9c2afa7526c0/ffff9c29c4a5c800 00000100:00080000:3.0:1783144394.137680:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783144394.137689:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783144394.137703:0:93559:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2ae4e9ea00 x1869759501382784/t81604378769(81604378769) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144403 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144394.137744:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783144394.139091:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144394.139096:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968829 gen 4 00000004:00080000:3.0:1783144394.139112:0:93559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144394.139123:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783144394.139507:0:92286:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783144394.139513:0:92286:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:0.0:1783144394.139522:0:92286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:3.0:1783144394.140508:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144394.140512:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968828 gen 4 00000004:00080000:3.0:1783144394.140557:0:93559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144394.140560:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783144394.140846:0:92288:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783144394.140850:0:92288:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:0.0:1783144394.140860:0:92288:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:3.0:1783144394.142152:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230486e0 00000020:00000080:3.0:1783144394.142161:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b2a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144394.142260:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b2a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783144394.143439:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230486f5 00000020:00000080:3.0:1783144394.143448:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ad3edd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144394.143464:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783144394.143470:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144394.143481:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783144394.143486:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c2af9f14d40) has no exports 00000020:00000080:0.0:1783144394.143563:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad3edd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1783144394.143988:0:93559:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783144394.143998:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048773 00000020:00000080:3.0:1783144394.144003:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c29ca299000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144394.144018:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783144394.144023:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144394.144032:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783144394.144034:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c2aee593380) has no exports 00000020:00000080:3.0:1783144394.144040:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304876c 00000020:00000080:3.0:1783144394.144044:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2af720c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144394.144242:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29ca299000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783144394.144253:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af720c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783144394.144556:0:93559:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783144394.144560:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783144394.144564:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968828 gen 5 00000004:00080000:3.0:1783144394.144569:0:93559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144394.144571:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144394.144621:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af720e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783144394.144652:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144394.144661:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144394.144665:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c29c340a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144394.144668:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c340a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783144394.144674:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144394.144828:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048757 00000020:00000080:3.0:1783144394.144835:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2af71e3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144394.144877:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783144394.144881:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144394.144888:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783144394.144891:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c2aee5919c0) has no exports 00000020:00000080:0.0:1783144394.144954:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783144394.144970:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048749 00000020:00000080:3.0:1783144394.144976:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2af71e2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144394.145090:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783144394.145541:0:93559:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783144394.145545:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783144394.145547:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968829 gen 5 00000004:00080000:3.0:1783144394.145551:0:93559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783144394.145553:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783144394.145597:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144394.145604:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783144394.145617:0:93559:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783144394.145623:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304873b 00000020:00000080:0.0:1783144394.145641:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af71e1800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783144394.145648:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2af720f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144394.145651:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af720f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783144394.145654:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783144394.145667:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2af720b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783144394.145714:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783144394.145718:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144394.145740:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783144394.145743:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c29c4ae99c0) has no exports 00000020:00000080:3.0:1783144394.145748:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048734 00000020:00000080:3.0:1783144394.145752:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783144394.145962:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af720b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783144394.146006:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783144394.150784:0:93559:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783144394.150795:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144394.150799:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783144394.150810:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144394.150870:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144394.150883:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144394.150894:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2afa974800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783144394.150909:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144394.150915:0:41298:0:(genops.c:906:class_export_put()) final put ffff9c2af71e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144394.150915:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783144394.150920:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af71e6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783144394.150929:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2aefa79000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783144394.150932:0:41298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144394.150933:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa79000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783144394.150942:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783144394.151067:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230486fc 00000020:00000080:0.0:1783144394.151074:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ac6d97800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783144394.151089:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783144394.151093:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144394.151098:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783144394.151102:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c29c236cd40) has no exports 00000020:00000080:1.0:1783144394.151112:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac6d97800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783144394.151124:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144394.151129:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783144394.151132:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2aefa7b800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783144394.151134:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefa7b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783144394.151138:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783144394.151244:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048703 00000020:00000080:0.0:1783144394.151249:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ac6d93000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783144394.151265:0:93559:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aefdd9000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783144394.151268:0:93559:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefdd9000 3 00000020:01000004:0.0:1783144394.151271:0:93559:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2aefdd9000 from lustre-MDT0000 00000020:00000080:0.0:1783144394.151287:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144394.151292:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783144394.151295:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ae4b2f800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783144394.151297:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ae4b2f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783144394.151303:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783144394.151332:0:93559:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783144394.151335:0:93559:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783144394.151338:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783144394.151340:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144394.151343:0:93559:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783144394.151351:0:93559:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2ac91e4800 a1ed6386-b53d-4b75-b3e0-82656a667de7 192.168.203.4@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144394.151357:0:93559:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2ac7fb1800 4e9e4714-8000-4c64-bed6-3cadd5fdfc80 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144394.151370:0:93559:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9c2aee594d40) has exports, disconnecting them 00000020:00080000:0.0:1783144394.151375:0:93559:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.4@tcp (ffff9c2ac91e4800), last request at 1783144375 00000020:00000080:0.0:1783144394.151395:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230487c0 00000020:00010000:0.0:1783144394.151399:0:93559:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ac91e4800: total 1 00000100:00080000:0.0:1783144394.151403:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e6800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144394.151413:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2ac91e4800): rc 0 00000020:00080000:0.0:1783144394.151416:0:93559:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2ac7fb1800), last request at 1783144374 00000020:00010000:0.0:1783144394.151454:0:6508:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ac91e4800: total 1 00010000:00010000:0.0:1783144394.151477:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ac91e4800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1783144394.151503:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516000/0xad8e53a423048ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41cb1 expref: 5 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151520:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00600/0xad8e53a423048c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41caa expref: 4 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151532:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47c200/0xad8e53a42304888b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c3a expref: 3 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151545:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516c00/0xad8e53a423048899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41c48 expref: 2 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151553:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ac91e4800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1783144394.151570:0:6508:0:(genops.c:906:class_export_put()) final put ffff9c2ac91e4800/a1ed6386-b53d-4b75-b3e0-82656a667de7 00010000:00010000:0.0:1783144394.151575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144394.151577:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144394.151579:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783144394.151592:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230486a1 00000020:00010000:0.0:1783144394.151595:0:93559:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ac7fb1800: total 2 00000100:00080000:0.0:1783144394.151598:0:93559:0:(import.c:65:import_set_state_nolock()) ffff9c2ac7fb0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144394.151613:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2ac7fb1800): rc 0 00000020:00080000:0.0:1783144394.151617:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9c2aee594d40) has no exports 00000020:00010000:0.0:1783144394.151635:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ac7fb1800: total 2 00000020:00000080:1.0:1783144394.151657:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac6d93000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1783144394.151659:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ac7fb1800, canceled 0 locks, left on hash table 13. 00000020:00000080:1.0:1783144394.151668:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac91e4800/a1ed6386-b53d-4b75-b3e0-82656a667de7 for MGS 00010000:00010000:0.0:1783144394.151680:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1200/0xad8e53a4230487ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230487e3 expref: 14 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151701:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3ce00/0xad8e53a423048806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a4230487ff expref: 13 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783144394.151702:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac91e6800 for MGS 00010000:00010000:0.0:1783144394.151738:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c29c9d3de00/0xad8e53a423048868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048861 expref: 12 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151751:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47d600/0xad8e53a423048876 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304886f expref: 11 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151764:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516400/0xad8e53a423048c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048c97 expref: 10 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151832:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe0800/0xad8e53a423048814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304880d expref: 9 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151846:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6e000/0xad8e53a423048c6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048c66 expref: 8 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151861:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517200/0xad8e53a423048cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048ca5 expref: 7 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151871:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01c00/0xad8e53a423048cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048cb3 expref: 6 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151880:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00400/0xad8e53a423048c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048c82 expref: 5 pid: 92276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151907:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac1518a00/0xad8e53a423048cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048cc1 expref: 4 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151919:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aee47ce00/0xad8e53a42304883e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048837 expref: 3 pid: 92275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151932:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423048c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423048c74 expref: 2 pid: 92277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144394.151942:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ac7fb1800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1783144394.151961:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb1800/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 00010000:00010000:0.0:1783144394.151977:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144394.151979:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144394.151981:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783144394.152005:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb1800/4e9e4714-8000-4c64-bed6-3cadd5fdfc80 for MGS 00000020:00000080:1.0:1783144394.152035:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac7fb0000 for MGS 00000100:00100000:1.0:1783144394.152074:0:92275:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2ac4d16000:92275] 0 exiting: rc = 1 00000100:00100000:2.0:1783144394.152095:0:92276:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2aef852e00:92276] 1 exiting: rc = 0 00000100:00100000:1.0:1783144394.152178:0:92277:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c29c377a800:92277] 2 exiting: rc = 0 00000100:00100000:0.0:1783144394.152288:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152298:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152308:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152315:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152323:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152330:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152336:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152341:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152347:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152353:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152361:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152369:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152376:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152383:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152394:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152405:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152415:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152436:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152447:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152454:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152459:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152464:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152471:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152477:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152489:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152494:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152500:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152505:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152511:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152523:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152529:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152535:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152540:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152546:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152551:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152557:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152562:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152568:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152573:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152578:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152583:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152588:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152593:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152599:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152604:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152609:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152614:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152620:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152637:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152644:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152649:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152653:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152669:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152674:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152680:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152686:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152691:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152696:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152701:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152706:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152711:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152716:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152737:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783144394.152746:0:93559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1783144394.153661:0:93559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af6ad4420 - data ffff9c2acfdde1b0/ffff9c29c47c5400 00000020:01000000:0.0:1783144394.153815:0:93559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af9d369c0 - data ffff9c29c1dd8000/ffff9c29c4a5e400 00000020:00000080:0.0:1783144394.154372:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304869a 00000020:00000080:0.0:1783144394.154381:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d52000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783144394.154438:0:93559:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2aefdd9000 from MGS, refs=2 00000020:01000004:0.0:1783144394.154446:0:93559:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefdd9000 2 00000020:01000004:0.0:1783144394.154450:0:93559:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2aefdd9000 from MGS 00000020:00000080:0.0:1783144394.154480:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783144394.154491:0:93559:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783144394.154494:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d54000/MGS 00000020:00000080:0.0:1783144394.154496:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d54000/MGS for MGS 00000020:01000000:0.0:1783144394.154503:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783144394.154562:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783144394.154566:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783144394.154575:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783144394.154580:0:93559:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c29ca29b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783144394.154587:0:93559:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c2ad08dcd40) has exports, disconnecting them 00000020:00080000:0.0:1783144394.154591:0:93559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c29ca29b000), last request at 1783144374 00000020:00000080:0.0:1783144394.154595:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230487b2 00000020:00080000:0.0:1783144394.154604:0:93559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29ca29b000): rc 0 00000020:00000080:0.0:1783144394.154617:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c29ca29b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783144394.154657:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d52000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144394.155564:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29ca29b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783144394.155775:0:93559:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783144394.155779:0:93559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783144394.155784:0:93559:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783144394.155789:0:93559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144394.155810:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29ca29f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783144394.155959:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144394.155968:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783144394.155972:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c29ca29c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783144394.155983:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29ca29c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783144394.155986:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783144394.156054:0:93559:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2aefdd9000 1 00000020:00000080:1.0:1783144394.156059:0:93559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304868c 00000020:00000080:1.0:1783144394.156064:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d56000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783144394.156072:0:93559:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783144394.156079:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d56000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783144394.156088:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783144394.156092:0:93559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783144394.156095:0:93559:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c2af9f10000) has no exports 00000020:00000080:1.0:1783144394.188793:0:93559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783144394.188805:0:93559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783144394.188810:0:93559:0:(genops.c:906:class_export_put()) final put ffff9c2aefddd800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783144394.188814:0:93559:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2aefddd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783144394.188823:0:93559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783144394.188931:0:93559:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9c2aefdda000 00000020:02000400:1.0:1783144394.188990:0:93559:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783144394.702858:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144395.725917:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144395.790037:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783144395.790224:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501383168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144395.790397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144395.790550:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383168 00000100:00100000:1.0:1783144395.790558:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383168 00000100:00100000:1.0:1783144395.790595:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1783144395.790605:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1869759501383168:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783144395.790632:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501383552:0@lo:400:kworker.0 00000100:00100000:2.0:1783144395.790654:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501383424:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.790667:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144395.790692:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501384064:0@lo:400:kworker.0 00000100:00100000:2.0:1783144395.790709:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144395.790737:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144395.790752:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501383936:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.790773:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501383680:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.790796:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144395.790812:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501384192:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.790830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144395.790847:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783144395.790852:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501383296:0@lo:400:kworker.0 00000100:00100000:3.0:1783144395.790866:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383552 00000100:00100000:3.0:1783144395.790870:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383552 00000400:00000100:0.0:1783144395.790870:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501383296 offset 0 length 224: 4 00000100:00100000:0.0:1783144395.790888:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501383808:0@lo:400:kworker.0 00000100:00100000:3.0:1783144395.790904:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383424 00000100:00100000:3.0:1783144395.790907:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383424 00000100:00100000:0.0:1783144395.790907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144395.790916:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383680 00000100:00100000:3.0:1783144395.790918:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383680 00000100:00100000:0.0:1783144395.790925:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384192 00000100:00100000:3.0:1783144395.790926:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383808 00000100:00100000:3.0:1783144395.790928:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383808 00000100:00100000:0.0:1783144395.790928:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384192 00000100:00100000:3.0:1783144395.790941:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1783144395.790951:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1783144395.790953:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501383552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.790957:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501383808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144395.790996:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144395.791007:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501383552:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144395.791007:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501383808:12345-0@lo:400:kworker.0 Request processed in 48us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144395.791015:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1783144395.791071:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1783144395.791080:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1783144395.791084:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3650:x1869759501383424:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783144395.791088:0:81077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783144395.791115:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1783144395.791120:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869759501383680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.791121:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3650:x1869759501383424:12345-0@lo:400:kworker.0 Request processed in 36us (422us total) trans 0 rc -107/-107 00000020:00080000:3.0:1783144395.791124:0:66143:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783144395.791127:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1783144395.791138:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1783144395.791142:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3648:x1869759501384192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144395.791144:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869759501383680:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc -107/-107 00000020:00080000:0.0:1783144395.791146:0:81077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783144395.791149:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1783144395.791163:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3648:x1869759501384192:12345-0@lo:400:kworker.0 Request processed in 20us (332us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144395.791168:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00080000:0.0:1783144395.791183:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144395.791196:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384064 00000100:00100000:0.0:1783144395.791199:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384064 00000100:00100000:0.0:1783144395.791223:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383936 00000100:00100000:0.0:1783144395.791226:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383936 00000100:00100000:0.0:1783144395.791256:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00080000:3.0:1783144395.791259:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1783144395.791261:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501384064:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783144395.791263:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783144395.791266:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144395.791271:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144395.791275:0:3650:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2914 00000100:00080000:3.0:1783144395.791280:0:3650:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144395.791287:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501384064:12345-0@lo:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144395.791293:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1783144395.791303:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1783144395.791309:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afaba4000 x1869759501384320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144395.791309:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501383936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.791332:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501383936:12345-0@lo:400:kworker.0 Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144395.791336:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501383424:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.791337:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1783144395.791350:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501383936:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.791357:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501384320:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783144395.791387:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501383552:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.791392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144395.791396:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501384064:0@lo:400:kworker.0 00000100:00080000:0.0:1783144395.791412:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144395.791421:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384320 00000100:00080000:0.0:1783144395.791421:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144395.791428:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384320 00000100:00100000:0.0:1783144395.791436:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501383808:0@lo:400:kworker.0 00000100:00080000:0.0:1783144395.791445:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1783144395.791446:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00080000:0.0:1783144395.791448:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1783144395.791450:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501384320:12345-0@lo:38:ptlrpcd_00_02.0 00000100:02000400:0.0:1783144395.791451:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783144395.791454:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144395.791456:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2914 00000100:00080000:0.0:1783144395.791459:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00010000:00020000:3.0:1783144395.791464:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144395.791471:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3cb7480 x1869759501384448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144395.791486:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1869759501383680:0@lo:400:kworker.0 00000100:00080000:0.0:1783144395.791495:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783144395.791498:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783144395.791501:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783144395.791503:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144395.791506:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2914 00000100:00080000:0.0:1783144395.791509:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144395.791520:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3cb7100 x1869759501384576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144395.791530:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501384192:0@lo:400:kworker.0 00000100:00100000:0.0:1783144395.791633:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501384448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783144395.791655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144395.791677:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501384576:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783144395.791699:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501384320:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 248us (306us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144395.791699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144395.791706:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00080000:0.0:1783144395.791711:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144395.791715:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144395.791718:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501384320:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783144395.791752:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384448 00000100:00100000:0.0:1783144395.791755:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384448 00000100:00100000:0.0:1783144395.791766:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384576 00000100:00100000:0.0:1783144395.791769:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384576 00000100:00100000:0.0:1783144395.791778:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1783144395.791782:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501384448:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783144395.791793:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144395.791822:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501384448:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38us (165us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144395.791827:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1783144395.791839:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1783144395.791843:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501384576:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783144395.791853:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144395.791874:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501384576:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (175us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144395.791880:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00080000:0.0:1783144395.791900:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144395.791904:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144395.791906:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501384448:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1783144395.791914:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144395.791922:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144395.791925:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501384576:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:3.0:1783144395.792206:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783144395.792210:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c29c5a43000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783144395.792379:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000020:00000080:0.0:1783144395.792680:0:41298:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c5a43000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783144395.792789:0:41298:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c5a40000 for lustre-OST0000 00000020:00080000:1.0:1783144395.793179:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144395.793226:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1869759501383168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2621us (2829us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144395.793236:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:02020000:3.0:1783144395.793258:0:3649:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1783144395.793263:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783144395.793267:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783144395.793271:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783144395.793274:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144395.793278:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2914 00000100:00080000:3.0:1783144395.793283:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144395.793300:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afaba7800 x1869759501384704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144395.793355:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501384704:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783144395.793387:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144395.793469:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384704 00000100:00100000:3.0:1783144395.793473:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384704 00000100:00100000:3.0:1783144395.793493:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:3.0:1783144395.793499:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501384704:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783144395.793511:0:78024:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144395.793581:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501384704:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 81us (193us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144395.793595:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00080000:1.0:1783144395.794449:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144395.794453:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144395.794460:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501384704:0@lo:38:ptlrpcd_00_01.0 00000400:00000100:2.0:1783144395.875225:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481713664 offset 0 length 224: 4 00000100:00100000:2.0:1783144395.875267:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144395.875307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144395.875343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144395.875382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144395.875417:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481714176 00000100:00100000:2.0:1783144395.875425:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481714176 00000100:00100000:1.0:1783144395.875479:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481713920 00000100:00100000:2.0:1783144395.875483:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481714048 00000100:00100000:1.0:1783144395.875484:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481713920 00000100:00100000:2.0:1783144395.875489:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481714048 00000100:00100000:0.0:1783144395.875526:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481713792 00000100:00100000:0.0:1783144395.875532:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481713792 00000100:00100000:2.0:1783144395.875533:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2074 00000100:00100000:1.0:1783144395.875548:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 852 00000100:00100000:2.0:1783144395.875549:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481714176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144395.875562:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:2404:x1869759481713920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144395.875636:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1280 00000100:00100000:0.0:1783144395.875644:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1869759481713792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144395.875651:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2075 00000020:00080000:0.0:1783144395.875653:0:66114:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:3.0:1783144395.875680:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2403:x1869759481714048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144395.875756:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481714176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 210us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144395.875764:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2074 00000100:00100000:1.0:1783144395.875796:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:2404:x1869759481713920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 232us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144395.875804:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 852 00000100:00080000:1.0:1783144395.875854:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144395.875859:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144395.875861:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144395.875885:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2403:x1869759481714048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 221us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144395.875892:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2075 00000100:00100000:0.0:1783144395.876045:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1869759481713792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 401us (700us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783144395.876050:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1280 00000100:00100000:2.0:1783144395.878110:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144395.878189:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481714304 00000100:00100000:3.0:1783144395.878195:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481714304 00000100:00100000:3.0:1783144395.878235:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1281 00000100:00100000:3.0:1783144395.878242:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481714304:12345-192.168.203.4@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783144395.878262:0:66143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144395.878315:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1869759481714304:12345-192.168.203.4@tcp:38:ptlrpcd_00_00.0 Request processed in 72us (209us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144395.878322:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1281 00010000:00010000:0.0:1783144396.749940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783144396.816198:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783144396.816220:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378769 is committed 00000020:00000080:2.0:1783144396.816225:0:75517:0:(genops.c:906:class_export_put()) final put ffff9c2ac7fb2000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783144396.816262:0:75517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378768 is committed 00010000:00010000:1.0:1783144396.816655:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816667:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816674:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816679:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144396.816684:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816691:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816706:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9c29c3de4000) 00010000:00010000:1.0:1783144396.816709:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144396.816736:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816744:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0400/0xad8e53a423048ece lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816769:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816776:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816781:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816787:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144396.816790:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816795:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816804:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2aee3dbd00) 00010000:00010000:1.0:1783144396.816806:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144396.816810:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816815:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2aeed01600/0xad8e53a423048ee3 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816825:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816841:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816847:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816853:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6ea00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144396.816855:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816867:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816875:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9c29cd096300) 00010000:00010000:1.0:1783144396.816886:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144396.816890:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816896:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af9f6ea00/0xad8e53a423048f29 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816965:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816972:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816978:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816983:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144396.816991:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.816997:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.817005:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2af71e9b00) 00010000:00010000:1.0:1783144396.817008:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144396.817011:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144396.817016:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7516a00/0xad8e53a423048f3e lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144396.817800:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac7fb2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783144396.817863:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac7fb3800 for lustre-MDT0001 00000100:00100000:2.0:1783144397.326144:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783144397.326161:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c61fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501384832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144397.326234:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144397.326305:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384832 00000100:00100000:0.0:1783144397.326313:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384832 00000100:00080000:2.0:1783144397.326363:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144397.326392:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:2.0:1783144397.326403:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501384832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144397.326432:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144397.326490:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501384832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144397.326498:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:0.0:1783144397.326539:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c61fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501384832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144397.326747:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501384960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144397.326780:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144397.326828:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501384960 00000100:00100000:0.0:1783144397.326833:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501384960 00000100:00100000:0.0:1783144397.326870:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00080000:2.0:1783144397.326874:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144397.326880:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501384960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144397.326898:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144397.326940:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501384960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144397.326945:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1783144397.327032:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501384960:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783144397.774608:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783144398.351022:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783144398.351029:0:9516:0:(genops.c:906:class_export_put()) final put ffff9c2af5c4a800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783144398.351057:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968831 is committed 00000020:00000080:3.0:1783144398.351078:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af5c4a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783144398.351122:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5c4d800 for lustre-OST0001 00010000:00010000:0.0:1783144398.797871:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144399.822314:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144400.845858:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144400.910017:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144400.910025:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144400.910028:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144400.910036:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2930 00000100:00080000:1.0:1783144400.910042:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144400.910049:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144400.910071:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4e9f480 x1869759501385216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144400.910118:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144400.910122:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144400.910124:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144400.910128:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2930 00000100:00080000:1.0:1783144400.910130:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144400.910134:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144400.910162:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4e9c380 x1869759501385472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144400.910180:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144400.910183:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144400.910185:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144400.910188:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2930 00000100:00080000:1.0:1783144400.910191:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144400.910195:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144400.910206:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2ae4e9d880 x1869759501385728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144400.910229:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144400.910233:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783144400.910316:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501385088:0@lo:400:kworker.0 00000400:00000100:0.0:1783144400.910368:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501385088 offset 0 length 224: 4 00000100:00100000:0.0:1783144400.910404:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501385984:0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.910436:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144400.910459:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144400.910465:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501385856:0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.910486:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144400.910530:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501385600:0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.910553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144400.910570:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783144400.910574:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501385344:0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.910607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144400.910641:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501385600 00000100:00100000:0.0:1783144400.910647:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501385600 00000100:00100000:0.0:1783144400.910690:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501385344 00000100:00100000:0.0:1783144400.910694:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501385344 00000100:00100000:0.0:1783144400.910717:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1783144400.910743:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501385600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.910793:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501385600:12345-0@lo:400:kworker.0 Request processed in 52us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144400.910800:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1783144400.910817:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1783144400.910823:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501385344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.910863:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501385344:12345-0@lo:400:kworker.0 Request processed in 40us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144400.910870:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1783144400.910891:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501385984 00000100:00100000:0.0:1783144400.910894:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501385984 00000100:00100000:0.0:1783144400.910917:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501385856 00000100:00100000:0.0:1783144400.910920:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501385856 00000100:00100000:0.0:1783144400.910938:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:0.0:1783144400.910944:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501385984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.910978:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501385984:12345-0@lo:400:kworker.0 Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144400.910984:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:0.0:1783144400.910995:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1783144400.911000:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501385856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.911022:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501385856:12345-0@lo:400:kworker.0 Request processed in 23us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144400.911026:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1783144400.911053:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501385344:0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.911059:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501385600:0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.911079:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501385856:0@lo:400:kworker.0 00000100:00100000:0.0:1783144400.911084:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501385984:0@lo:400:kworker.0 00000100:00080000:1.0:1783144400.911142:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144400.911147:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2930 00000100:00080000:1.0:1783144400.911149:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783144400.911152:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144400.911164:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee581180 x1869759501386112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144400.911909:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501385216:0@lo:38:kworker.0 00000100:00100000:2.0:1783144400.911948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144400.911975:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501385472:0@lo:38:kworker.0 00000100:00100000:2.0:1783144400.911991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144400.912007:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501385728:0@lo:38:kworker.0 00000100:00100000:2.0:1783144400.912021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144400.912030:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501386112:0@lo:38:kworker.0 00000100:00100000:2.0:1783144400.912040:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144400.912067:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144400.912071:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144400.912072:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144400.912081:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501385216 00000100:00100000:2.0:1783144400.912091:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501385216 00000100:00100000:0.0:1783144400.912107:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501385472 00000100:00100000:2.0:1783144400.912111:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501386112 00000100:00100000:0.0:1783144400.912113:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501385472 00000100:00100000:2.0:1783144400.912115:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501386112 00000100:00100000:2.0:1783144400.912133:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1783144400.912137:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501385216:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144400.912150:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00010000:00020000:2.0:1783144400.912152:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144400.912159:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501386112:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144400.912185:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501385216:12345-0@lo:38:kworker.0 Request processed in 45us (236us total) trans 0 rc -19/-19 00010000:00020000:0.0:1783144400.912193:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144400.912195:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1783144400.912213:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1783144400.912219:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501385472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783144400.912239:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144400.912266:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501385472:12345-0@lo:38:kworker.0 Request processed in 46us (272us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144400.912272:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00080000:2.0:1783144400.912304:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144400.912309:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144400.912312:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501385216:0@lo:38:kworker.0 00000100:00080000:2.0:1783144400.912320:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144400.912323:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144400.912326:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501385472:0@lo:38:kworker.0 00000100:00080000:2.0:1783144400.912333:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144400.912336:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144400.912339:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501386112:0@lo:38:kworker.0 00000100:00100000:0.0:1783144400.912389:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501386112:12345-0@lo:38:kworker.0 Request processed in 70us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144400.912397:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1783144400.912434:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501385728 00000100:00100000:0.0:1783144400.912438:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501385728 00000100:00100000:3.0:1783144400.912747:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1783144400.912754:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501385728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144400.912766:0:8447:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144400.912815:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501385728:12345-0@lo:38:kworker.0 Request processed in 60us (791us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144400.912821:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00080000:2.0:1783144400.912905:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144400.912916:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144400.912920:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501385728:0@lo:38:kworker.0 00000400:00000100:2.0:1783144400.996286:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481714432 offset 0 length 224: 4 00000100:00100000:2.0:1783144400.996327:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144400.996378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144400.996405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144400.996440:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144400.996532:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481714816 00000100:00100000:1.0:1783144400.996541:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481714816 00000100:00100000:1.0:1783144400.996610:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481714944 00000100:00100000:1.0:1783144400.996613:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481714944 00000100:00100000:1.0:1783144400.996634:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2078 00000100:00100000:1.0:1783144400.996643:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481714816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144400.996707:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481714816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 65us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144400.996754:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2079 00000100:00100000:0.0:1783144400.996766:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481714944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144400.996798:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481714944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144400.996847:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481714560 00000100:00100000:3.0:1783144400.996852:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481714560 00000100:00080000:2.0:1783144400.996956:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144400.996960:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144400.996983:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481714688 00000100:00100000:2.0:1783144400.996986:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481714688 00000100:00100000:2.0:1783144400.997018:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 855 00000100:00100000:2.0:1783144400.997023:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2405:x1869759481714688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144400.997054:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2405:x1869759481714688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144400.997061:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 855 00000100:00080000:2.0:1783144400.997080:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144400.997386:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1285 00000100:00100000:3.0:1783144400.997390:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481714560:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:3.0:1783144400.997404:0:81077:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783144400.997430:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2402:x1869759481714560:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 40us (1053us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783144400.997435:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1285 00000100:00100000:1.0:1783144400.997658:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2078 00000100:00100000:0.0:1783144400.999920:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2079 00010000:00010000:0.0:1783144401.871853:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144402.446898:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501386240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144402.446961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144402.447080:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501386240 00000100:00100000:1.0:1783144402.447088:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501386240 00000100:00100000:0.0:1783144402.447117:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501386368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144402.447157:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144402.447181:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144402.447268:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501386368 00000100:00100000:1.0:1783144402.447273:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501386368 00000100:00100000:1.0:1783144402.447322:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1783144402.447333:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501386240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144402.447359:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144402.447408:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501386240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144402.447415:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1783144402.447432:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:1.0:1783144402.447437:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501386368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783144402.447449:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783144402.447532:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144402.447641:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501386240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144402.449643:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501386368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2201us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144402.449652:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1783144402.449742:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501386368:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783144402.894551:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144403.918104:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144404.941879:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144405.966007:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144406.029925:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144406.029933:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144406.029937:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144406.029944:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2935 00000100:00080000:1.0:1783144406.029950:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144406.029957:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144406.029979:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee582300 x1869759501386624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144406.029982:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501386496:0@lo:400:kworker.0 00000100:00080000:1.0:1783144406.030029:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144406.030031:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144406.030033:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:0.0:1783144406.030038:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759501386496 offset 0 length 224: 4 00000100:00080000:1.0:1783144406.030039:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2935 00000100:00080000:1.0:1783144406.030042:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144406.030047:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144406.030056:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee582d80 x1869759501386880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144406.030072:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144406.030075:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144406.030077:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144406.030080:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2935 00000100:00080000:1.0:1783144406.030081:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144406.030084:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144406.030092:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee580380 x1869759501387136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144406.030105:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783144406.030111:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144406.030114:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783144406.030116:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783144406.030118:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501387392:0@lo:400:kworker.0 00000100:00080000:1.0:1783144406.030121:0:41298:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2935 00000100:00080000:1.0:1783144406.030126:0:41298:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783144406.030129:0:41298:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144406.030138:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee580000 x1869759501387520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144406.030164:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501386624:0@lo:38:kworker.0 00000100:00100000:0.0:1783144406.030164:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144406.030197:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501386752:0@lo:400:kworker.0 00000100:00100000:1.0:1783144406.030205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144406.030236:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501386880:0@lo:38:kworker.0 00000100:00100000:3.0:1783144406.030240:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501386624 00000100:00100000:0.0:1783144406.030244:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144406.030256:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501386624 00000100:00100000:1.0:1783144406.030269:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501387008:0@lo:400:kworker.0 00000100:00100000:1.0:1783144406.030291:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144406.030302:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501386752 00000100:00100000:3.0:1783144406.030306:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501386752 00000100:00100000:0.0:1783144406.030309:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387392 00000100:00100000:0.0:1783144406.030315:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387392 00000100:00100000:1.0:1783144406.030316:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144406.030323:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501387264:0@lo:400:kworker.0 00000100:00100000:3.0:1783144406.030349:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387008 00000100:00100000:1.0:1783144406.030352:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144406.030355:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387008 00000100:00100000:0.0:1783144406.030363:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387264 00000100:00100000:0.0:1783144406.030368:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387264 00000100:00100000:3.0:1783144406.030395:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1783144406.030406:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1783144406.030409:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501386752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144406.030409:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:0.0:1783144406.030423:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501387392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144406.030430:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501387008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144406.030476:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501386752:12345-0@lo:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144406.030484:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501387392:12345-0@lo:400:kworker.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144406.030494:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501387008:12345-0@lo:400:kworker.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144406.030495:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1783144406.030499:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1783144406.030517:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1783144406.030527:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:3.0:1783144406.030532:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1783144406.030539:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501387264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144406.030550:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501386624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144406.030568:0:66113:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144406.030590:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501387008:0@lo:400:kworker.0 00000100:00100000:0.0:1783144406.030600:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501387264:12345-0@lo:400:kworker.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144406.030608:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:3.0:1783144406.030617:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1869759501386624:12345-0@lo:38:kworker.0 Request processed in 75us (412us total) trans 0 rc -19/-19 00000100:00080000:2.0:1783144406.030621:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144406.030623:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501387264:0@lo:400:kworker.0 00000100:00080000:2.0:1783144406.030628:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144406.030630:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00080000:2.0:1783144406.030634:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144406.030658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144406.030681:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501386880 00000100:00100000:3.0:1783144406.030686:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501386880 00000100:00100000:0.0:1783144406.030687:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501387136:0@lo:38:kworker.0 00000100:00100000:1.0:1783144406.030702:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501387392:0@lo:400:kworker.0 00000100:00100000:1.0:1783144406.030719:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501386752:0@lo:400:kworker.0 00000100:00100000:0.0:1783144406.030747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144406.030751:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1783144406.030762:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501386880:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783144406.030774:0:66114:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783144406.030784:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501387520:0@lo:38:kworker.0 00000100:00100000:1.0:1783144406.030801:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387136 00000100:00100000:1.0:1783144406.030805:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387136 00000100:00100000:3.0:1783144406.030810:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501386880:12345-0@lo:38:kworker.0 Request processed in 48us (152us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144406.030821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144406.030831:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1783144406.030833:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1783144406.030842:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501387136:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783144406.030846:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387520 00000100:00100000:2.0:1783144406.030852:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387520 00010000:00020000:1.0:1783144406.030856:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1783144406.030872:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144406.030879:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144406.030884:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501386624:0@lo:38:kworker.0 00000100:00100000:2.0:1783144406.030893:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00080000:0.0:1783144406.030900:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783144406.030901:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501387520:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144406.030907:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501387136:12345-0@lo:38:kworker.0 Request processed in 61us (157us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783144406.030910:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144406.030917:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501386880:0@lo:38:kworker.0 00010000:00020000:2.0:1783144406.030919:0:66947:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144406.030923:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00080000:0.0:1783144406.030935:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783144406.030946:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144406.030951:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501387136:0@lo:38:kworker.0 00000100:00100000:2.0:1783144406.030963:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501387520:12345-0@lo:38:kworker.0 Request processed in 61us (144us total) trans 0 rc -19/-19 00000100:00080000:0.0:1783144406.030968:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783144406.030973:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00080000:0.0:1783144406.030976:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783144406.030980:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501387520:0@lo:38:kworker.0 00000400:00000100:2.0:1783144406.116439:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.203.4@tcp portal 26 match 1869759481715072 offset 0 length 224: 4 00000100:00100000:2.0:1783144406.116478:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144406.116505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144406.116526:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144406.116605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144406.116632:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481715584 00000100:00100000:2.0:1783144406.116640:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481715584 00000100:00100000:2.0:1783144406.116689:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481715456 00000100:00100000:2.0:1783144406.116692:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481715456 00000100:00100000:2.0:1783144406.116714:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2082 00000100:00100000:2.0:1783144406.116739:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481715584:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144406.116803:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481715584:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144406.116810:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2082 00000100:00100000:2.0:1783144406.116827:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2083 00000100:00100000:2.0:1783144406.116833:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481715456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144406.116856:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481715456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144406.116863:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2083 00000100:00080000:2.0:1783144406.116882:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144406.116894:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144406.117030:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481715200 00000100:00100000:1.0:1783144406.117035:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481715200 00000100:00100000:1.0:1783144406.117061:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481715328 00000100:00100000:1.0:1783144406.117064:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481715328 00000100:00100000:1.0:1783144406.117096:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 858 00000100:00100000:1.0:1783144406.117103:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2406:x1869759481715328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144406.117139:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2406:x1869759481715328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144406.117145:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 858 00000100:00100000:1.0:1783144406.117160:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1289 00000100:00100000:1.0:1783144406.117164:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481715200:12345-192.168.203.4@tcp:38:kworker.0 00010000:00020000:1.0:1783144406.117181:0:66112:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144406.117204:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1869759481715200:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 38us (727us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144406.117210:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1289 00000100:00080000:1.0:1783144406.117255:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783144406.991282:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144407.566029:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501387648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144407.566099:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144407.566836:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501387776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783144407.566867:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144407.567055:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387648 00000100:00100000:0.0:1783144407.567062:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387648 00000100:00100000:0.0:1783144407.567101:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387776 00000100:00100000:0.0:1783144407.567104:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387776 00000100:00100000:0.0:1783144407.567123:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1783144407.567131:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501387648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144407.567157:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144407.567198:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501387648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144407.567205:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1783144407.567223:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1783144407.567230:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501387776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144407.567243:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144407.567268:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501387776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144407.567273:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1783144407.567313:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501387648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144407.567588:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501387776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144408.017582:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144409.037809:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783144409.748497:0:94177:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783144409.748502:0:94177:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783144409.748503:0:94177:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783144409.748623:0:94177:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c29c5808800 00000020:01000004:3.0:1783144409.748638:0:94177:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783144409.748651:0:94177:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783144409.748664:0:94177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2aee593380) 00000020:00000080:3.0:1783144409.748681:0:94177:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783144409.811428:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.812086:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783144409.813489:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783144409.816298:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.816492:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.816688:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.816930:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.817107:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.817289:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.817470:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.817672:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.817902:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.818084:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.818261:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.818441:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.818627:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.818829:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.819031:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.819230:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.819402:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.819615:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.819849:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.820023:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783144409.820221:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.820458:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783144409.820670:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783144409.821033:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783144409.821240:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783144409.821436:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783144409.821636:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783144409.821836:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783144409.822041:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783144409.822241:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783144409.822418:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783144409.822607:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783144409.823188:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783144409.823533:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783144409.823760:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783144409.824035:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.824203:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.824402:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.824602:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783144409.824812:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.825027:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.825256:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783144409.825424:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.825630:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783144409.826413:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.826444:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.826473:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.827011:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.827414:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.827647:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.828145:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.828348:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783144409.828567:0:94177:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1783144409.829087:0:94177:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783144409.829278:0:94177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783144409.829285:0:94177:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783144409.829296:0:94177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048f53 00000020:01000004:3.0:1783144409.829302:0:94177:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783144409.829315:0:94177:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783144409.829326:0:94177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c29c5808800 from MGS 00000020:01000004:3.0:1783144409.829329:0:94177:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783144409.829339:0:94177:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c2aee590000) 00000020:00000080:3.0:1783144409.829350:0:94177:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783144409.829401:0:94177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c5808800 from MGS, refs=2 00080000:01000000:3.0:1783144409.829405:0:94177:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783144409.829410:0:94177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048f61 00010000:00010000:3.0:1783144409.829527:0:94177:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783144409.832416:0:94177:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783144409.833159:0:94181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783144409.833187:0:94177:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783144409.833219:0:94177:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783144409.833600:0:94177:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783144409.834089:0:94177:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783144409.834210:0:94177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783144409.834215:0:94177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783144409.834622:0:94177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783144409.834628:0:94177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783144409.834860:0:94177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783144409.834866:0:94177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783144409.838455:0:94177:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783144409.838479:0:94177:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1783144409.838481:0:94177:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1783144409.838485:0:94177:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:0.0:1783144409.838490:0:94177:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783144409.838496:0:94177:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1783144409.838500:0:94177:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783144409.838502:0:94177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783144409.838510:0:94177:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2af5513b80 x1869759501383296/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144411 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144409.838548:0:94177:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2ae4e9e680 x1869759501385088/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144416 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144409.838567:0:94177:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2aee580a80 x1869759501386496/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783144409.838577:0:94177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783144409.838580:0:94177:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783144409.838581:0:94177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783144409.838584:0:94177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1783144409.838772:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501385088:0@lo:400:kworker.0 00000100:00100000:3.0:1783144409.838911:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501383296:0@lo:400:kworker.0 00000100:00100000:3.0:1783144409.838946:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501386496:0@lo:400:kworker.0 10000000:01000000:0.0:1783144409.839698:0:94177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1783144409.839712:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048876 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839758:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048876 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839765:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1783144409.839779:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839789:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3dc00/0xad8e53a42304886f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048876 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.839804:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048c6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839811:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048c6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839816:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.839819:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839822:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a423048c66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048c6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.839830:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048c7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839836:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048c7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839841:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.839845:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839849:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423048c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048c7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.839868:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048c89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839874:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048c89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839879:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.839888:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839892:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519600/0xad8e53a423048c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048c89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.839901:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048c9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839907:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048c9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839912:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.839914:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839917:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac1519200/0xad8e53a423048c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048c9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.839924:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048cac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839930:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048cac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839935:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.839943:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839947:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00200/0xad8e53a423048ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048cac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.839954:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839960:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839964:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.839967:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839970:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a423048cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048cba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.839977:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048cc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.839983:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048cc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.839988:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.839990:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.839993:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e600/0xad8e53a423048cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048cc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.840004:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a4230487ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.840010:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a4230487ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.840024:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.840027:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.840031:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1400/0xad8e53a4230487e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a4230487ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.840042:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048806 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.840048:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048806 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.840053:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783144409.840056:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.840059:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0200/0xad8e53a4230487ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048806 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.840070:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048814 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.840075:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048814 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.840080:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783144409.840083:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.840086:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0c00/0xad8e53a42304880d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048814 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.840094:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a42304883e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.840109:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a42304883e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.840114:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783144409.840117:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.840120:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c29c9d3da00/0xad8e53a423048837 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a42304883e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.840128:0:94177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xad8e53a423048868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144409.840135:0:94177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xad8e53a423048868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.840148:0:94177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783144409.840152:0:94177:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783144409.840155:0:94177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aee47c600/0xad8e53a423048861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xad8e53a423048868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783144409.840170:0:94177:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2ac6d92000 already not connected (conn 55, was 0): DISCONN 00000100:00080000:0.0:1783144409.840175:0:94177:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144409.840179:0:94177:0:(import.c:512:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 2909 00000100:00080000:0.0:1783144409.840185:0:94177:0:(import.c:626:import_select_connection()) MGC192.168.203.104@tcp: import ffff9c2ac6d92000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144409.840210:0:94177:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3cb7480 x1869759501387904/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144409.840229:0:94177:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1783144409.840290:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501387904:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783144409.840347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144409.840397:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501387904 00000100:00100000:2.0:1783144409.840404:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501387904 00000100:00100000:2.0:1783144409.840440:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783144409.840447:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1869759501387904:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783144409.840466:0:94183:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo t0 exp 0000000000000000 cur 2944 last 0 00000020:00000080:2.0:1783144409.840495:0:94183:0:(genops.c:1406:class_connect()) connect: client 4e9e4714-8000-4c64-bed6-3cadd5fdfc80, cookie 0xad8e53a423048f68 00000100:00080000:2.0:1783144409.840614:0:94183:0:(import.c:65:import_set_state_nolock()) ffff9c29c5727800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144409.840669:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:3647:x1869759501387904:12345-0@lo:250:mount.lustre.0 Request processed in 221us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.840677:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783144409.840759:0:3647:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 28 00000100:00080000:1.0:1783144409.840767:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:1.0:1783144409.840773:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783144409.840782:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783144409.840785:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac6d92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783144409.840787:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783144409.840801:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783144409.840812:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3647:1869759501387904:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1783144409.840883:0:94177:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1783144409.840891:0:94177:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783144409.840920:0:94177:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783144409.840924:0:94177:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783144409.841011:0:94177:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783144409.841036:0:94177:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783144409.841040:0:94177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783144409.841042:0:94177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144409.841043:0:94177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144409.841044:0:94177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144409.841046:0:94177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144409.841047:0:94177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144409.841049:0:94177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144409.841050:0:94177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144409.841055:0:94177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144409.841056:0:94177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783144409.841058:0:94177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783144409.841060:0:94177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783144409.841061:0:94177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783144409.841062:0:94177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144409.841063:0:94177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144409.841064:0:94177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144409.841065:0:94177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144409.841066:0:94177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783144409.841066:0:94177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783144409.841067:0:94177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144409.841068:0:94177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783144409.841080:0:94177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783144409.841090:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783144409.841121:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144409.841138:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144409.841190:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388032 00000100:00100000:1.0:1783144409.841194:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388032 00000100:00100000:1.0:1783144409.841227:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783144409.841234:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:94177:x1869759501388032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144409.841265:0:94185:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783144409.841268:0:94185:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783144409.841271:0:94185:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783144409.841578:0:94186:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000000:0.0:1783144409.841599:0:52153:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.104@tcp 10000000:01000000:0.0:1783144409.841612:0:52153:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1783144409.841620:0:52153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783144409.841621:0:52153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783144409.841623:0:52153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.841624:0:52153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144409.841625:0:52153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.841627:0:52153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.841628:0:52153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783144409.841629:0:52153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.841631:0:52153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:1.0:1783144409.841665:0:94185:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 120 00000020:01000000:0.0:1783144409.841673:0:52153:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1783144409.841682:0:52153:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1783144409.841685:0:52153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783144409.841686:0:52153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783144409.841687:0:52153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.841688:0:52153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144409.841689:0:52153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.841691:0:52153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.841692:0:52153:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783144409.841693:0:52153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.841695:0:52153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783144409.841742:0:52153:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1783144409.841748:0:52153:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1783144409.841750:0:52153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783144409.841752:0:52153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783144409.841753:0:52153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.841755:0:52153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144409.841756:0:52153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.841757:0:52153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.841758:0:52153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144409.841759:0:52153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.841761:0:52153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783144409.841777:0:52153:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1783144409.841799:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144409.841811:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501388160:0@lo:253:kworker.0 00000100:00100000:0.0:1783144409.841852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.841909:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501388288:0@lo:253:kworker.0 00000100:00100000:0.0:1783144409.841943:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144409.841973:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388160 00000100:00100000:2.0:1783144409.841977:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388160 00000100:00100000:0.0:1783144409.841980:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144409.841988:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501388416:0@lo:253:kworker.0 00000100:00100000:2.0:1783144409.841991:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388288 00000100:00100000:2.0:1783144409.841994:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388288 00000100:00100000:2.0:1783144409.842005:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783144409.842012:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3648:x1869759501388160:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1783144409.842022:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:2.0:1783144409.842027:0:94183:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1783144409.842204:0:94184:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1783144409.842210:0:94184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1783144409.842637:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388416 00000100:00100000:2.0:1783144409.842641:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388416 00000100:00100000:3.0:1783144409.842694:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783144409.842702:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3650:x1869759501388288:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783144409.842719:0:94188:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783144409.843079:0:94187:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783144409.843082:0:94187:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783144409.843083:0:94187:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783144409.843085:0:94187:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783144409.843094:0:94187:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:3.0:1783144409.843172:0:94185:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783144409.843186:0:94185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783144409.843211:0:94183:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783144409.844826:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94177:x1869759501388032:12345-0@lo:253:mount.lustre.0 Request processed in 3588us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.844837:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783144409.844869:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783144409.844878:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:3650:x1869759501388416:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783144409.844899:0:94185:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783144409.844938:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783144409.844953:0:94177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783144409.844957:0:94177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783144409.844959:0:94177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144409.844960:0:94177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.844961:0:94177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144409.844962:0:94177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.844964:0:94177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.844965:0:94177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144409.844966:0:94177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144409.844968:0:94177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.844969:0:94177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783144409.844990:0:94177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c29c5808800 from lustre-MDT0000 10000000:01000000:0.0:1783144409.845071:0:94177:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783144409.845075:0:94177:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783144409.845083:0:94177:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c29c5808800 10000000:01000000:0.0:1783144409.845088:0:94177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783144409.845093:0:94177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c29c5808800 10000000:01000000:0.0:1783144409.845097:0:94177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783144409.845100:0:94177:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c29c5808800 from 1 10000000:01000000:0.0:1783144409.845103:0:94177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783144409.845132:0:94177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ec00/0xad8e53a423048f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.845144:0:94177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ec00/0xad8e53a423048f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.845153:0:94177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ec00/0xad8e53a423048f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144409.845185:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783144409.845219:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.845256:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144409.845272:0:94184:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:2.0:1783144409.845280:0:94184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:2.0:1783144409.845780:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388544 00000100:00100000:2.0:1783144409.845797:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388544 00000100:00100000:0.0:1783144409.845956:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783144409.845966:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94177:x1869759501388544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144409.845975:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144409.845989:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6e600/0xad8e53a423048f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048f6f expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.846010:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6e600/0xad8e53a423048f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048f6f expref: 9 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.846021:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6e600/0xad8e53a423048f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048f6f expref: 9 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.846031:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6e600, rc 0) 00000100:00100000:0.0:1783144409.846075:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:94177:x1869759501388544:12345-0@lo:101:mount.lustre.0 Request processed in 110us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.846081:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:3.0:1783144409.846190:0:94183:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:2.0:1783144409.846194:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388544:0@lo:101:mount.lustre.0 20000000:01000000:3.0:1783144409.846203:0:94183:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1783144409.846208:0:94177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ec00/0xad8e53a423048f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048f76 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144409.846218:0:94188:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1783144409.846219:0:94177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ec00/0xad8e53a423048f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048f76 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144409.846236:0:94177:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 20000000:01000000:1.0:1783144409.846274:0:94186:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783144409.846278:0:94186:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783144409.846290:0:94186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.846357:0:94177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ec00/0xad8e53a423048f6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048f76 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.846366:0:94177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ec00/0xad8e53a423048f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048f76 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144409.846373:0:94177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783144409.846377:0:94177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783144409.846381:0:94177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c29c5808800 10000000:01000000:2.0:1783144409.846384:0:94177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783144409.846386:0:94177:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783144409.846388:0:94177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783144409.846404:0:94177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.846411:0:94177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.846418:0:94177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144409.846431:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783144409.846461:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.846470:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3648:x1869759501388160:12345-0@lo:253:kworker.0 Request processed in 4459us (4619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.846481:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac8802a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144409.846483:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783144409.846491:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388672 00000100:00100000:2.0:1783144409.846495:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388672 00000100:00100000:2.0:1783144409.846526:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783144409.846533:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94177:x1869759501388672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783144409.846540:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144409.846549:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423048f84 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.846562:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423048f84 expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.846570:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048f84 expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783144409.846571:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783144409.846573:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783144409.846574:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.846575:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:2.0:1783144409.846576:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517000, rc 0) 00000020:01000004:0.0:1783144409.846577:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.846578:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.846579:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783144409.846580:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.846582:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783144409.846584:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501388160:0@lo:253:kworker.0 00000100:00100000:2.0:1783144409.846608:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:94177:x1869759501388672:12345-0@lo:101:mount.lustre.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.846614:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783144409.846650:0:94186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.846656:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388672:0@lo:101:mount.lustre.0 20000000:01000000:1.0:1783144409.846660:0:94186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000382171s 00010000:00010000:1.0:1783144409.846663:0:94186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.846665:0:94177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.846671:0:94186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.846672:0:94177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.846677:0:94186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.846684:0:94186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.846696:0:94186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144409.846700:0:94186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.846707:0:94186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.846712:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388800:0@lo:501:mount.lustre.0 00010000:00010000:1.0:1783144409.846717:0:94186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.846752:0:94186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.846758:0:94186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1a00/0xad8e53a423048f7d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.846838:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144409.846856:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388800 00000100:00100000:3.0:1783144409.846859:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3d1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144409.846860:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388800 00000100:00100000:2.0:1783144409.846882:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783144409.846888:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:94177:x1869759501388800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783144409.846970:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501388800:12345-0@lo:501:mount.lustre.0 Request processed in 81us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.846976:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783144409.846989:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144409.847015:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144409.847047:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.847066:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3d1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144409.847075:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501388928 00000100:00100000:2.0:1783144409.847084:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501388928 00000100:00100000:2.0:1783144409.847105:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783144409.847112:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501388928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783144409.847189:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501388928:12345-0@lo:503:mount.lustre.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.847196:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783144409.847207:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501388928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144409.847715:0:94190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94190:1869759501389056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144409.847776:0:94190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.847797:0:94190:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3d10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.847857:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389056 00000100:00100000:0.0:1783144409.847861:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389056 00000100:00100000:0.0:1783144409.847882:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783144409.847888:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94190:x1869759501389056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144409.848118:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94190:x1869759501389056:12345-0@lo:502:llog_process_th.0 Request processed in 229us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.848124:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783144409.848192:0:94190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94190:1869759501389056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783144409.848212:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144409.848266:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144409.848269:0:94190:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783144409.848275:0:94190:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783144409.848283:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783144409.848296:0:94190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c2aee594d40) 00000020:00000080:3.0:1783144409.848315:0:94190:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1783144409.848321:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783144409.848384:0:94190:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783144409.848391:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048f99 00000020:00000080:3.0:1783144409.848615:0:94190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783144409.848619:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144409.848623:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144409.848624:0:94190:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783144409.848627:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144409.848630:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 20000000:01000000:1.0:1783144409.848630:0:94185:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000080:3.0:1783144409.848631:0:94190:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783144409.848634:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783144409.848641:0:94190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c2aee5919c0) 00000020:00000080:3.0:1783144409.848651:0:94190:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1783144409.848655:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783144409.848657:0:94190:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783144409.848659:0:94190:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783144409.848664:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 20000000:01000000:0.0:1783144409.848697:0:94188:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000020:01000004:3.0:1783144409.848705:0:94190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c5808800 from lustre-MDT0000, refs=3 20000000:01000000:0.0:1783144409.848707:0:94188:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000020:00000080:3.0:1783144409.848718:0:94190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c29c3568000) 00000020:00000080:3.0:1783144409.848749:0:94190:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1783144409.848813:0:94190:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783144409.848819:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423048fae 20000000:01000000:1.0:1783144409.848852:0:94186:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783144409.848856:0:94186:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783144409.848868:0:94186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.848880:0:94186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783144409.848887:0:94186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000382171s 00010000:00010000:1.0:1783144409.848891:0:94186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.848897:0:94186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144409.848906:0:94190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00010000:00010000:1.0:1783144409.848908:0:94186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:01000000:3.0:1783144409.848912:0:94190:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00010000:00010000:1.0:1783144409.848914:0:94186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783144409.848916:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad8e53a423048fbc 00080000:01000000:3.0:1783144409.848920:0:94190:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00010000:00010000:1.0:1783144409.848921:0:94186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1800 already unused, calling callback (ffffffffc0c0bce0) 00000020:00000080:3.0:1783144409.848922:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048fc3 00010000:00010000:1.0:1783144409.848924:0:94186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.848931:0:94186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.848939:0:94186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.848945:0:94186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.848950:0:94186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1800/0xad8e53a423048fb5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783144409.856716:0:94185:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783144409.856746:0:94185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783144409.857065:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:3650:x1869759501388416:12345-0@lo:253:kworker.0 Request processed in 12184us (15038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.857076:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1783144409.857134:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783144409.857137:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783144409.857139:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144409.857151:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144409.857152:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144409.857153:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144409.857155:0:3650:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783144409.857156:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144409.857158:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144409.857161:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501388416:0@lo:253:kworker.0 20000000:01000000:2.0:1783144409.857333:0:94186:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144409.857338:0:94186:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144409.857358:0:94186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857373:0:94186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783144409.857383:0:94186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000382171s 00010000:00010000:2.0:1783144409.857387:0:94186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857394:0:94186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857401:0:94186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857409:0:94186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857415:0:94186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144409.857419:0:94186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857443:0:94186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857454:0:94186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857461:0:94186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.857466:0:94186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517800/0xad8e53a423048fca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144409.857633:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:3650:x1869759501388288:12345-0@lo:253:kworker.0 Request processed in 14930us (15690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.857639:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1783144409.858842:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783144409.858849:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783144409.858851:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144409.858852:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144409.858853:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144409.858856:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144409.858857:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144409.858859:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144409.858861:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783144409.858866:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501388288:0@lo:253:kworker.0 00010000:00010000:3.0:1783144409.895739:0:94190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1783144409.895902:0:94190:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 111669149701 srv lr: 115964116992 lx: 0 gen 21 00000001:00080000:3.0:1783144409.895935:0:94190:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef idx: 2 lr: 0 srv lr: 115964116992 lx: 0 gen 23 00000001:00000004:3.0:1783144409.895961:0:94190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116992 00000001:00080000:3.0:1783144409.896052:0:94190:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1783144409.896102:0:94190:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2ac7511e40: xid 1869759481705216, transno 115964116997, client gen 23, slot idx 0 00000001:00080000:3.0:1783144409.896112:0:94190:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2ac7511600: xid 1869759501379456, transno 115964117001, client gen 21, slot idx 1 00000001:00080000:3.0:1783144409.896117:0:94190:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2ac7511c00: xid 1869759501379712, transno 115964117002, client gen 21, slot idx 2 00000001:00080000:3.0:1783144409.896122:0:94190:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2ac75110c0: xid 1869759501376128, transno 115964116998, client gen 21, slot idx 3 00000020:00000080:3.0:1783144409.896521:0:94190:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c29c356cd40) 00000020:00000080:3.0:1783144409.896540:0:94190:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1783144409.896611:0:94190:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783144409.896618:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048fe6 00000020:00000080:3.0:1783144409.897075:0:94190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783144409.901508:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad8e53a423048fed 00000020:00000080:3.0:1783144409.901899:0:94190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783144409.901910:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144409.901917:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144409.901919:0:94190:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783144409.901923:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783144409.901926:0:94190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783144409.901928:0:94190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144409.901929:0:94190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144409.901931:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783144409.901934:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144409.901936:0:94190:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783144409.901940:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144409.901945:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144409.901946:0:94190:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783144409.901950:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783144409.901986:0:94190:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783144409.902001:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144409.902009:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144409.902011:0:94190:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783144409.902014:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144409.902017:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144409.902019:0:94190:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783144409.902022:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783144409.902027:0:94190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:00000080:3.0:1783144409.902049:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783144409.902062:0:94190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c2af5d5cd40) 00000020:00000080:3.0:1783144409.902078:0:94190:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1783144409.902082:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783144409.902131:0:94190:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783144409.902137:0:94190:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783144409.902141:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423048ffb 00010000:00080000:3.0:1783144409.902167:0:94190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ad13c7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1783144409.903998:0:94190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783144409.905064:0:94190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144409.905077:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783144409.905111:0:94190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783144409.905135:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423049002 00000100:00080000:2.0:1783144409.905144:0:94190:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783144409.905149:0:94190:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2ad13c7800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144409.905180:0:94190:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60e9f80 x1869759501389184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144409.905244:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501389184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783144409.905308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783144409.905402:0:94190:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1783144409.905463:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144409.905467:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.905469:0:94190:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783144409.905472:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783144409.905475:0:94190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1783144409.905476:0:94190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783144409.905478:0:94190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783144409.905479:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783144409.905489:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.905490:0:94190:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783144409.905494:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783144409.905499:0:94190:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783144409.905502:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.905504:0:94190:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783144409.905507:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783144409.905511:0:94190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:2.0:1783144409.905540:0:94190:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783144409.905543:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783144409.905554:0:94190:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c2af9c78000) 00000020:00000080:2.0:1783144409.905568:0:94190:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783144409.905572:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783144409.905631:0:94190:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783144409.905637:0:94190:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783144409.905642:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423049010 00010000:00080000:2.0:1783144409.905680:0:94190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c29c5a45800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1783144409.905883:0:94190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1783144409.906361:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389184 00000100:00100000:3.0:1783144409.906369:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389184 00000100:00100000:3.0:1783144409.906401:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:3.0:1783144409.906409:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501389184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783144409.906432:0:8447:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2944 last 0 00000020:00000080:3.0:1783144409.906462:0:8447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423049017 00000004:00100000:3.0:1783144409.906474:0:8447:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783144409.906564:0:8447:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e6800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783144409.906665:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144409.906671:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144409.906674:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144409.906683:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2940 00000100:00080000:0.0:1783144409.906686:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783144409.906691:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144409.906712:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2affdb4000 x1869759501389312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:2.0:1783144409.907935:0:94190:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783144409.907960:0:94190:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783144409.908290:0:94190:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:2.0:1783144409.908944:0:94190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783144409.908970:0:94190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000100:00100000:1.0:1783144409.911022:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501389312:0@lo:38:kworker.0 00000100:00100000:1.0:1783144409.911089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783144409.911093:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144409.911099:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144409.911102:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144409.911109:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2940 00000100:00080000:0.0:1783144409.911113:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783144409.911126:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144409.911146:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2affdb4380 x1869759501389568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783144409.911166:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144409.911170:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783144409.911172:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783144409.911176:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2940 00000100:00080000:0.0:1783144409.911179:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1783144409.911183:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501389184:12345-0@lo:38:llog_process_th.0 Request processed in 4771us (5872us total) trans 0 rc 0/0 00000100:00080000:0.0:1783144409.911186:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144409.911199:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1783144409.911203:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2affdb6680 x1869759501389824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144409.911207:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783144409.911219:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1783144409.911229:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783144409.911235:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783144409.911238:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ad13c7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783144409.911239:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501389696:0@lo:400:kworker.0 00000100:00100000:0.0:1783144409.911251:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144409.911258:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501389184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783144409.911263:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501389952:0@lo:400:kworker.0 00000100:00100000:1.0:1783144409.911289:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501389568:0@lo:38:kworker.0 00000100:00100000:0.0:1783144409.911299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144409.911322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.911342:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389952 00000100:00100000:0.0:1783144409.911349:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389952 00000100:00100000:1.0:1783144409.911350:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501389824:0@lo:38:kworker.0 00000100:00100000:1.0:1783144409.911389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.911401:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1783144409.911412:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501389952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144409.911437:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389312 00000100:00100000:1.0:1783144409.911443:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389312 00000100:00100000:0.0:1783144409.911461:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501389952:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.911465:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389568 00000100:00100000:1.0:1783144409.911470:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389568 00000100:00100000:0.0:1783144409.911471:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:1.0:1783144409.911492:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1783144409.911500:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501389312:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144409.911524:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501389952:0@lo:400:kworker.0 00000100:00080000:0.0:1783144409.911560:0:52153:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783144409.911566:0:52153:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783144409.911567:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501389312:12345-0@lo:38:kworker.0 Request processed in 65us (476us total) trans 0 rc -11/-11 00000100:00080000:0.0:1783144409.911569:0:52153:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783144409.911575:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00080000:0.0:1783144409.911582:0:52153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2940 00000100:00080000:0.0:1783144409.911586:0:52153:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783144409.911590:0:52153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144409.911600:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1783144409.911601:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501390080:0@lo:400:kworker.0 00000100:00100000:1.0:1783144409.911608:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501389568:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144409.911632:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144409.911653:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501389568:12345-0@lo:38:kworker.0 Request processed in 45us (331us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144409.911661:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1783144409.911679:0:52153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c3cb7480 x1869759501390208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144409.911681:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144409.911698:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389824 00000100:00100000:1.0:1783144409.911703:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389824 00000100:00100000:1.0:1783144409.911754:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1783144409.911759:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501389824:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783144409.911789:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501389824:12345-0@lo:38:kworker.0 Request processed in 29us (402us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783144409.911794:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1783144409.911838:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501390208:0@lo:38:kworker.0 00000100:00100000:1.0:1783144409.911861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783144409.911888:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144409.911893:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144409.911897:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501389568:0@lo:38:kworker.0 00000100:00100000:0.0:1783144409.911901:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390208 00000100:00100000:0.0:1783144409.911908:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390208 00000100:00080000:1.0:1783144409.911919:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144409.911925:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783144409.911933:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:0.0:1783144409.911938:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501390208:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144409.911972:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1869759501390208:12345-0@lo:38:kworker.0 Request processed in 32us (109us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783144409.911978:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1783144409.912023:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501389824:0@lo:38:kworker.0 00000100:00080000:1.0:1783144409.912039:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144409.912043:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144409.912046:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501389312:0@lo:38:kworker.0 00000100:00080000:1.0:1783144409.912065:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144409.912069:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783144409.912072:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501390208:0@lo:38:kworker.0 00000100:00100000:3.0:1783144409.912175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144409.912185:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501389440:0@lo:400:kworker.0 00000100:00100000:1.0:1783144409.912208:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389696 00000100:00100000:1.0:1783144409.912213:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389696 00000100:00100000:2.0:1783144409.912223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.912228:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390080 00000100:00100000:3.0:1783144409.912233:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390080 00000100:00100000:2.0:1783144409.912249:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501390336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144409.912254:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501389440 00000100:00100000:1.0:1783144409.912259:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501389440 00000100:00100000:3.0:1783144409.912272:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1783144409.912284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144409.912294:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1783144409.912303:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501389696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144409.912318:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390336 00000100:00100000:2.0:1783144409.912323:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390336 00000100:00100000:3.0:1783144409.912343:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501390080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144409.912349:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501389696:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.912355:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1783144409.912360:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1783144409.912374:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501390336:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144409.912382:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1783144409.912396:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501390080:12345-0@lo:400:kworker.0 Request processed in 55us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.912396:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501389440:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1783144409.912397:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1783144409.912421:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1783144409.912449:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501390336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.912457:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869759501389440:12345-0@lo:400:kworker.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.912459:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:3.0:1783144409.912463:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501390080:0@lo:400:kworker.0 00000100:00100000:1.0:1783144409.912471:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1783144409.912499:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1869759501389440:0@lo:400:kworker.0 00000100:00080000:1.0:1783144409.912501:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144409.912508:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144409.912531:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501390336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144409.912559:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501389696:0@lo:400:kworker.0 00000040:00080000:0.0:1783144409.913272:0:94190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:2.0:1783144409.913630:0:94196:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:2.0:1783144409.913635:0:94196:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1783144409.914011:0:94196:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1783144409.914026:0:94196:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1783144409.914127:0:94196:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1783144409.914130:0:94196:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783144409.914460:0:94190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144409.914469:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783144409.914500:0:94190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783144409.914526:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304901e 00000100:00080000:2.0:1783144409.914534:0:94190:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783144409.914539:0:94190:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c29c5a45800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144409.914563:0:94190:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60eaa00 x1869759501390464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144409.914585:0:94190:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1783144409.914622:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501390464:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1783144409.914632:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144409.914638:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.914640:0:94190:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783144409.914643:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783144409.914646:0:94190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1783144409.914653:0:94190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783144409.914655:0:94190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783144409.914657:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783144409.914661:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.914662:0:94190:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783144409.914665:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1783144409.914680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1783144409.914716:0:94190:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783144409.914740:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.914742:0:94190:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783144409.914747:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00100000:3.0:1783144409.914750:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390464 00000020:00000080:2.0:1783144409.914752:0:94190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000100:00100000:3.0:1783144409.914757:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390464 00000020:01000000:2.0:1783144409.914773:0:94190:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783144409.914776:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783144409.914837:0:94190:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c2af9c799c0) 00000020:00000080:2.0:1783144409.914853:0:94190:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1783144409.914859:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1783144409.914861:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980 00000100:00100000:3.0:1783144409.914869:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1869759501390464:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783144409.914893:0:26146:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2944 last 0 00000004:00080000:2.0:1783144409.914920:0:94190:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00000020:00000080:3.0:1783144409.914922:0:26146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304902c 00080000:01000000:2.0:1783144409.914927:0:94190:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783144409.914934:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad8e53a423049033 00002000:00100000:3.0:1783144409.914948:0:26146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2afcbb8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783144409.914954:0:26146:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783144409.914957:0:26146:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1783144409.914959:0:94190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c29c5a41800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00002000:00080000:3.0:1783144409.915019:0:26146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783144409.915041:0:26146:0:(import.c:65:import_set_state_nolock()) ffff9c2afcbb9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144409.915095:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501390464:12345-0@lo:8:llog_process_th.0 Request processed in 223us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.915102:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980 00000100:00100000:3.0:1783144409.915143:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:2.0:1783144409.915150:0:94190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00080000:3.0:1783144409.915151:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783144409.915166:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783144409.915171:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783144409.915174:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783144409.915185:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783144409.915203:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501390464:0@lo:8:llog_process_th.0 00000040:01000000:2.0:1783144409.915203:0:94190:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783144409.915216:0:94190:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000004:00080000:3.0:1783144409.915228:0:94196:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783144409.915268:0:94196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2944268545791ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783144409.915275:0:94196:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783144409.915537:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144409.915547:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501390592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144409.915577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.915601:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390592 00000100:00100000:0.0:1783144409.915604:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390592 00000100:00100000:0.0:1783144409.915637:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1783144409.915643:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501390592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783144409.915658:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144409.915821:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501390592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.915828:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1783144409.915867:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501390592:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783144409.916045:0:94190:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000100:00080000:1.0:1783144409.916264:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1783144409.916843:0:94190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783144409.916873:0:94190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:2.0:1783144409.916980:0:94190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000004:00080000:0.0:1783144409.917028:0:94178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1783144409.917671:0:94198:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:0.0:1783144409.917677:0:94198:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783144409.917826:0:94198:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:0.0:1783144409.918072:0:94198:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783144409.918200:0:94198:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:0.0:1783144409.918204:0:94198:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783144409.918264:0:94190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783144409.918287:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783144409.918321:0:94190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783144409.918341:0:94190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a42304903a 00000100:00080000:2.0:1783144409.918350:0:94190:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783144409.918361:0:94190:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c29c5a41800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144409.918397:0:94190:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c60ead80 x1869759501390720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144409.918426:0:94190:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783144409.918476:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144409.918480:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.918482:0:94190:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783144409.918484:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144409.918488:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.918489:0:94190:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783144409.918491:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783144409.918493:0:94190:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783144409.918495:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144409.918497:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.918498:0:94190:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783144409.918501:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144409.918503:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.918504:0:94190:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783144409.918507:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783144409.918511:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144409.918523:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.918524:0:94190:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1783144409.918526:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144409.918530:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.918531:0:94190:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1783144409.918534:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1783144409.918578:0:94190:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1783144409.918624:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501390720:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783144409.918691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.918858:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390720 00000100:00100000:0.0:1783144409.918866:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390720 00000100:00100000:0.0:1783144409.918905:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4981 00000100:00100000:0.0:1783144409.918914:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3647:x1869759501390720:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783144409.918940:0:26139:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2944 last 0 00000020:00000080:0.0:1783144409.918968:0:26139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad8e53a423049041 00002000:00100000:0.0:1783144409.918980:0:26139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2ac9d61800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:2.0:1783144409.918986:0:94190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94190:1869759501390848:0@lo:502:llog_process_th.0 00002000:00080000:0.0:1783144409.918987:0:26139:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783144409.918992:0:26139:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783144409.919036:0:94190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1783144409.919049:0:26139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1783144409.919065:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390848 00000100:00100000:2.0:1783144409.919069:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390848 00000100:00080000:0.0:1783144409.919072:0:26139:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d62000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783144409.919095:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783144409.919109:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94190:x1869759501390848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144409.919125:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3647:x1869759501390720:12345-0@lo:8:llog_process_th.0 Request processed in 210us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.919133:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4981 00000100:00100000:2.0:1783144409.919180:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94190:x1869759501390848:12345-0@lo:502:llog_process_th.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.919186:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783144409.919217:0:94190:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ecd900 going to sleep for 11 seconds 00000100:00100000:2.0:1783144409.919234:0:94190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94190:1869759501390848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144409.919253:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144409.919257:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.919258:0:94190:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:2.0:1783144409.919261:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144409.919265:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144409.919266:0:94190:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1783144409.919269:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1783144409.919277:0:94190:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1783144409.919431:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783144409.919438:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783144409.919444:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783144409.919450:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783144409.919462:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a41800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783144409.919472:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783144409.919477:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501390720:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1783144409.919495:0:94198:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783144409.919545:0:94198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2944272822605ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783144409.919552:0:94198:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783144409.919576:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144409.919588:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501390976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144409.919623:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144409.919656:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501390976 00000100:00100000:1.0:1783144409.919659:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501390976 00000100:00100000:1.0:1783144409.919701:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:1.0:1783144409.919708:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501390976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783144409.919751:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144409.919790:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501390976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.919796:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00080000:1.0:1783144409.919818:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144409.919839:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501390976:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783144409.920773:0:94178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783144409.921792:0:94190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94190:1869759501391104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144409.921860:0:94190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144409.921895:0:94190:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ecd900 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.921990:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501391104 00000100:00100000:0.0:1783144409.921996:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501391104 00000100:00100000:0.0:1783144409.922039:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783144409.922047:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94190:x1869759501391104:12345-0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783144409.922134:0:94200:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c5808800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783144409.922138:0:94200:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c29c5808800 4 00000100:00100000:0.0:1783144409.922150:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94190:x1869759501391104:12345-0@lo:502:llog_process_th.0 Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.922164:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783144409.922215:0:94190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94190:1869759501391104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783144409.922244:0:94190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783144409.922251:0:94190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144409.922253:0:94190:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783144409.922258:0:94190:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1783144409.922350:0:94177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:3.0:1783144409.922373:0:94177:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783144409.922494:0:94177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.922528:0:94177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144409.922535:0:94177:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c29c5808800 from 1 10000000:01000000:3.0:1783144409.922537:0:94177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144409.922561:0:94177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.922568:0:94177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.922576:0:94177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.922587:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144409.922613:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.922637:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.922711:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501391232 00000100:00100000:0.0:1783144409.922716:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501391232 00000100:00100000:0.0:1783144409.922767:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783144409.922774:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+8:94177:x1869759501391232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144409.922938:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144409.922951:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049048 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.922998:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049048 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.923005:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049048 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.923011:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6f000, rc 0) 00000100:00100000:0.0:1783144409.923040:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:94177:x1869759501391232:12345-0@lo:101:mount.lustre.0 Request processed in 266us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.923046:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783144409.923063:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144409.923075:0:94177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.923084:0:94177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.923579:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391360:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783144409.923615:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.923646:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.923698:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501391360 00000100:00100000:0.0:1783144409.923702:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501391360 00000100:00100000:0.0:1783144409.923768:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783144409.923775:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:94177:x1869759501391360:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783144409.924001:0:94189:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783144409.924018:0:94189:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783144409.924021:0:94189:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783144409.924024:0:94189:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783144409.924026:0:94189:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:0.0:1783144409.924106:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:94177:x1869759501391360:12345-0@lo:256:mount.lustre.0 Request processed in 332us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.924113:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783144409.924178:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391360:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783144409.924885:0:94177:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144409.924947:0:94177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.924955:0:94177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144409.924960:0:94177:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c29c5808800 from 1 10000000:01000000:3.0:1783144409.924962:0:94177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144409.924980:0:94177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.924985:0:94177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.924991:0:94177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.925002:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783144409.925025:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.925050:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144409.925069:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501391488 00000100:00100000:1.0:1783144409.925074:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501391488 00000100:00100000:1.0:1783144409.925101:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783144409.925109:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:94177:x1869759501391488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783144409.925118:0:94185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144409.925129:0:94185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1800/0xad8e53a42304905d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049056 expref: -99 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.925146:0:94185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1800/0xad8e53a42304905d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049056 expref: 10 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.925155:0:94185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1800/0xad8e53a42304905d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049056 expref: 10 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144409.925488:0:94185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1800, rc 0) 00000100:00100000:3.0:1783144409.925611:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783144409.925611:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501391488:12345-0@lo:101:mount.lustre.0 Request processed in 502us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.925617:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1783144409.925623:0:94177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304905d expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.925631:0:94177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304905d expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.925846:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144409.925873:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.925900:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.926027:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501391616 00000100:00100000:0.0:1783144409.926031:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501391616 00000100:00100000:0.0:1783144409.926063:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783144409.926071:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501391616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144409.926224:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501391616:12345-0@lo:501:mount.lustre.0 Request processed in 153us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.926231:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783144409.926359:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783144409.926392:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783144409.926432:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.926481:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.926525:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501391744 00000100:00100000:0.0:1783144409.926529:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501391744 00000100:00100000:0.0:1783144409.926560:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783144409.926567:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501391744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144409.926688:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501391744:12345-0@lo:503:mount.lustre.0 Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.926696:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783144409.926826:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501391744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144409.927604:0:94201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94201:1869759501391872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144409.927648:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144409.927746:0:94201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144409.928040:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501391872 00000100:00100000:2.0:1783144409.928045:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501391872 00000100:00100000:2.0:1783144409.928116:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783144409.928126:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94201:x1869759501391872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144409.928533:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94201:x1869759501391872:12345-0@lo:502:llog_process_th.0 Request processed in 409us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.928541:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783144409.928609:0:94201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94201:1869759501391872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144409.928636:0:94201:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144409.928645:0:94201:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144409.928647:0:94201:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783144409.928655:0:94201:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c29c5808800 00000020:00000080:1.0:1783144409.928658:0:94201:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783144409.928665:0:94201:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144409.928678:0:94201:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144409.928679:0:94201:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783144409.928682:0:94201:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144409.928684:0:94201:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144409.928686:0:94201:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783144409.928689:0:94201:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c29c5808800 00000020:00000080:1.0:1783144409.928691:0:94201:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783144409.928780:0:94201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94201:1869759501392000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144409.928837:0:94201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.928856:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392000 00000100:00100000:0.0:1783144409.928864:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392000 00000100:00100000:1.0:1783144409.928873:0:94201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.928905:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783144409.928916:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94201:x1869759501392000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144409.929003:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94201:x1869759501392000:12345-0@lo:502:llog_process_th.0 Request processed in 90us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.929016:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783144409.930122:0:94201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94201:1869759501392000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144409.930146:0:94201:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144409.930156:0:94201:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144409.930158:0:94201:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783144409.930161:0:94201:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783144409.930251:0:94177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1783144409.930278:0:94177:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783144409.930299:0:94177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304905d expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.930311:0:94177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304905d expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144409.930364:0:94177:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783144409.930367:0:94177:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c29c5808800 10000000:01000000:0.0:1783144409.930370:0:94177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c29c5808800 10000000:01000000:0.0:1783144409.930374:0:94177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783144409.930393:0:94177:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c29c5808800 from 1 10000000:01000000:0.0:1783144409.930395:0:94177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783144409.930430:0:94177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.930440:0:94177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.930449:0:94177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144409.930466:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501392128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783144409.930532:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.930563:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144409.930890:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392128 00000100:00100000:3.0:1783144409.930896:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392128 00000100:00100000:3.0:1783144409.931068:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783144409.931076:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:94177:x1869759501392128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144409.931088:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144409.931099:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049064 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.931119:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049064 expref: 11 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.931126:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049064 expref: 11 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.931132:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01400, rc 0) 00000100:00100000:3.0:1783144409.931163:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94177:x1869759501392128:12345-0@lo:101:mount.lustre.0 Request processed in 89us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.931175:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783144409.931270:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501392128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783144409.931283:0:94177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.931298:0:94177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144409.931352:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501392256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144409.931380:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.931404:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144409.931411:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392256 00000100:00100000:1.0:1783144409.931416:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392256 00000100:00100000:1.0:1783144409.931453:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783144409.931461:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94177:x1869759501392256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783144409.931588:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94177:x1869759501392256:12345-0@lo:501:mount.lustre.0 Request processed in 127us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.931594:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783144409.932323:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501392256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783144409.932354:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501392384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783144409.932391:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.932409:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144409.932466:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392384 00000100:00100000:1.0:1783144409.932471:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392384 00000100:00100000:1.0:1783144409.932521:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783144409.932529:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94177:x1869759501392384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144409.932622:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94177:x1869759501392384:12345-0@lo:503:mount.lustre.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.932627:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501392384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783144409.932633:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783144409.933254:0:94203:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94203:1869759501392512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144409.933292:0:94203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.933396:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392512 00000100:00100000:3.0:1783144409.933402:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392512 00000100:00100000:1.0:1783144409.933402:0:94203:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2711780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144409.933482:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783144409.933491:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94203:x1869759501392512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144409.933971:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94203:x1869759501392512:12345-0@lo:502:llog_process_th.0 Request processed in 481us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.933979:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783144409.934076:0:94203:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94203:1869759501392512:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783144409.934132:0:94203:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783144409.934145:0:94203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c29c4ae99c0) 00000020:00000080:1.0:1783144409.934170:0:94203:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783144409.934325:0:94203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c5808800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783144409.934329:0:94203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c29c5808800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783144409.934332:0:94203:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c29c5808800 4 00010000:00080000:1.0:1783144409.934366:0:94203:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ad085c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144409.936177:0:94203:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1783144409.936283:0:94203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783144409.936321:0:94203:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783144409.936332:0:94203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad8e53a423049079 00000100:00080000:1.0:1783144409.936341:0:94203:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783144409.936347:0:94203:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ad085c000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144409.936376:0:94203:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2aee581f80 x1869759501392640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783144409.936394:0:94203:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783144409.936568:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501392640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783144409.936623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.936672:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392640 00000100:00100000:3.0:1783144409.936679:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392640 00000100:00100000:3.0:1783144409.936704:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1783144409.936711:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501392640:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783144409.936929:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501392640:12345-0@lo:38:llog_process_th.0 Request processed in 70us (159us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783144409.936938:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1783144409.936974:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783144409.936981:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ad085c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783144409.936985:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783144409.936988:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501392640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783144409.937964:0:94203:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94203:1869759501392768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144409.938006:0:94203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.938031:0:94203:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144409.938044:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392768 00000100:00100000:3.0:1783144409.938047:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392768 00000100:00100000:3.0:1783144409.938080:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783144409.938085:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94203:x1869759501392768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144409.938163:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94203:x1869759501392768:12345-0@lo:502:llog_process_th.0 Request processed in 78us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.938168:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783144409.938198:0:94203:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94203:1869759501392768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144409.938222:0:94203:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94203:1869759501392896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144409.938242:0:94203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.938292:0:94203:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca3d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144409.938321:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501392896 00000100:00100000:0.0:1783144409.938324:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501392896 00000100:00100000:0.0:1783144409.938350:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783144409.938355:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94203:x1869759501392896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144409.938463:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94203:x1869759501392896:12345-0@lo:502:llog_process_th.0 Request processed in 106us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.938471:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783144409.938537:0:94203:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94203:1869759501392896:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783144409.938558:0:94203:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1783144409.938689:0:94177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:0.0:1783144409.938711:0:94177:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144409.938847:0:94177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.938858:0:94177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783144409.938916:0:94177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783144409.938919:0:94177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144409.938920:0:94177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.938922:0:94177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144409.938923:0:94177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.938925:0:94177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.938926:0:94177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144409.938928:0:94177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144409.938930:0:94177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.938932:0:94177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783144409.938936:0:94177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783144409.938939:0:94177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783144409.938941:0:94177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144409.938942:0:94177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.938943:0:94177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144409.938945:0:94177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.938946:0:94177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.938948:0:94177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144409.938949:0:94177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144409.938950:0:94177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.938952:0:94177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783144409.938966:0:94177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783144409.938975:0:94177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501393024:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783144409.939007:0:94177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.939063:0:94177:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cf840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144409.939116:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393024 00000100:00100000:3.0:1783144409.939120:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393024 00000100:00100000:3.0:1783144409.939155:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783144409.939163:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94177:x1869759501393024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783144409.939180:0:94184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783144409.939193:0:94184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783144409.942546:0:94184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783144409.942567:0:94184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783144409.942964:0:94186:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783144409.942970:0:94186:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783144409.942989:0:94186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943013:0:94186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049048 expref: 11 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943023:0:94186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943057:0:94186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423049048 expref: 11 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943074:0:94186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423049048 expref: 11 pid: 94188 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144409.943088:0:94186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501393152:0@lo:104: 00000100:00100000:2.0:1783144409.943125:0:94186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.943172:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:94177:x1869759501393024:12345-0@lo:253:mount.lustre.0 Request processed in 4007us (4161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.943183:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783144409.943282:0:94186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9ee2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144409.943309:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393152 00000100:00100000:2.0:1783144409.943315:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393152 00000100:00100000:2.0:1783144409.943351:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1783144409.943360:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:94186:x1869759501393152:12345-0@lo:104: 00010000:00010000:2.0:1783144409.943371:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943463:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783144409.943471:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:94186:x1869759501393152:12345-0@lo:104: Request processed in 112us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144409.943478:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00010000:2.0:1783144409.943500:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144409.943505:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943529:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144409.943534:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943543:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144409.943551:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144409.943557:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144409.943594:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943601:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144409.943620:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943627:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a423049048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304904f expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144409.943648:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144409.943650:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144409.943653:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144409.943660:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783144409.943672:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501393280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144409.943707:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.944691:0:94177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:94177:1869759501393024:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783144409.944705:0:94177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783144409.944708:0:94177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783144409.944710:0:94177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783144409.944712:0:94177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144409.944713:0:94177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144409.944715:0:94177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144409.944716:0:94177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144409.944718:0:94177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783144409.944734:0:94177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783144409.944742:0:94177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144409.944744:0:94177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783144409.944760:0:94177:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783144409.944798:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393280 00000100:00100000:0.0:1783144409.944803:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393280 00010000:00010000:0.0:1783144409.944960:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049048 expref: 11 pid: 94188 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144409.944992:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1783144409.945003:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3650:x1869759501393280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144409.945014:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144409.945020:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049048 expref: 11 pid: 94188 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945031:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423049048 expref: 11 pid: 94188 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945046:0:26153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945054:0:26153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783144409.945069:0:26153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002100037s 00010000:00010000:0.0:1783144409.945074:0:26153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945082:0:26153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945089:0:26153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945107:0:26153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945112:0:26153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144409.945116:0:26153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945125:0:26153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945135:0:26153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144409.945145:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144409.945194:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:3650:x1869759501393280:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144409.945202:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1783144409.946707:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501393280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144409.948847:0:94186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6f000/0xad8e53a42304904f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423049048 expref: 10 pid: 94188 timeout: 3044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144409.948877:0:94186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501393152:0@lo:104: 00010000:00010000:3.0:1783144409.948900:0:94186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.948910:0:94186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.948916:0:94186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144409.948924:0:94186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517800/0xad8e53a423049080 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783144409.954522:0:94177:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:0.0:1783144409.955030:0:94177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783144409.955187:0:94209:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:1.0:1783144409.955190:0:94209:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:3.0:1783144409.955381:0:94210:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783144409.955560:0:94177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783144409.956016:0:94210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783144409.958123:0:94211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94211:1869759501393408:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783144409.958146:0:94210:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1783144409.958189:0:94211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783144409.958211:0:94210:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1783144409.958217:0:94211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783144409.958536:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393408 00000100:00100000:1.0:1783144409.958543:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393408 00000100:00100000:1.0:1783144409.958592:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:1.0:1783144409.958603:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94211:x1869759501393408:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783144409.958650:0:94177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783144409.958690:0:94177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783144409.958695:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94211:x1869759501393408:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.958704:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1783144409.958780:0:94211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94211:1869759501393408:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1783144409.958878:0:94211:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783144409.958904:0:94211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94211:1869759501393536:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144409.958947:0:94211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144409.959174:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393536 00000100:00100000:3.0:1783144409.959179:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393536 00000100:00100000:0.0:1783144409.959180:0:94211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144409.959210:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:3.0:1783144409.959218:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94211:x1869759501393536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783144409.959313:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94211:x1869759501393536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144409.959319:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1783144409.959605:0:94211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94211:1869759501393536:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783144409.959669:0:94211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94211:1869759501393664:0@lo:1000:lod0000_rec0001.0 00000004:00000080:2.0:1783144409.959685:0:94177:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783144409.959692:0:94177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:0.0:1783144409.959692:0:94211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144409.959715:0:94211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2799f00 going to sleep for 11 seconds 00000040:00080000:2.0:1783144409.959746:0:94177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783144409.959789:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393664 00000100:00100000:1.0:1783144409.959793:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393664 00000100:00100000:1.0:1783144409.959815:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1783144409.959822:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94211:x1869759501393664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783144409.959948:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94211:x1869759501393664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144409.959955:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:0.0:1783144409.960070:0:94211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af563ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94211:1869759501393664:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1783144409.960103:0:94211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783144409.961168:0:94177:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783144409.961942:0:94177:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783144409.961972:0:94177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783144409.962054:0:94177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783144409.962481:0:94177:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000040:00080000:0.0:1783144409.963550:0:94211:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783144409.963601:0:94211:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783144409.963606:0:94211:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1783144409.964239:0:94177:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964117002 00010000:00080000:0.0:1783144409.965037:0:94212:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94212 00010000:02000000:0.0:1783144409.965084:0:94212:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1783144409.965088:0:94212:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783144409.965092:0:94212:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783144409.965159:0:94177:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783144409.965173:0:94177:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783144409.965194:0:94177:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783144409.965207:0:94177:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783144409.966242:0:94177:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144409.966494:0:94177:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783144410.061891:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144411.086600:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144411.235303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144411.235355:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481715840 00000100:00100000:3.0:1783144411.235365:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481715840 00000100:00100000:3.0:1783144411.235523:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1294 00000100:00100000:3.0:1783144411.235533:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1869759481715840:12345-192.168.203.4@tcp:38:kworker.0 00010000:00080000:3.0:1783144411.235571:0:66947:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef' at ffff9c2aefa79000, cookie 0xad8e53a423048fd8 00010000:00080000:3.0:1783144411.235577:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp recovering/t115964117003 exp ffff9c2aefa79000 cur 2945 last 1783144409 00010000:02000400:3.0:1783144411.235586:0:66947:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1783144411.235592:0:66947:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1783144411.235611:0:66947:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783144411.236039:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2aefddc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144411.236059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144411.236106:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481715840:12345-192.168.203.4@tcp:38:kworker.0 Request processed in 571us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144411.236110:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481715712 00000100:00100000:1.0:1783144411.236116:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481715712 00000100:00100000:3.0:1783144411.236118:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1294 00000100:00100000:1.0:1783144411.236148:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1783144411.236155:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1869759481715712:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:1.0:1783144411.236162:0:94183:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:1.0:1783144411.236243:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1869759481715712:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 86us (184us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144411.236251:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1783144411.236324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144411.236352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144411.236381:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144411.236405:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716096 00000100:00100000:0.0:1783144411.236409:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716096 00000100:00100000:0.0:1783144411.236446:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716224 00000100:00100000:0.0:1783144411.236450:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716224 00000100:00100000:0.0:1783144411.236477:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2086 00000100:00100000:0.0:1783144411.236487:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481716224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144411.236539:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481716224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.236543:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4982 00000100:00100000:0.0:1783144411.236553:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2086 00000100:00100000:2.0:1783144411.236558:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2402:x1869759481716096:12345-192.168.203.4@tcp:9:kworker.0 00000100:00080000:0.0:1783144411.236652:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144411.236653:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481715968 00000100:00080000:0.0:1783144411.236657:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144411.236659:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481715968 00000020:00000080:2.0:1783144411.236682:0:26149:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423048e2d 00000100:00080000:0.0:1783144411.236687:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144411.236693:0:26149:0:(import.c:65:import_set_state_nolock()) ffff9c2ac9d65000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783144411.236710:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 861 00000100:00100000:3.0:1783144411.236748:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2403:x1869759481715968:12345-192.168.203.4@tcp:400:kworker.0 00000001:00000004:2.0:1783144411.236767:0:26149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968829 00000100:00100000:3.0:1783144411.236802:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2403:x1869759481715968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.236811:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 861 00000100:00100000:2.0:1783144411.236879:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+2:2402:x1869759481716096:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 324us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.236887:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4982 00010000:00010000:0.0:1783144411.237197:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144411.243993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144411.244073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144411.244105:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709440 00000100:00100000:0.0:1783144411.244113:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709440 00000100:00100000:0.0:1783144411.244160:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1295 00000100:00100000:0.0:1783144411.244170:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481709440:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00080000:0.0:1783144411.244187:0:66143:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 115964117003, current: 115964117003, replaying 00000100:00100000:0.0:1783144411.244200:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481709440:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 33us (127us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144411.244207:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1295 00010000:00080000:0.0:1783144411.244223:0:94212:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1783144411.244254:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716352 00000100:00100000:3.0:1783144411.244260:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716352 00000100:00100000:3.0:1783144411.244292:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:3.0:1783144411.244298:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2402:x1869759481716352:12345-192.168.203.4@tcp:250:ptlrpcd_00_00.0 00010000:00080000:3.0:1783144411.244321:0:94188:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp t0 exp 0000000000000000 cur 2945 last 0 00000020:00000080:3.0:1783144411.244354:0:94188:0:(genops.c:1406:class_connect()) connect: client a1ed6386-b53d-4b75-b3e0-82656a667de7, cookie 0xad8e53a423049087 00000100:00080000:3.0:1783144411.244473:0:94188:0:(import.c:65:import_set_state_nolock()) ffff9c2aefddf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144411.244590:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+5:2402:x1869759481716352:12345-192.168.203.4@tcp:250:ptlrpcd_00_00.0 Request processed in 290us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.244606:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 10000000:01000000:3.0:1783144411.534686:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783144411.534692:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c29c5808800 from 124 10000000:01000000:3.0:1783144411.534696:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144411.534747:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.534758:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.534768:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.534791:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501393792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.534848:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.534882:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144411.534934:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393792 00000100:00100000:0.0:1783144411.534941:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393792 00000100:00100000:0.0:1783144411.534995:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783144411.535004:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:6518:x1869759501393792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.535016:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144411.535042:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304908e expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.535063:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304908e expref: 11 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.535078:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304908e expref: 11 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.535099:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6fa00, rc 0) 00000100:00100000:0.0:1783144411.535139:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501393792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144411.535147:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783144411.535303:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501393792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.535318:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.535325:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.535363:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501393920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.535388:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.535413:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144411.535477:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501393920 00000100:00100000:0.0:1783144411.535481:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501393920 00000100:00100000:0.0:1783144411.535519:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783144411.535527:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501393920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783144411.535539:0:94183:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783144411.535560:0:94183:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783144411.535563:0:94183:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:0.0:1783144411.535646:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501393920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144411.535654:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783144411.536373:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501393920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783144411.536424:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144411.536431:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.536438:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144411.536446:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144411.536447:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 58 10000000:01000000:3.0:1783144411.536449:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144411.536462:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.536469:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.536476:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.536488:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.536525:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.536551:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96000 going to sleep for 11 seconds 00000100:00100000:0.0:1783144411.536590:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394048 00000100:00100000:0.0:1783144411.536595:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394048 00000100:00100000:0.0:1783144411.536648:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783144411.536656:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:6518:x1869759501394048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.536663:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144411.536671:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304909c expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.536686:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304909c expref: 12 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.536694:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304909c expref: 12 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.536707:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6fc00, rc 0) 00000100:00100000:0.0:1783144411.536742:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501394048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144411.536746:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783144411.536816:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.536827:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.536836:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.536896:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.536921:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.536939:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96000 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.536948:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394176 00000100:00100000:3.0:1783144411.536951:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394176 00000100:00100000:3.0:1783144411.536970:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783144411.536974:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501394176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.537085:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501394176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.537091:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783144411.537119:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.537148:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.537185:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.537200:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff96000 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.537213:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394304 00000100:00100000:3.0:1783144411.537216:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394304 00000100:00100000:3.0:1783144411.537237:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783144411.537244:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501394304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.537321:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501394304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.537327:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783144411.537364:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144411.538027:0:94402:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1783144411.538085:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1783144411.538105:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783144411.538112:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538121:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144411.538129:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783144411.538131:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2ac91e0000 from 121 10000000:01000000:3.0:1783144411.538133:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783144411.538150:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538157:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538165:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.538179:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.538208:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.538224:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.538237:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394432 00000100:00100000:3.0:1783144411.538240:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394432 00000100:00100000:3.0:1783144411.538264:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783144411.538272:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+12:6518:x1869759501394432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.538280:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144411.538290:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230490aa expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538318:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230490aa expref: 13 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538327:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490aa expref: 13 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538335:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00200, rc 0) 00000100:00100000:3.0:1783144411.538363:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501394432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.538370:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783144411.538401:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.538420:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538428:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.538471:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.538517:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.538546:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afff963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.538559:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394560 00000100:00100000:3.0:1783144411.538562:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394560 00000100:00100000:3.0:1783144411.538595:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783144411.538602:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501394560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783144411.538613:0:94184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783144411.538627:0:94184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783144411.538637:0:94184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783144411.538640:0:94184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783144411.538643:0:94184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783144411.538645:0:94184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:3.0:1783144411.538711:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501394560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.538719:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783144411.538768:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783144411.538844:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783144411.538851:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538859:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144411.538867:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783144411.538869:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1783144411.538871:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783144411.538886:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538893:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.538900:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.538912:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.538935:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.538958:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01574240 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.538970:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394688 00000100:00100000:3.0:1783144411.538974:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394688 00000100:00100000:3.0:1783144411.538999:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783144411.539006:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+13:6518:x1869759501394688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.539014:0:94185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144411.539022:0:94185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230490b8 expref: -99 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.539037:0:94185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 14 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.539044:0:94185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 14 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.539051:0:94185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01600, rc 0) 00000100:00100000:3.0:1783144411.539080:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501394688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.539086:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783144411.539118:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.539128:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.539135:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.539181:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.539206:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.539224:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01574240 going to sleep for 11 seconds 00000100:00100000:0.0:1783144411.539420:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394816 00000100:00100000:0.0:1783144411.539433:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394816 00000100:00100000:0.0:1783144411.539492:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783144411.539513:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501394816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.539770:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501394816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144411.539777:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783144411.540014:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.540054:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.540102:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.540142:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501394944 00000100:00100000:0.0:1783144411.540148:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501394944 00000100:00100000:3.0:1783144411.540158:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01574240 going to sleep for 11 seconds 00000100:00100000:0.0:1783144411.540183:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783144411.540190:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501394944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.540332:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501394944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144411.540340:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783144411.540422:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501394944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144411.542109:0:94404:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:0.0:1783144411.542399:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:0.0:1783144411.542451:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783144411.542466:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.542476:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.542496:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1783144411.542499:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9c2ac91e0000 from 1 10000000:01000000:0.0:1783144411.542511:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783144411.542553:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a4230490c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.542562:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a4230490c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.542572:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a4230490c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.542599:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.542714:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.542850:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac3975f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.543356:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395072 00000100:00100000:3.0:1783144411.543365:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395072 00000100:00100000:2.0:1783144411.543461:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783144411.543471:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+14:6518:x1869759501395072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.543487:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144411.543515:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517600/0xad8e53a4230490cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230490c6 expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.543549:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517600/0xad8e53a4230490cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230490c6 expref: 15 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.543559:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517600/0xad8e53a4230490cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490c6 expref: 15 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.543567:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517600, rc 0) 00000100:00100000:2.0:1783144411.543641:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501395072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.543649:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783144411.543783:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.543906:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a4230490c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490cd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.543917:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a4230490c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490cd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.543936:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783144411.543941:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a4230490c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490cd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.543949:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6ea00/0xad8e53a4230490c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490cd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.543968:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783144411.543970:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2ac91e0000 from 7 10000000:01000000:0.0:1783144411.543973:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783144411.543996:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.544003:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.544011:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.544028:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.544061:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.545066:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac3975f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.545392:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395200 00000100:00100000:2.0:1783144411.545397:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395200 00000100:00100000:2.0:1783144411.545433:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783144411.545444:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501395200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.545454:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144411.545474:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516e00/0xad8e53a4230490db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230490d4 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.545491:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516e00/0xad8e53a4230490db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230490d4 expref: 16 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.545499:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516e00/0xad8e53a4230490db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490d4 expref: 16 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.545514:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516e00, rc 0) 00000100:00100000:2.0:1783144411.545558:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501395200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.545566:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783144411.545650:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.545663:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490db expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.545671:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490db expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.545854:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.545882:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.545909:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac3975f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.545922:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395328 00000100:00100000:3.0:1783144411.545929:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395328 00000100:00100000:3.0:1783144411.545962:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783144411.545970:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501395328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.546089:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501395328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.546099:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783144411.546113:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.546153:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.546207:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.546257:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac3975f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.546287:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395456 00000100:00100000:2.0:1783144411.546291:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395456 00000100:00100000:2.0:1783144411.546344:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783144411.546352:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501395456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.546432:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501395456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.546439:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783144411.546462:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783144411.547340:0:94407:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783144411.547532:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783144411.547552:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783144411.547559:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490db expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.547568:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490db expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.547576:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783144411.547578:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 58 10000000:01000000:0.0:1783144411.547581:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783144411.547599:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.547603:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.547608:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.547617:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.547639:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.547656:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.547669:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395584 00000100:00100000:2.0:1783144411.547675:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395584 00000100:00100000:2.0:1783144411.547707:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783144411.547714:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501395584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.547862:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144411.547882:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230490e2 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.547899:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 17 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.547907:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 17 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.547914:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517800, rc 0) 00000100:00100000:2.0:1783144411.547954:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501395584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.547961:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783144411.548232:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.548244:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.548263:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.548296:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.548321:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.548352:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.548362:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395712 00000100:00100000:3.0:1783144411.548368:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395712 00000100:00100000:3.0:1783144411.548401:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783144411.548407:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501395712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.548484:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501395712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.548489:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783144411.548526:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.548554:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.548587:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.548605:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.548623:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395840 00000100:00100000:2.0:1783144411.548628:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395840 00000100:00100000:2.0:1783144411.548654:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783144411.548660:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501395840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.548768:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501395840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.548776:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783144411.548788:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144411.549477:0:94408:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1783144411.549619:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1783144411.549633:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144411.549637:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.549643:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.549648:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783144411.549650:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1783144411.549651:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783144411.549664:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.549668:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.549679:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.549688:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.549712:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.549759:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738780 going to sleep for 11 seconds 00000100:00100000:1.0:1783144411.549777:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501395968 00000100:00100000:1.0:1783144411.549783:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501395968 00000100:00100000:1.0:1783144411.549819:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783144411.549828:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501395968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144411.549840:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144411.549850:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230490f0 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144411.549866:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 18 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144411.549875:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 18 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144411.549883:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1600, rc 0) 00000100:00100000:1.0:1783144411.549921:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501395968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144411.549928:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783144411.549945:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501395968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.549956:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.549962:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.549992:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.550012:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.550028:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738780 going to sleep for 11 seconds 00000100:00100000:1.0:1783144411.551153:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396096 00000100:00100000:1.0:1783144411.551159:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396096 00000100:00100000:1.0:1783144411.551196:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783144411.551205:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501396096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144411.551323:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501396096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144411.551332:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783144411.551336:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.551366:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.551395:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.551410:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.551634:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396224 00000100:00100000:2.0:1783144411.551638:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396224 00000100:00100000:2.0:1783144411.551665:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783144411.551672:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501396224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.552692:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501396224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1019us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.552700:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783144411.552873:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144411.553888:0:94411:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783144411.554012:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783144411.554031:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783144411.554040:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.554055:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.554063:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783144411.554065:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2b017f2000 from 7 10000000:01000000:0.0:1783144411.554068:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783144411.554090:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.554097:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.554105:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.554120:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.554152:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.554219:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.554283:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396352 00000100:00100000:2.0:1783144411.554288:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396352 00000100:00100000:3.0:1783144411.554821:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783144411.554837:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501396352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.554847:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144411.554858:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423049105 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230490fe expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.554876:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423049105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230490fe expref: 19 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.554884:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423049105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490fe expref: 19 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.554891:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01a00, rc 0) 00000100:00100000:3.0:1783144411.554977:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501396352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.554984:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783144411.555248:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.555262:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049105 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.555271:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049105 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144411.555315:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.555341:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144411.555368:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa8349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.556561:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396480 00000100:00100000:3.0:1783144411.556567:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396480 00000100:00100000:3.0:1783144411.556600:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783144411.556609:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501396480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.556705:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501396480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.556713:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783144411.556875:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.556905:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.557418:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144411.557447:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa8349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.557533:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396608 00000100:00100000:3.0:1783144411.557538:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396608 00000100:00100000:3.0:1783144411.557566:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783144411.557574:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501396608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.557652:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501396608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.557662:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.557668:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000040:00080000:3.0:1783144411.559014:0:94414:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783144411.559077:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783144411.559103:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783144411.559112:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049105 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.559122:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049105 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144411.559130:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144411.559133:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 58 10000000:01000000:2.0:1783144411.559136:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144411.559158:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.559166:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.559260:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144411.559278:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.559317:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144411.559357:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa834840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.559533:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396736 00000100:00100000:3.0:1783144411.559539:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396736 00000100:00100000:3.0:1783144411.559570:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783144411.559580:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501396736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.559590:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144411.559601:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304910c expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.559620:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304910c expref: 20 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.559629:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304910c expref: 20 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.559636:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00400, rc 0) 00000100:00100000:3.0:1783144411.559669:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501396736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.559676:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783144411.559681:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.559695:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.559711:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144411.559897:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.559926:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144411.559960:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa834840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.560367:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396864 00000100:00100000:3.0:1783144411.560372:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396864 00000100:00100000:3.0:1783144411.560405:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783144411.560412:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501396864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.560511:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501396864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.560520:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783144411.560534:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.560565:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.560604:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.560623:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144411.560634:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501396992 00000100:00100000:3.0:1783144411.560639:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501396992 00000100:00100000:3.0:1783144411.560669:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783144411.560676:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501396992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.560768:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501396992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.560776:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783144411.560853:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501396992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144411.561493:0:94415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1783144411.561847:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1783144411.561870:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144411.561878:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.561888:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144411.561897:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783144411.561899:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783144411.561902:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783144411.561921:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.561929:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.561937:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144411.561950:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.561980:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144411.562022:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa834c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144411.562027:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501397120 00000100:00100000:0.0:1783144411.562034:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501397120 00000100:00100000:0.0:1783144411.562070:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783144411.562078:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501397120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.562086:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144411.562096:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304911a expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.562111:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304911a expref: 21 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.562120:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304911a expref: 21 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.562128:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af9f6f200, rc 0) 00000100:00100000:0.0:1783144411.562165:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501397120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144411.562171:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783144411.562194:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.562206:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.562215:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144411.562259:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.562284:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144411.562297:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa834c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.562308:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501397248 00000100:00100000:2.0:1783144411.562311:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501397248 00000100:00100000:2.0:1783144411.562333:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783144411.562339:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501397248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.562450:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501397248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.562457:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783144411.562472:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.562517:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.562554:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.562575:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af0738240 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.562592:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501397376 00000100:00100000:2.0:1783144411.562597:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501397376 00000100:00100000:2.0:1783144411.562633:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783144411.562641:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501397376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.563341:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501397376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 700us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144411.563351:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783144411.563377:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783144411.564066:0:94416:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783144411.564126:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783144411.564150:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783144411.564157:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.564165:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144411.564173:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783144411.564175:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c2afaac8800 from 7 10000000:01000000:3.0:1783144411.564178:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783144411.564195:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.564202:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.564209:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.564234:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.564263:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.564290:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac53f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.564301:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501397504 00000100:00100000:2.0:1783144411.564307:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501397504 00000100:00100000:2.0:1783144411.564341:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783144411.564356:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501397504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.564419:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144411.564431:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516a00/0xad8e53a42304912f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049128 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.564448:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516a00/0xad8e53a42304912f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049128 expref: 22 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.564456:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516a00/0xad8e53a42304912f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049128 expref: 22 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.564463:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516a00, rc 0) 00000100:00100000:2.0:1783144411.564512:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501397504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.564519:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783144411.564542:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144411.564554:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144411.564562:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144411.564608:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.564633:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.564653:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac53f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.564657:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501397632 00000100:00100000:2.0:1783144411.564663:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501397632 00000100:00100000:2.0:1783144411.564699:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783144411.564708:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501397632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.564861:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501397632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.564869:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783144411.565535:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.565559:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144411.565587:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144411.565606:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac53f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.565625:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501397760 00000100:00100000:2.0:1783144411.565630:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501397760 00000100:00100000:2.0:1783144411.565667:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783144411.565675:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501397760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.566389:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501397760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 713us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144411.566394:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.566409:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000040:00080000:2.0:1783144411.567170:0:94420:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783144411.567276:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783144411.567297:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783144411.567304:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.567313:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.567326:0:6518:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783144411.567329:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144411.567331:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783144411.567350:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e800/0xad8e53a423049136 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.567357:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e800/0xad8e53a423049136 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.567364:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e800/0xad8e53a423049136 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.567376:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.567406:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.567429:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.567569:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501397888 00000100:00100000:2.0:1783144411.567574:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501397888 00000100:00100000:2.0:1783144411.567607:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783144411.567615:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501397888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.567624:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144411.567636:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516400/0xad8e53a42304913d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049136 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.567653:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516400/0xad8e53a42304913d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049136 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.567662:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516400/0xad8e53a42304913d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049136 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.567669:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516400, rc 0) 00000100:00100000:2.0:1783144411.567701:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501397888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.567708:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783144411.567716:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501397888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.567784:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e800/0xad8e53a423049136 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304913d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.567793:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e800/0xad8e53a423049136 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304913d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.567807:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783144411.567810:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e800/0xad8e53a423049136 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304913d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.567816:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e800/0xad8e53a423049136 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304913d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144411.567832:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783144411.567834:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144411.567835:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783144411.567848:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.567855:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.567861:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.567884:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501398016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.567907:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.567923:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.567944:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398016 00000100:00100000:2.0:1783144411.567949:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398016 00000100:00100000:2.0:1783144411.567979:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783144411.567985:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501398016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144411.567992:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144411.568000:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049144 expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.568025:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049144 expref: 24 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.568033:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049144 expref: 24 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144411.568040:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516c00, rc 0) 00000100:00100000:2.0:1783144411.568069:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501398016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144411.568077:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783144411.568085:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501398016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144411.568099:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.568105:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144411.568136:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501398144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144411.568152:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144411.568166:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144411.568191:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398144 00000100:00100000:2.0:1783144411.568196:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398144 00000100:00100000:2.0:1783144411.568312:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783144411.568323:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501398144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144411.568393:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501398144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (237us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144411.568401:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783144411.568404:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4ea7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501398144:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783144411.568434:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783144411.568442:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144411.568447:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1783144411.810470:0:94462:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783144412.111143:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783144412.243853:0:94514:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144412.244058:0:94514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783144412.580168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144412.580400:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716480 00000100:00100000:2.0:1783144412.580410:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716480 00000100:00100000:2.0:1783144412.580465:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:2.0:1783144412.580474:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+5:70816:x1869759481716480:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144412.580488:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144412.580527:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d59 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144412.580555:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 6 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144412.580565:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 6 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144412.580574:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7516000, rc 0) 00000100:00100000:2.0:1783144412.580629:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481716480:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 156us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144412.580636:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:0.0:1783144412.582777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144412.582826:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716608 00000100:00100000:2.0:1783144412.582832:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716608 00000100:00100000:0.0:1783144412.582979:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:0.0:1783144412.582990:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481716608:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783144412.583008:0:94185:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1783144412.583026:0:94185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783144412.583030:0:94185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783144412.583033:0:94185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783144412.583035:0:94185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783144412.583038:0:94185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:3.0:1783144412.584673:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481716608:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 Request processed in 1680us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144412.584682:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 64 00000100:00100000:1.0:1783144412.589199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144412.589843:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716736 00000100:00100000:0.0:1783144412.589851:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716736 00000100:00100000:0.0:1783144412.589898:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:0.0:1783144412.589907:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+6:70816:x1869759481716736:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144412.589919:0:94183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144412.589932:0:94183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d60 expref: -99 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144412.589955:0:94183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 7 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144412.589965:0:94183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 7 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144412.589984:0:94183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fc00, rc 0) 00000100:00100000:0.0:1783144412.590034:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+7:70816:x1869759481716736:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 127us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144412.590040:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:0.0:1783144412.592754:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144412.592845:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716864 00000100:00100000:2.0:1783144412.592852:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716864 00000100:00100000:2.0:1783144412.592928:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1783144412.592937:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+7:70816:x1869759481716864:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144412.593078:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481716864:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 142us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144412.593087:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:2.0:1783144412.598327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144412.598374:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481716992 00000100:00100000:3.0:1783144412.598383:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481716992 00000100:00100000:3.0:1783144412.598433:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:3.0:1783144412.598443:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481716992:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144412.598584:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481716992:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 141us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144412.598592:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 67 00000100:00100000:1.0:1783144412.602465:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144412.602531:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481717120 00000100:00100000:2.0:1783144412.602541:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481717120 00000100:00100000:2.0:1783144412.602586:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1783144412.602593:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481717120:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144412.602605:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144412.602622:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac7517e00/0xad8e53a423049160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d67 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144412.602643:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac7517e00/0xad8e53a423049160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d67 expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144412.602651:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac7517e00/0xad8e53a423049160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d67 expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144412.602657:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517e00, rc 0) 00000100:00100000:2.0:1783144412.602701:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481717120:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144412.602708:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1783144412.604364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144412.604436:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481717248 00000100:00100000:3.0:1783144412.604443:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481717248 00000100:00100000:3.0:1783144412.604479:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1783144412.604489:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481717248:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144412.604637:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481717248:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 145us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144412.604646:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1783144412.608977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144412.609104:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481717376 00000100:00100000:3.0:1783144412.609113:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481717376 00000100:00100000:3.0:1783144412.609161:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:3.0:1783144412.609169:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481717376:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144412.609316:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481717376:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144412.609324:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 70 00000100:00100000:3.0:1783144412.612892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144412.613312:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481717504 00000100:00100000:0.0:1783144412.613319:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481717504 00000100:00100000:0.0:1783144412.613359:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1783144412.613369:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481717504:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144412.613383:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144412.613398:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d6e expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144412.613419:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 10 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144412.613427:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 10 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144412.613433:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fe00, rc 0) 00000100:00100000:0.0:1783144412.613472:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481717504:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 105us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144412.613479:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 71 00000100:00100000:0.0:1783144412.617957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144412.618096:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481717632 00000100:00100000:3.0:1783144412.618105:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481717632 00000100:00100000:3.0:1783144412.618156:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 72 00000100:00100000:3.0:1783144412.618259:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481717632:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144412.618370:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481717632:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 204us (418us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144412.618378:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 72 00000020:00000004:2.0:1783144412.660046:0:94564:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783144412.660225:0:94564:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783144412.686050:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144412.686068:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501398272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144412.686127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144412.686169:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398272 00000100:00100000:1.0:1783144412.686176:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398272 00000100:00100000:1.0:1783144412.686224:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:1.0:1783144412.686232:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501398272:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783144412.686239:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1783144412.686258:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144412.686304:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501398272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144412.686310:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:0.0:1783144412.686397:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501398272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144412.686855:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501398400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144412.686884:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144412.687046:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398400 00000100:00100000:1.0:1783144412.687051:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398400 00000100:00100000:1.0:1783144412.687089:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:1.0:1783144412.687098:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501398400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144412.687115:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00080000:2.0:1783144412.687137:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144412.687178:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501398400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144412.687184:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:0.0:1783144412.687186:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c60ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501398400:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144413.134548:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144414.159070:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.182089:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783144415.246019:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144415.246027:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144415.246030:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783144415.246035:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501398528:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1783144415.246042:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2af71e4000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144415.246067:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afaba6a00 x1869759501398784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144415.246097:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144415.246105:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144415.246109:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144415.246112:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144415.246117:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c29c340b000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144415.246128:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144415.246130:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af5510e00 x1869759501399040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144415.246136:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501398656:0@lo:400:kworker.0 00000100:00080000:3.0:1783144415.246159:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783144415.246167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144415.246168:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144415.246172:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144415.246178:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2af7208000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144415.246194:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af5512d80 x1869759501399296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144415.246211:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501398784:0@lo:38:kworker.0 00000100:00080000:3.0:1783144415.246229:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144415.246233:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783144415.246236:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783144415.246240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144415.246242:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2aefa7c800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1783144415.246256:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2af5511180 x1869759501399680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144415.246257:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501399040:0@lo:38:kworker.0 00000100:00100000:0.0:1783144415.246275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144415.246286:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501399296:0@lo:38:kworker.0 00000100:00100000:0.0:1783144415.246303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783144415.246315:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783144415.246318:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783144415.246319:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501399680:0@lo:38:kworker.0 00000100:00080000:3.0:1783144415.246322:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2ad085c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144415.246330:0:35504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2ad085c000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1783144415.246336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.246345:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29ca60b800 x1869759501400064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144415.246368:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398784 00000100:00100000:0.0:1783144415.246377:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398784 00000100:00100000:3.0:1783144415.246395:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398656 00000100:00100000:3.0:1783144415.246400:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398656 00000100:00100000:0.0:1783144415.246409:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399040 00000100:00100000:0.0:1783144415.246414:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399040 00000100:00100000:0.0:1783144415.246432:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399680 00000100:00100000:0.0:1783144415.246435:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399680 00000100:00100000:3.0:1783144415.246440:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783144415.246451:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501398656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144415.246457:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1783144415.246464:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501398784:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783144415.246510:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501398656:12345-0@lo:400:kworker.0 Request processed in 60us (343us total) trans 0 rc 0/0 00010000:00080000:0.0:1783144415.246515:0:66114:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2949 last 0 00000100:00100000:3.0:1783144415.246520:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000020:00000080:0.0:1783144415.246554:0:66114:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad8e53a42304916e 00000100:00100000:3.0:1783144415.246560:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:3.0:1783144415.246566:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501399040:12345-0@lo:38:kworker.0 00000004:00100000:0.0:1783144415.246570:0:66114:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:3.0:1783144415.246582:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2949 last 0 00000020:00000080:3.0:1783144415.246612:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad8e53a423049175 00000004:00100000:3.0:1783144415.246620:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783144415.246649:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2afcbb9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144415.246688:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869759501399040:12345-0@lo:38:kworker.0 Request processed in 120us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144415.246696:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00080000:0.0:1783144415.246715:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2af5ddc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144415.246716:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1783144415.246746:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501399680:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783144415.246768:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2949 last 0 00000100:00100000:0.0:1783144415.246774:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501398784:12345-0@lo:38:kworker.0 Request processed in 307us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.246782:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000020:00000080:3.0:1783144415.246794:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad8e53a42304917c 00000004:00100000:3.0:1783144415.246802:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783144415.246820:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501399168:0@lo:400:kworker.0 00000100:00080000:3.0:1783144415.246821:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2afcbbc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783144415.246861:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869759501399680:12345-0@lo:38:kworker.0 Request processed in 114us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.246864:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.246872:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1783144415.246887:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399168 00000100:00100000:3.0:1783144415.246890:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399168 00000100:00100000:0.0:1783144415.246891:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501399936:0@lo:400:kworker.0 00000100:00100000:3.0:1783144415.246921:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1783144415.246928:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.246930:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501399168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144415.246954:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783144415.246963:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501398912:0@lo:400:kworker.0 00000100:00100000:3.0:1783144415.246968:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501399168:12345-0@lo:400:kworker.0 Request processed in 39us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144415.246975:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1783144415.246994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.246995:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398528 00000100:00100000:3.0:1783144415.247000:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398528 00000100:00100000:0.0:1783144415.247017:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501399808:0@lo:400:kworker.0 00000100:00100000:3.0:1783144415.247027:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399296 00000100:00100000:3.0:1783144415.247032:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399296 00000100:00100000:0.0:1783144415.247042:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.247051:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1783144415.247059:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501398528:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783144415.247075:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501399168:0@lo:400:kworker.0 00000004:00000024:3.0:1783144415.247084:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1783144415.247105:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399936 00000100:00100000:0.0:1783144415.247109:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399936 00000100:00100000:3.0:1783144415.247121:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501398528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144415.247128:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:0.0:1783144415.247138:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399808 00000100:00100000:0.0:1783144415.247142:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399808 00000100:00100000:3.0:1783144415.247147:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1783144415.247152:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1869759501399296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783144415.247170:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00010000:00080000:3.0:1783144415.247172:0:8447:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2aefa7e800, cookie 0xad8e53a423048fd1 00010000:00080000:3.0:1783144415.247176:0:8447:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t115964117001 exp ffff9c2aefa7e800 cur 2949 last 1783144409 00000100:00100000:0.0:1783144415.247183:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501399936:12345-0@lo:400:kworker.0 00000004:00100000:3.0:1783144415.247184:0:8447:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783144415.247198:0:8447:0:(import.c:65:import_set_state_nolock()) ffff9c2afcbbc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144415.247233:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501399936:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144415.247236:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501399296:12345-0@lo:38:kworker.0 Request processed in 82us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144415.247243:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:0.0:1783144415.247253:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00010000:00080000:3.0:1783144415.247259:0:94212:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1783144415.247263:0:94212:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 115964117003 00000020:00080000:3.0:1783144415.247266:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783144415.247269:0:94212:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 115964117003, next_transno: 115964117003 00000100:00100000:0.0:1783144415.247272:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00010000:00080000:3.0:1783144415.247273:0:94212:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (115964117003) 00000020:00080000:3.0:1783144415.247276:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:0.0:1783144415.247283:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501399808:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783144415.247285:0:94212:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481709440 t115964117003 from 192.168.203.4@tcp req@ffff9c2ad05d2680 x1869759481709440/t0(115964117003) o36->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:522/0 lens 528/0 e 0 to 0 dl 1783144422 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144415.247326:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3649:x1869759501399808:12345-0@lo:400:kworker.0 Request processed in 45us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.247333:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1783144415.247342:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501399424:0@lo:400:kworker.0 00000100:00100000:0.0:1783144415.247359:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501398912 00000100:00100000:0.0:1783144415.247364:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501398912 00000100:00100000:3.0:1783144415.247371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144415.247396:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:3.0:1783144415.247397:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501398656:0@lo:400:kworker.0 00000100:00100000:0.0:1783144415.247408:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501398912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144415.247422:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef4bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501398528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144415.247439:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783144415.247446:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869759501398912:12345-0@lo:400:kworker.0 Request processed in 40us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144415.247448:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501399552:0@lo:400:kworker.0 00000100:00100000:0.0:1783144415.247459:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:3.0:1783144415.247494:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144415.247511:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1869759501398912:0@lo:400:kworker.0 00000100:00100000:3.0:1783144415.247526:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501400064:0@lo:38:kworker.0 00000100:00100000:0.0:1783144415.247528:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501399808:0@lo:400:kworker.0 00000100:00100000:0.0:1783144415.247545:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501399936:0@lo:400:kworker.0 00000100:00100000:3.0:1783144415.247557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144415.247581:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400064 00000100:00100000:0.0:1783144415.247585:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400064 00000100:00100000:0.0:1783144415.247608:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1783144415.247613:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1869759501400064:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783144415.247628:0:66114:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2949 last 0 00000020:00000080:0.0:1783144415.247650:0:66114:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad8e53a423049183 00000004:00100000:0.0:1783144415.247658:0:66114:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783144415.247676:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2af5ddd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144415.247717:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869759501400064:12345-0@lo:38:kworker.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.247743:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00080000:2.0:1783144415.247839:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144415.247844:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144415.247846:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144415.247857:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399424 00000100:00100000:2.0:1783144415.247861:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399424 00000100:00100000:2.0:1783144415.247903:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501399552 00000100:00100000:2.0:1783144415.247907:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501399552 00000100:00080000:1.0:1783144415.247911:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144415.247916:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144415.247935:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1783144415.247945:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501399424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144415.247952:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:1.0:1783144415.247965:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501399552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144415.247991:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501399424:12345-0@lo:400:kworker.0 Request processed in 47us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144415.247999:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1783144415.248040:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501399424:0@lo:400:kworker.0 00000100:00100000:1.0:1783144415.248119:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501399552:12345-0@lo:400:kworker.0 Request processed in 157us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144415.248128:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00010000:00080000:3.0:1783144415.248148:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c29ca60b800 x1869759501400064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144415.248159:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501399552:0@lo:400:kworker.0 00000100:00080000:3.0:1783144415.248161:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000004:00080000:1.0:1783144415.248165:0:94212:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 840us 00000100:00080000:3.0:1783144415.248172:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783144415.248178:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783144415.248181:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ad085c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783144415.248189:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869759501400064:0@lo:38:kworker.0 00010000:00080000:3.0:1783144415.248202:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2af5511180 x1869759501399680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144415.248210:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1783144415.249012:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2af5511180 x1869759501399680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144440 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144415.249020:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783144415.249023:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2aefa7c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783144415.249027:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783144415.249031:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869759501399680:0@lo:38:kworker.0 00010000:00080000:3.0:1783144415.249046:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2afaba6a00 x1869759501398784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144415.249055:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:3.0:1783144415.249859:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2afaba6a00 x1869759501398784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144440 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144415.249868:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783144415.249871:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783144415.249874:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783144415.249886:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501398784:0@lo:38:kworker.0 00010000:00080000:3.0:1783144415.249902:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2af5510e00 x1869759501399040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144415.249912:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:3.0:1783144415.250670:0:3647:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2af5510e00 x1869759501399040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144440 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144415.250678:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783144415.250681:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c340b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783144415.250684:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783144415.250687:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1869759501399040:0@lo:38:kworker.0 00000100:00100000:3.0:1783144415.250700:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117002 gen 3 00000004:00080000:3.0:1783144415.250705:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117001 committed transno 115964117002 00000004:00080000:3.0:1783144415.250753:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117002 committed transno 115964117002 00000100:00080000:3.0:1783144415.250766:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1783144415.250773:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1783144415.250777:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1783144415.250779:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117002 gen 3 00000100:00080000:3.0:1783144415.250782:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2af7208000 from lustre-MDT0000_UUID committed 115964117002 last 0 00000100:00080000:3.0:1783144415.250785:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1783144415.251006:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501399296:0@lo:38:kworker.0 00010000:00080000:3.0:1783144415.251065:0:94578:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1783144415.251069:0:94578:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1783144415.251073:0:94578:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:3.0:1783144415.251445:0:94578:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a4230488d8 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1783144415.251473:0:94578:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:1.0:1783144415.251577:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501400192:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1783144415.251628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.251698:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400192 00000100:00100000:3.0:1783144415.251703:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400192 00000100:00100000:3.0:1783144415.251834:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:3.0:1783144415.251844:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501400192:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1783144415.251867:0:8447:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2aee582d80 x1869759501400192/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:526/0 lens 328/0 e 0 to 0 dl 1783144426 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144415.251877:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869759501400192:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 37us (250us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144415.251884:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00010000:00010000:1.0:1783144415.255130:0:94212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255159:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255173:0:94212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255185:0:94212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255192:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255198:0:94212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255586:0:94212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255595:0:94212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255601:0:94212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255608:0:94212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144415.255612:0:94212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255620:0:94212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255632:0:94212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29c3de4400) 00010000:00010000:1.0:1783144415.255636:0:94212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144415.255640:0:94212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255646:0:94212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a42304918a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144415.255663:0:94212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7eb6ce6 reply state 00000000006e3f03 transno 115964117003 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255674:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.255680:0:94212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29c3de4f00) 00010000:00010000:1.0:1783144415.255688:0:94212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144415.255691:0:94212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783144415.255907:0:94212:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1783144415.255929:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144415.255932:0:94212:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117004 00000020:00080000:1.0:1783144415.255937:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783144415.255939:0:94212:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117004 00000001:00080000:0.0:1783144415.257066:0:94178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117003 is committed 00010000:00010000:3.0:1783144415.258375:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.258387:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.258393:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.258399:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144415.258403:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.258410:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.258423:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29c3de4f00) 00010000:00010000:3.0:1783144415.258426:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144415.258437:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.258443:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049191 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144415.259522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144415.259581:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481709952 00000100:00100000:3.0:1783144415.259589:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481709952 00000100:00100000:3.0:1783144415.259664:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1300 00000100:00100000:3.0:1783144415.259673:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481709952:12345-192.168.203.4@tcp:36:rm.0 00010000:00080000:3.0:1783144415.259689:0:66113:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 115964117004, current: 115964117004, replaying 00000100:00100000:3.0:1783144415.259707:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481709952:12345-192.168.203.4@tcp:36:rm.0 Request processed in 36us (190us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144415.259714:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1300 00000020:00080000:2.0:1783144415.259775:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144415.259778:0:94212:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 115964117004, next_transno: 115964117004 00010000:00080000:2.0:1783144415.259782:0:94212:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (115964117004) 00000020:00080000:2.0:1783144415.259785:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144415.259794:0:94212:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481709952 t115964117004 from 192.168.203.4@tcp req@ffff9c29c60ead80 x1869759481709952/t0(115964117004) o36->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:526/0 lens 512/0 e 0 to 0 dl 1783144426 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783144415.259856:0:94212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259867:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259877:0:94212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259887:0:94212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259893:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259899:0:94212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259961:0:94212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259979:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.259986:0:94212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260153:0:94212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260161:0:94212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260167:0:94212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260172:0:94212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144415.260176:0:94212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260182:0:94212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260190:0:94212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c29cd29e700) 00010000:00010000:2.0:1783144415.260193:0:94212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783144415.260196:0:94212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260202:0:94212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a4230491a6 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260218:0:94212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260229:0:94212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260235:0:94212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260240:0:94212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144415.260242:0:94212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260248:0:94212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260254:0:94212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29e500) 00010000:00010000:2.0:1783144415.260256:0:94212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144415.260259:0:94212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260264:0:94212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517400/0xad8e53a423049198 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144415.260275:0:94212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e881c6e reply state 00000000c1953e07 transno 115964117004 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260283:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.260290:0:94212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c29cd29e200) 00010000:00010000:2.0:1783144415.260292:0:94212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144415.260294:0:94212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1783144415.260340:0:94212:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783144415.260356:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144415.260359:0:94212:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117005 00000020:00080000:2.0:1783144415.260362:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144415.260364:0:94212:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117005 00000100:00100000:2.0:1783144415.262572:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144415.263814:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481717888 00000100:00100000:1.0:1783144415.263822:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481717888 00000100:00100000:1.0:1783144415.263865:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 864 00000100:00100000:1.0:1783144415.263875:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2402:x1869759481717888:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783144415.263893:0:66112:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c29c60eaa00 x1869759481717888/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:526/0 lens 224/0 e 0 to 0 dl 1783144426 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144415.263911:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2402:x1869759481717888:12345-192.168.203.4@tcp:400:ldlm_lock_repla.0 Request processed in 39us (1343us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144415.263918:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 864 00000020:00080000:2.0:1783144415.263926:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144415.263930:0:94212:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964117005 00010000:00080000:2.0:1783144415.263932:0:94212:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1783144415.263934:0:94212:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783144415.263940:0:94212:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783144415.263942:0:94212:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783144415.263947:0:94212:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9c2aee582d80 x1869759501400192/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:526/0 lens 328/0 e 0 to 0 dl 1783144426 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783144415.263959:0:94212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144415.263976:0:94212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031600/0xad8e53a4230491ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad8e53a4230488d1 expref: -99 pid: 94212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.263990:0:94212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031600/0xad8e53a4230491ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230488d1 expref: 7 pid: 94212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.263998:0:94212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031600/0xad8e53a4230491ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230488d1 expref: 7 pid: 94212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.264003:0:94212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac0031600, rc 0) 00010000:00080000:2.0:1783144415.264042:0:94212:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1783144415.264048:0:94212:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:1.0:1783144415.264454:0:3647:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2ac7516200/0xad8e53a4230488d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad8e53a4230491ad expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783144415.264464:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1783144415.264495:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501400192:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1783144415.264516:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501400320:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1783144415.264548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144415.264580:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400320 00000100:00100000:2.0:1783144415.264584:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400320 00000100:00100000:2.0:1783144415.264612:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1783144415.264624:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1869759501400320:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1783144415.264631:0:8446:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2aee583800 x1869759501400320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:526/0 lens 224/0 e 0 to 0 dl 1783144426 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144415.264645:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1869759501400320:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 21us (97us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144415.264649:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00010000:00080000:3.0:1783144415.264668:0:94212:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1783144415.264914:0:94212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:0.0:1783144415.267324:0:94178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783144415.267330:0:94178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00080000:0.0:1783144415.267350:0:94178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117004 is committed 00010000:00010000:1.0:1783144415.267442:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.267453:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.267468:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.267486:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144415.267491:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.267500:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.267513:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.267519:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac7517a00/0xad8e53a42304919f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94212 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783144415.267531:0:94212:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783144415.267610:0:94212:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783144415.267621:0:94212:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.203.4@tcp: req@ffff9c29c60eaa00 x1869759481717888/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:526/0 lens 224/0 e 0 to 0 dl 1783144426 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783144415.267687:0:94212:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2aee583800 x1869759501400320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:526/0 lens 224/0 e 0 to 0 dl 1783144426 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144415.268116:0:94212:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:2.0:1783144415.269161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144415.269340:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481717760 00000100:00100000:0.0:1783144415.269346:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481717760 00000100:00100000:0.0:1783144415.269391:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1301 00000100:00100000:0.0:1783144415.269401:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:72231:x1869759481717760:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:0.0:1783144415.269423:0:66114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444917248 avail 1298677760 00000100:00100000:0.0:1783144415.269471:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:72231:x1869759481717760:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 72us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.269489:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1301 00000100:00080000:1.0:1783144415.269870:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783144415.269878:0:3647:0:(client.c:3233:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2aee582300 x1869759501400320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144431 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144415.269886:0:3647:0:(client.c:3242:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2aee582300 x1869759501400320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144431 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144415.269892:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af7208000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783144415.269935:0:3647:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1783144415.269941:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001102733e): req@ffff9c2af5512a00 x1869759501383168/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144411 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144415.269957:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501400320:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1783144415.271095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144415.271115:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783144415.271129:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501400448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144415.271137:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718016 00000100:00100000:1.0:1783144415.271143:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718016 00000100:00100000:2.0:1783144415.271159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783144415.271184:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144415.271201:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1302 00000100:00100000:1.0:1783144415.271214:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:72231:x1869759481718016:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:1.0:1783144415.271229:0:81077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783144415.271260:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501383168 00000100:00100000:2.0:1783144415.271268:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501383168 00000100:00100000:1.0:1783144415.271318:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:72231:x1869759481718016:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 62us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144415.271325:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:1.0:1783144415.271337:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1302 00000100:00100000:2.0:1783144415.271347:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869759501383168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783144415.271375:0:78024:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444917248 avail 1298677760 00000100:00100000:2.0:1783144415.271431:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869759501383168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144415.271437:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1783144415.271463:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144415.271521:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400448 00000100:00100000:1.0:1783144415.271528:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400448 00000100:00100000:0.0:1783144415.271529:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501383168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144415.271563:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:1.0:1783144415.271571:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501400448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144415.271586:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444917248 avail 1298677760 00000100:00100000:1.0:1783144415.271621:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501400448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144415.271627:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1783144415.271911:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501400448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144415.275577:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144415.275629:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718144 00000100:00100000:0.0:1783144415.275634:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718144 00000100:00100000:0.0:1783144415.275662:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4983 00000100:00100000:0.0:1783144415.275667:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1869759481718144:12345-192.168.203.4@tcp:8:lfs.0 00010000:00080000:0.0:1783144415.275689:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp t0 exp 0000000000000000 cur 2949 last 0 00000020:00000080:0.0:1783144415.275713:0:8437:0:(genops.c:1406:class_connect()) connect: client 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef, cookie 0xad8e53a4230491b4 00002000:00100000:0.0:1783144415.275739:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef/ffff9c2ac5d54000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783144415.275765:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783144415.275836:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783144415.275856:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d56800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783144415.275894:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481718144:12345-192.168.203.4@tcp:8:lfs.0 Request processed in 227us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.275899:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4983 00000100:00100000:0.0:1783144415.277025:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000001:00100000:2.0:1783144415.277067:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000100:00100000:1.0:1783144415.277069:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718272 00000001:00100000:2.0:1783144415.277074:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000100:00100000:1.0:1783144415.277075:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718272 00000020:00000080:2.0:1783144415.277080:0:8430:0:(genops.c:906:class_export_put()) final put ffff9c2ac9d67800/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00000001:00100000:2.0:1783144415.277096:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783144415.277113:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac9d67800/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef for lustre-OST0000 00000100:00080000:0.0:1783144415.277115:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144415.277127:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1666 00000100:00100000:1.0:1783144415.277137:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72231:x1869759481718272:12345-192.168.203.4@tcp:13:lfs.0 00000020:00000080:2.0:1783144415.277149:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac9d65000 for lustre-OST0000 00002000:00000024:1.0:1783144415.277151:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144415.277192:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72231:x1869759481718272:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144415.277199:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1666 00000100:00100000:1.0:1783144415.278504:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144415.278540:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718400 00000100:00100000:2.0:1783144415.278551:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718400 00000100:00100000:2.0:1783144415.278596:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1667 00000100:00100000:2.0:1783144415.278604:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72231:x1869759481718400:12345-192.168.203.4@tcp:13:lfs.0 00000100:00080000:0.0:1783144415.278622:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1783144415.278623:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144415.278658:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72231:x1869759481718400:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144415.278664:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1667 00000004:00000080:3.0:1783144415.284004:0:94212:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc16287a6be10 00100000:10000000:3.0:1783144415.284017:0:94212:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1783144415.284926:0:94199:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x703:0x0] 00000100:00100000:3.0:1783144415.284967:0:94199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94199:1869759501400576:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783144415.285031:0:94199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.285063:0:94199:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144415.285111:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400576 00000100:00100000:0.0:1783144415.285122:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400576 00000100:00100000:0.0:1783144415.285174:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4984 00000100:00100000:0.0:1783144415.285183:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:94199:x1869759501400576:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783144415.285206:0:26150:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -94 00002000:02000040:0.0:1783144415.285210:0:26150:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1796 to 0x2c0000401:1889) 00000004:00080000:1.0:1783144415.285273:0:94197:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x702:0x0] 00000100:00100000:1.0:1783144415.285298:0:94197:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94197:1869759501400704:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783144415.285329:0:94197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144415.285385:0:94197:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c3ecd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144415.285418:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400704 00000100:00100000:3.0:1783144415.285422:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400704 00000100:00100000:3.0:1783144415.285485:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4985 00000100:00100000:3.0:1783144415.285493:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:94197:x1869759501400704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783144415.285507:0:26140:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -95 00002000:02000040:3.0:1783144415.285510:0:26140:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1795 to 0x280000401:1889) 00002000:00010000:0.0:1783144415.294592:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.294604:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294619:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.294623:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.294628:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294642:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294669:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294677:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294703:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144415.294945:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.294951:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294959:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.294962:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.294966:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294975:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294983:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.294990:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295013:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783144415.295421:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144415.295429:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295437:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.295441:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295450:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295465:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295472:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d943054/0xad8e53a4230491bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295503:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.295506:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295524:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.295527:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295535:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295545:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295552:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be31a8c/0xad8e53a4230491c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.295563:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.295565:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.295566:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.295572:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144415.295797:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.295802:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295810:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.295814:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.295817:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295826:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295834:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295841:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295856:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144415.295892:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.295896:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295904:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.295912:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.295916:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295925:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295932:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295940:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295953:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144415.295960:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144415.295964:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295970:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.295973:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295981:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.295990:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296007:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b6fc31/0xad8e53a4230491c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296020:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.296023:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296029:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98fa00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.296032:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296040:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296049:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296057:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab385e2e/0xad8e53a4230491d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296068:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.296070:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.296071:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144415.296108:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.296113:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296125:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.296128:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.296132:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296140:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296148:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296155:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296166:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144415.296197:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.296202:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296209:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.296212:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.296216:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296223:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296241:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296248:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296258:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783144415.296293:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.296298:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.296302:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.296308:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.296312:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.296313:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296317:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296333:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.296337:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296338:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.296349:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296351:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296371:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296375:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296393:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296401:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783144415.296403:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296409:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783144415.296414:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296415:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783144415.296422:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ee00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.296427:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296435:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296447:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296455:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7509ac9/0xad8e53a4230491d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296471:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783144415.296486:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296494:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e600 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:3.0:1783144415.296498:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.296498:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296509:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296523:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.296529:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.296530:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296534:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296548:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296551:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296562:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc84cbe/0xad8e53a4230491de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296566:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296577:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296577:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144415.296584:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296595:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.296596:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144415.296599:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296607:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296617:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296624:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7dc6bd/0xad8e53a4230491e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.296640:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.296648:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296648:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783144415.296654:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296661:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.296665:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.296667:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.296670:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296673:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296685:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296697:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296704:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296706:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc0ea21/0xad8e53a4230491ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296747:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.296750:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296752:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296772:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.296773:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296776:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296804:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296805:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144415.296819:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296827:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2446771/0xad8e53a4230491f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296840:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.296843:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296849:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.296852:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296858:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296865:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296872:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072163e59/0xad8e53a4230491fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296891:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.296894:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.296895:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783144415.296919:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.296926:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296935:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.296938:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1783144415.296940:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.296943:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296946:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296960:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296961:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.296968:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.296977:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.296979:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.296995:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297010:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297015:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297021:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297035:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783144415.297035:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783144415.297047:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144415.297052:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297059:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.297063:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.297071:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.297072:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297081:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297088:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297105:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025c3e195/0xad8e53a423049201 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297110:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.297118:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.297123:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297127:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.297133:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297135:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297153:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297173:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297176:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.297182:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297186:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.297195:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297208:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297215:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008590e5ca/0xad8e53a423049208 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.297221:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.297228:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297231:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.297238:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297239:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.297246:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.297254:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297255:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.297261:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297268:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297273:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297290:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297293:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297307:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297316:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000930061c2/0xad8e53a42304920f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297319:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.297335:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.297340:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297347:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.297351:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.297355:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.297361:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297363:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297382:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.297385:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.297386:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297392:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297400:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4cc4c9/0xad8e53a423049216 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297406:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297417:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.297417:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297421:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.297424:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.297428:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297457:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.297464:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.297469:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297494:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.297498:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297506:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.297508:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.297519:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297523:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297532:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.297535:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4741c91/0xad8e53a42304921d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297536:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.297545:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297553:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.297556:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297557:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.297560:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.297568:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297575:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.297580:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.297587:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297592:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.297600:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.297604:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.297609:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297620:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.297630:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.297635:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297638:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297651:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297653:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.297665:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.297665:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.297672:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297674:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297692:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.297696:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297698:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297714:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297716:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297741:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297762:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.297766:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297775:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b803de/0xad8e53a423049224 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297793:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.297797:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.297802:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.297811:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297815:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.297823:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.297826:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.297830:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297837:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297845:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297856:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297864:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.297885:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.297894:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.297897:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297900:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297918:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.297922:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297922:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.297926:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297938:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ebb493/0xad8e53a423049232 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297943:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297956:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297961:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.297963:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297966:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.297980:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.297981:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.297986:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.297995:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298007:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298011:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.298019:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298025:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059188c86/0xad8e53a423049239 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298045:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.298049:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.298053:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.298054:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298060:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298067:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298071:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.298077:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298081:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298095:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298097:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298120:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.298123:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298132:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221d2084/0xad8e53a423049240 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298148:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.298151:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298153:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.298164:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.298164:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298172:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.298175:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298177:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.298185:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298191:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298197:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298207:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298230:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000663faeda/0xad8e53a423049247 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298232:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298250:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298255:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.298258:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.298259:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.298264:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298271:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.298275:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298283:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298290:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.298294:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298297:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298315:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.298318:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.298325:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298333:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6f20fe5/0xad8e53a42304924e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298338:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298350:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298352:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.298356:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.298359:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.298373:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144415.298383:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783144415.298384:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144415.298389:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298396:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47ce00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.298400:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298409:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298414:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.298422:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298422:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298444:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.298445:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725cc7bf/0xad8e53a42304922b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298450:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.298458:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298467:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.298469:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298490:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298497:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298505:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.298513:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298521:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.298525:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298533:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298538:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.298545:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298547:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298558:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.298562:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004833b344/0xad8e53a423049255 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298572:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.298578:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298581:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.298588:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298589:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298604:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.298609:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298609:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298632:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298633:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298652:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.298668:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298676:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008256cd5a/0xad8e53a42304925c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298690:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.298692:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.298698:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298700:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298718:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.298737:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.298739:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298741:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.298750:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298755:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298763:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298771:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298774:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298781:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b024975/0xad8e53a423049263 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298795:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298801:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.298806:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.298807:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783144415.298817:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298839:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.298845:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298852:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.298855:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.298858:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298866:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298873:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298879:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298890:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.298893:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.298896:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298906:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298920:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.298922:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.298935:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298936:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb47936a/0xad8e53a42304926a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298951:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.298953:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.298955:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.298958:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.298961:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298978:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.298981:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.298984:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299001:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299004:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299018:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299026:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.299042:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299051:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000838753f1/0xad8e53a423049271 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.299063:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.299066:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.299070:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299072:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299088:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.299089:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.299093:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.299095:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299099:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299111:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299114:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299130:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299148:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003835c7b0/0xad8e53a423049278 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299148:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299167:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299172:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299176:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.299178:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.299186:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.299191:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299200:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.299204:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299212:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.299214:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.299223:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299228:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299232:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.299239:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.299243:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f77618b3/0xad8e53a42304927f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299245:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299266:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299269:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299273:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299276:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.299276:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299285:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299313:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.299317:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.299323:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299330:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.299334:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.299350:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.299353:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299357:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299372:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.299373:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299375:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.299383:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299388:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a72f841f/0xad8e53a423049286 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299396:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.299405:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299407:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299411:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.299413:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299415:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.299432:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783144415.299438:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.299444:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299452:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.299455:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299462:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144415.299467:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.299485:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299505:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f55ddca1/0xad8e53a42304928d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299518:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299520:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299522:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783144415.299541:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.299546:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299554:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.299559:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.299559:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299566:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.299566:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.299572:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.299577:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299586:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299593:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299620:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144415.299659:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.299664:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299671:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.299674:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.299677:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299686:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299693:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299700:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299713:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783144415.299766:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.299772:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299779:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.299783:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.299787:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299805:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299813:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299821:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.299882:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144415.299888:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299891:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783144415.299900:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.299904:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.299919:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.299932:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.299932:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299944:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.299946:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e907fe80/0xad8e53a42304929b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299963:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.299968:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.299972:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.299972:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144415.299978:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.299987:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.299989:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.299995:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300003:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300006:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300023:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300035:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300038:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000517a4c2/0xad8e53a4230492a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300063:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783144415.300075:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144415.300079:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300086:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.300090:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300098:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.300106:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.300109:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300113:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300120:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000026cd725/0xad8e53a4230492a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300125:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.300131:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.300134:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783144415.300136:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300138:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300158:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47cc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.300159:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300162:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300181:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300203:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300204:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300224:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.300228:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300236:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c0a56d/0xad8e53a4230492b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300252:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.300255:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.300262:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.300262:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47da00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.300267:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300270:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300276:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300296:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.300298:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300301:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.300310:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300312:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093ded405/0xad8e53a4230492b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300333:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300355:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300359:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.300362:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.300365:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300366:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.300373:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.300382:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144415.300421:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.300427:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300434:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.300437:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.300442:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300452:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300470:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.300490:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300520:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144415.300526:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300549:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.300590:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300600:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300613:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300621:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d163b049/0xad8e53a4230492be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300654:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300665:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.300675:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.300680:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300691:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300699:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300708:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300733:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783144415.300777:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.300783:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300792:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.300795:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.300799:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300809:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300818:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300833:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.300842:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783144415.300927:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783144415.300937:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300945:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.300956:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300965:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300978:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.300993:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144415.300998:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301004:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.301008:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301017:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301028:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301035:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aff53dcd/0xad8e53a423049294 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301049:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.301057:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301064:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.301068:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301075:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301087:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301094:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca74c87b/0xad8e53a4230492cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.301117:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.301119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.301121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.301129:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.301133:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783144415.301170:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.301178:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301187:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.301190:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.301195:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301205:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301214:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301222:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301277:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783144415.301324:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.301330:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301345:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.301348:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.301352:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301360:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301368:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301376:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301391:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783144415.301434:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.301440:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301449:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.301452:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.301457:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301466:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301499:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301507:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301519:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783144415.301564:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.301570:0:26150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301579:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.301582:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.301587:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301597:0:26150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301605:0:26150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301613:0:26150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.301636:0:26150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:0.0:1783144415.302024:0:26150:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1795 00000100:00100000:0.0:1783144415.302119:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:94199:x1869759501400576:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16934us (17084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.302128:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4984 00010000:00010000:3.0:1783144415.302213:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1783144415.302219:0:26140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0f90b7c/0xad8e53a4230492c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144415.302263:0:94199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94199:1869759501400576:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783144415.302276:0:94199:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x703:0x0] 00000100:00100000:3.0:1783144415.302343:0:94199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94199:1869759501400960:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783144415.302374:0:94199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.302394:0:94199:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac75110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144415.302412:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400960 00000100:00100000:3.0:1783144415.302418:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400960 00000100:00100000:3.0:1783144415.302450:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4986 00000100:00100000:3.0:1783144415.302458:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94199:x1869759501400960:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783144415.302500:0:8602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00010000:00010000:2.0:1783144415.302580:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783144415.302587:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302597:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.302601:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302623:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302637:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302646:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e77c7ba/0xad8e53a4230492d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144415.302668:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783144415.302679:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501400832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144415.302717:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144415.302761:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783144415.302766:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302775:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.302778:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302786:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302850:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302870:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206d1dec/0xad8e53a4230492da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302895:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144415.302900:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302907:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.302911:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302919:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302932:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302939:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4bc182c/0xad8e53a4230492e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302951:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.302955:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302962:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.302970:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302979:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.302989:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303006:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef7aa148/0xad8e53a4230492e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303022:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303024:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303028:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303034:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303038:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303040:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303042:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144415.303183:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.303189:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303199:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.303203:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.303208:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303230:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303240:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303249:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303263:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.303271:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.303274:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303282:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.303285:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303294:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303306:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303313:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e0e619/0xad8e53a4230492ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303340:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303343:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303345:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144415.303403:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.303409:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303417:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.303420:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.303424:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303434:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303442:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303449:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303463:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.303470:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.303485:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303503:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.303507:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303516:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303528:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303536:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064b3a0c/0xad8e53a4230492f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303550:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303553:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783144415.303604:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.303610:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303618:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.303623:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.303627:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303636:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303650:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303657:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303671:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.303679:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.303683:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303690:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.303694:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303702:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303715:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303742:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f737452e/0xad8e53a4230492fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.303756:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303763:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.303766:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144415.303962:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501400832 00000100:00100000:0.0:1783144415.303967:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501400832 00000100:00100000:0.0:1783144415.303997:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:0.0:1783144415.304004:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3650:x1869759501400832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783144415.304016:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144415.304055:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3650:x1869759501400832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.304063:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00100000:2.0:1783144415.304074:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501400832:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1783144415.304126:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.304132:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304150:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.304153:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.304158:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304167:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304174:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304182:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304201:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.304231:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.304237:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.304239:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.304250:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304251:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.304258:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304264:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.304269:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304270:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.304279:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304287:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304290:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304304:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0bf944/0xad8e53a423049304 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304322:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304325:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304325:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.304329:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304336:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304350:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.304364:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.304369:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304376:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.304386:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.304388:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.304399:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304401:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304421:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.304425:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.304426:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304430:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304436:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d57674c8/0xad8e53a42304930b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304446:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304455:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304456:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304458:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.304462:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304469:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304506:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.304514:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.304519:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304527:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47ca00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.304530:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304538:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.304545:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.304549:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304552:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304572:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.304574:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a5b024a/0xad8e53a423049312 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304576:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.304585:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304596:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304598:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.304601:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.304604:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304609:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304617:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304631:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.304639:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.304644:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304652:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47d000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.304656:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304664:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.304666:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.304677:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304681:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304691:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.304695:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba54677f/0xad8e53a423049319 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304704:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.304712:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304714:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.304717:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.304745:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304754:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304763:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304770:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304782:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.304790:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.304796:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304804:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47dc00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.304808:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304816:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.304819:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.304827:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304829:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304845:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:2.0:1783144415.304847:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eea59d1/0xad8e53a423049320 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304849:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.304859:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304866:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304870:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.304873:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.304882:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304895:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304908:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.304914:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.304919:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304927:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47de00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.304930:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.304944:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.304953:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304954:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304976:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.304979:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.304979:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.304987:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.304993:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002021fb13/0xad8e53a423049327 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305001:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305010:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305024:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305027:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305030:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305034:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144415.305146:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305245:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783144415.305248:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305257:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee47c400 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.305261:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305270:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.305277:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.305282:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305283:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305297:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.305301:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.305311:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305314:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1c0e229/0xad8e53a42304932e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305333:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305338:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305342:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305354:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305362:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305378:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.305385:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.305391:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305399:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.305403:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305410:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.305419:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.305422:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305426:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305436:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005518a12/0xad8e53a423049335 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305440:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.305448:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.305454:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305455:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305458:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305466:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305466:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305500:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305507:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305521:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783144415.305558:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.305573:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305581:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.305584:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.305588:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305598:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305598:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.305606:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305612:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305618:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.305623:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305626:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305638:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305656:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305664:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ebfff44/0xad8e53a42304933c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305668:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.305686:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.305690:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305696:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.305699:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305707:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305747:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305755:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d6925d2/0xad8e53a423049343 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305771:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.305774:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783144415.305776:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.305780:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305784:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.305787:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305791:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.305796:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305797:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.305801:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.305805:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305815:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144415.305819:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305824:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305833:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305848:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144415.305865:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.305871:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.305880:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151200 already unused, calling callback (ffffffffc0c0bce0) 00002000:00010000:3.0:1783144415.305881:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783144415.305885:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305888:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.305905:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305906:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.305918:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.305927:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.305930:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.305942:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd64708/0xad8e53a42304934a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.305943:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1783144415.305956:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783144415.305962:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.305966:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305970:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.305970:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.305973:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.305991:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144415.306000:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.306004:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306010:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150e00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:0.0:1783144415.306013:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306018:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306024:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306029:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc3dad64/0xad8e53a423049351 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.306033:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.306040:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306049:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.306050:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306054:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144415.306055:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.306058:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306060:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306071:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306078:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306090:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306107:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.306116:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.306123:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306132:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.306136:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306144:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.306146:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.306157:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306162:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306167:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.306173:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.306178:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306199:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049358 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306201:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306222:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306227:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306230:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306231:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.306235:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306247:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.306255:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.306261:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306269:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150a00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.306273:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306282:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.306287:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783144415.306295:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306296:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306306:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a42304935f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306314:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:3.0:1783144415.306319:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144415.306323:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306324:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306327:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306337:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306337:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306347:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306354:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306370:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144415.306399:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.306407:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.306408:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.306418:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306424:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150800 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144415.306431:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.306431:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306437:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.306445:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306448:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306464:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306470:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306499:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306502:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cce5051c/0xad8e53a423049366 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306516:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306527:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.306530:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144415.306534:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306535:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783144415.306545:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150c00 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.306553:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.306556:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306566:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144415.306577:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783144415.306583:0:26140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306584:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306603:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=2949s v=(0 0) 00010000:00010000:0.0:1783144415.306604:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6a52fc5/0xad8e53a42304936d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306610:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144415.306619:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306626:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306629:0:26140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144415.306630:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144415.306634:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144415.306641:0:26140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306648:0:26140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144415.306670:0:26140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783144415.306678:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144415.306684:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306692:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144415.306696:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306704:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306717:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306748:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028d8ad0/0xad8e53a423049374 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144415.306766:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.306769:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144415.306771:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783144415.307143:0:26140:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1794 00000100:00100000:3.0:1783144415.307198:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:94197:x1869759501400704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21705us (21866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144415.307207:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4985 00000100:00100000:1.0:1783144415.307214:0:94197:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94197:1869759501400704:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783144415.307225:0:94197:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x702:0x0] 00000100:00100000:3.0:1783144415.307315:0:94197:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94197:1869759501401216:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783144415.307347:0:94197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144415.307349:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501401088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144415.307373:0:94197:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad4c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783144415.307394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144415.307395:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401216 00000100:00100000:3.0:1783144415.307400:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401216 00000100:00100000:3.0:1783144415.307436:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4987 00000100:00100000:3.0:1783144415.307445:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:94197:x1869759501401216:12345-0@lo:5:osp-pre-0-0.0 00000001:00080000:1.0:1783144415.307459:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968832 is committed 00002000:00080000:3.0:1783144415.307484:0:16470:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00000100:00100000:1.0:1783144415.307518:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401088 00000100:00100000:1.0:1783144415.307522:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401088 00000100:00100000:1.0:1783144415.307556:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:1.0:1783144415.307567:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501401088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144415.307581:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 896 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144415.307608:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:94199:x1869759501400960:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5150us (5232us total) trans 4294968832 rc 0/0 00000100:00100000:2.0:1783144415.307618:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4986 00000100:00100000:0.0:1783144415.307631:0:94199:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968832 gen 2 00000100:00100000:1.0:1783144415.307636:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501401088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144415.307638:0:94199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c25f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94199:1869759501400960:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783144415.307644:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000004:00080000:0.0:1783144415.307649:0:94199:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00000100:00100000:1.0:1783144415.307680:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501401088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144415.308715:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:94197:x1869759501401216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1272us (1368us total) trans 4294968830 rc 0/0 00000100:00100000:3.0:1783144415.308833:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4987 00000100:00100000:0.0:1783144415.308841:0:94197:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afaba6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94197:1869759501401216:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783144415.308852:0:94197:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00000001:00100000:2.0:1783144415.760042:0:75517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783144416.208268:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144416.355110:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144416.355182:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144416.355218:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144416.355240:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144416.356112:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718912 00000100:00100000:3.0:1783144416.356122:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718912 00000100:00100000:3.0:1783144416.356166:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2091 00000100:00100000:3.0:1783144416.356176:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2403:x1869759481718912:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144416.356238:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2403:x1869759481718912:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144416.356245:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2091 00000100:00100000:3.0:1783144416.356815:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718528 00000100:00100000:3.0:1783144416.356820:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718528 00000100:00100000:3.0:1783144416.356856:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:3.0:1783144416.356862:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2403:x1869759481718528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144416.356899:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2403:x1869759481718528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144416.356908:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 74 00000100:00100000:1.0:1783144416.359075:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718656 00000100:00100000:1.0:1783144416.359084:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718656 00000100:00100000:2.0:1783144416.359158:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144416.360147:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719040 00000100:00100000:2.0:1783144416.360154:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719040 00000100:00100000:2.0:1783144416.360185:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2092 00000100:00100000:2.0:1783144416.360195:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2403:x1869759481719040:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144416.360252:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2403:x1869759481719040:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144416.360259:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2092 00000100:00100000:3.0:1783144416.361056:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481718784 00000100:00100000:3.0:1783144416.361062:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481718784 00000100:00100000:3.0:1783144416.361096:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 865 00000100:00100000:3.0:1783144416.361105:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2403:x1869759481718656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144416.361145:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2403:x1869759481718656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (6041us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144416.361151:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 865 00000100:00100000:3.0:1783144416.361167:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 866 00000100:00100000:3.0:1783144416.361173:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2403:x1869759481718784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144416.361197:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2403:x1869759481718784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 24us (5955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144416.361203:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 866 00010000:00010000:2.0:1783144417.230919:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144417.623413:0:94760:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:2.0:1783144417.806314:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501401472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783144417.806318:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeff06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501401344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144417.806381:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144417.806440:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401344 00000100:00100000:0.0:1783144417.806447:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401344 00000100:00100000:2.0:1783144417.806450:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144417.806497:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401472 00000100:00100000:2.0:1783144417.806501:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401472 00000100:00100000:0.0:1783144417.806705:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:0.0:1783144417.806719:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501401344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783144417.806764:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144417.806804:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501401344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144417.806811:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:0.0:1783144417.806828:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1783144417.806834:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501401472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144417.806850:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144417.806883:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501401472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144417.806889:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1783144417.809026:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501401472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144417.809062:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeff06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501401344:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783144417.811659:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144417.811669:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783144418.253849:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783144418.330243:0:94808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1783144419.277898:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144419.714378:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144419.714495:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719168 00000100:00100000:1.0:1783144419.714505:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719168 00000100:00100000:1.0:1783144419.714635:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1303 00000100:00100000:1.0:1783144419.714645:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:72700:x1869759481719168:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1783144419.714679:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144419.714699:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304937b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d75 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.714803:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049382 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.714818:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.714829:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144419.714878:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144419.714882:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144419.714905:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.714928:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304937b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d75 expref: 8 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.714945:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d75 expref: 7 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.714953:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144419.714956:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144419.714960:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1200, rc 0) 00000100:00100000:1.0:1783144419.715015:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:72700:x1869759481719168:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 372us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144419.715022:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1303 00000100:00080000:0.0:1783144419.715510:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144419.718026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144419.718103:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719296 00000100:00100000:3.0:1783144419.718112:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719296 00000100:00100000:3.0:1783144419.718202:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1304 00000100:00100000:3.0:1783144419.718212:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:72700:x1869759481719296:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:3.0:1783144419.718246:0:66112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444917248 avail 1298677760 00000100:00100000:3.0:1783144419.718338:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:72700:x1869759481719296:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144419.718346:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1304 00000100:00100000:3.0:1783144419.720832:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144419.720925:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719424 00000100:00100000:2.0:1783144419.720933:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719424 00000100:00100000:2.0:1783144419.721001:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1305 00000100:00100000:2.0:1783144419.721010:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:72700:x1869759481719424:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144419.721042:0:66947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00080000:0.0:1783144419.721073:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144419.721114:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:72700:x1869759481719424:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144419.721122:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1305 00000100:00100000:2.0:1783144419.723066:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144419.723147:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719552 00000100:00100000:0.0:1783144419.723153:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719552 00000100:00100000:0.0:1783144419.723256:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1672 00000100:00100000:0.0:1783144419.723266:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72700:x1869759481719552:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:0.0:1783144419.723288:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783144419.723334:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72700:x1869759481719552:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 70us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144419.723342:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1672 00000100:00080000:1.0:1783144419.723381:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783144419.724574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144419.724700:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719680 00000100:00100000:3.0:1783144419.724705:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719680 00000100:00100000:3.0:1783144419.724801:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1673 00000100:00100000:3.0:1783144419.724810:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72700:x1869759481719680:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1783144419.724827:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144419.724867:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:72700:x1869759481719680:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 59us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144419.724874:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1673 00000100:00080000:1.0:1783144419.725037:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144419.734753:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144419.734854:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719808 00000100:00100000:1.0:1783144419.734863:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719808 00000100:00100000:1.0:1783144419.734918:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1306 00000100:00100000:1.0:1783144419.734927:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:71601:x1869759481719808:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1783144419.734944:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144419.734970:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049389 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d7c expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735026:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735040:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735050:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735062:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735068:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735073:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735193:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a42304939e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735201:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a42304939e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735219:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a42304939e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144419.735245:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144419.735248:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144419.735278:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a42304939e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735290:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735296:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735302:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735308:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144419.735311:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735318:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735328:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144419.735331:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144419.735335:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735340:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0a00/0xad8e53a423049390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735361:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735367:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735371:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735376:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144419.735378:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735383:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735390:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c2af565c400) 00010000:00010000:1.0:1783144419.735392:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144419.735394:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735399:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049397 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735838:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049389 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d7c expref: 9 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735853:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1400/0xad8e53a42304939e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d7c expref: 8 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.735873:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af565c300) 00010000:00010000:1.0:1783144419.735875:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144419.735878:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1400, rc 0) 00000100:00100000:1.0:1783144419.735934:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71601:x1869759481719808:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1007us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144419.735940:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1306 00000100:00100000:0.0:1783144419.737195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144419.737260:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481719936 00000100:00100000:3.0:1783144419.737265:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481719936 00000100:00100000:3.0:1783144419.737300:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1307 00000100:00100000:3.0:1783144419.737309:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:71601:x1869759481719936:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1783144419.737320:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144419.737330:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493a5 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d83 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.737367:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.737377:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.737385:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.737406:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.737753:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.737760:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144419.737842:0:66114:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea43800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66114:1869759501401600:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783144419.737873:0:66114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144419.737897:0:66114:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144419.737991:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401600 00000100:00100000:2.0:1783144419.737996:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401600 00000100:00100000:2.0:1783144419.738031:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1783144419.738038:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66114:x1869759501401600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783144419.738102:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66114:x1869759501401600:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144419.738109:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:3.0:1783144419.738134:0:66114:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea43800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66114:1869759501401600:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783144419.738168:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151a00/0xad8e53a4230493ba lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738177:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151a00/0xad8e53a4230493ba lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738184:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151a00/0xad8e53a4230493ba lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144419.738201:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151a00/0xad8e53a4230493ba lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738212:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738219:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738235:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738241:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738246:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144419.738250:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738257:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738267:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af565c300) 00010000:00010000:3.0:1783144419.738270:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144419.738273:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738279:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a4230493ac lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738289:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738295:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738302:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738307:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144419.738323:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738328:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738333:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c2ac6738e00) 00010000:00010000:3.0:1783144419.738335:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144419.738337:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738340:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a4230493b3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738360:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493a5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d83 expref: 10 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738367:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151a00/0xad8e53a4230493ba lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d83 expref: 9 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.738371:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2ac6738100) 00010000:00010000:3.0:1783144419.738372:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144419.738374:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151a00, rc 0) 00000100:00100000:3.0:1783144419.738401:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71601:x1869759481719936:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1094us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144419.738415:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1307 00000100:00100000:0.0:1783144419.739502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144419.739569:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720064 00000100:00100000:2.0:1783144419.739573:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720064 00000100:00100000:2.0:1783144419.739598:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1308 00000100:00100000:2.0:1783144419.739606:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71601:x1869759481720064:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1783144419.739616:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144419.739628:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031a00/0xad8e53a4230493c1 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d8a expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.739657:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a4230493c8 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.739663:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a4230493c8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.739670:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a4230493c8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144419.739694:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1783144419.739701:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783144419.739754:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031a00/0xad8e53a4230493c1 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d8a expref: 11 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.739768:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a4230493c8 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d8a expref: 10 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.739776:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd096a00) 00010000:00010000:2.0:1783144419.739779:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1783144419.739782:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac0031400, rc 0) 00000100:00100000:2.0:1783144419.739853:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71601:x1869759481720064:12345-192.168.203.4@tcp:101:bash.0 Request processed in 247us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144419.739858:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1308 00000100:00100000:2.0:1783144419.742780:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144419.742805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144419.742810:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720192 00000100:00100000:3.0:1783144419.742830:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720192 00000100:00100000:0.0:1783144419.742854:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720320 00000100:00100000:0.0:1783144419.742859:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720320 00000100:00100000:0.0:1783144419.742934:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1309 00000100:00100000:0.0:1783144419.742943:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71601:x1869759481720320:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1783144419.742958:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144419.742971:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8600/0xad8e53a4230493cf lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d91 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743023:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743034:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743042:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743053:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743059:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743065:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743128:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8400/0xad8e53a4230493e4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743134:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8400/0xad8e53a4230493e4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743155:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8400/0xad8e53a4230493e4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144419.743195:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783144419.743199:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144419.743215:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8400/0xad8e53a4230493e4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743225:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8400/0xad8e53a4230493e4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743232:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743238:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743244:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743249:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743254:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144419.743257:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743266:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743274:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd096a00) 00010000:00010000:0.0:1783144419.743277:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144419.743284:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743290:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8c00/0xad8e53a4230493d6 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743300:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743305:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743311:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743316:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144419.743318:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743323:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144419.743330:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 719 00010000:00010000:0.0:1783144419.743330:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9c29ca14f700) 00010000:00010000:0.0:1783144419.743334:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144419.743338:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743343:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe9400/0xad8e53a4230493dd lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144419.743359:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2403:x1869759481720192:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783144419.743369:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8600/0xad8e53a4230493cf lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d91 expref: 13 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.743388:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144419.743391:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2afcbe8400/0xad8e53a4230493e4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d91 expref: 12 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144419.743397:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2aee3dbd00) 00010000:00010000:0.0:1783144419.743399:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144419.743401:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8400, rc 0) 00010000:00010000:3.0:1783144419.743405:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a4230493c8 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d8a expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.743421:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c29cd096a00) 00010000:00010000:3.0:1783144419.743424:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144419.743459:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71601:x1869759481720320:12345-192.168.203.4@tcp:101:bash.0 Request processed in 518us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144419.743469:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2403:x1869759481720192:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 126us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144419.743470:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1309 00000100:00100000:3.0:1783144419.743489:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 719 00000100:00100000:0.0:1783144419.745041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144419.745093:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720448 00000100:00100000:2.0:1783144419.745098:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720448 00000100:00100000:2.0:1783144419.745206:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4988 00000100:00100000:2.0:1783144419.745213:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2405:x1869759481720448:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1783144419.745223:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144419.745233:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a4230493eb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d98 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144419.745249:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x243:0x0] initial LVB size: 0, mtime: 0x6a489fc9, atime: 0x6a489fc9, ctime: 0x6a489fc9, blocks: 0x0 00010000:00010000:2.0:1783144419.745259:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=2954s v=(0 0) 00010000:00010000:2.0:1783144419.745262:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144419.745267:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a4230493eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d98 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.745285:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000064b3a0c/0xad8e53a4230493eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d98 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.745293:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac0031e00, rc 0) 00000100:00100000:2.0:1783144419.745355:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2405:x1869759481720448:12345-192.168.203.4@tcp:101:bash.0 Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144419.745362:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4988 00000100:00100000:1.0:1783144419.746887:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144419.746941:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720576 00000100:00100000:3.0:1783144419.746946:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720576 00000100:00100000:3.0:1783144419.746977:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1310 00000100:00100000:3.0:1783144419.746996:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:71601:x1869759481720576:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1783144419.747008:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144419.747020:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a4230493f2 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41d9f expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747055:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747062:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747068:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747075:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747088:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747092:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144419.747259:0:66112:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66112:1869759501401728:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783144419.747299:0:66112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144419.747348:0:66112:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dd6600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144419.747403:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401728 00000100:00100000:2.0:1783144419.747407:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401728 00000100:00100000:2.0:1783144419.747536:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:2.0:1783144419.747543:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66112:x1869759501401728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783144419.747605:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66112:x1869759501401728:12345-0@lo:1000:mdt00_000.0 Request processed in 62us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144419.747612:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:3.0:1783144419.747630:0:66112:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66112:1869759501401728:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783144419.747665:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423049407 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747674:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423049407 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747681:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423049407 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144419.747699:0:66112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423049407 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747709:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747713:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747744:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747762:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747768:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144419.747772:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747780:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747791:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2af565c300) 00010000:00010000:3.0:1783144419.747793:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144419.747796:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747800:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230493f9 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747808:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747812:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747815:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747819:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144419.747820:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747830:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747835:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c2ac6738e00) 00010000:00010000:3.0:1783144419.747836:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144419.747838:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747841:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150000/0xad8e53a423049400 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747861:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a4230493f2 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d9f expref: 11 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747880:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150600/0xad8e53a423049407 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d9f expref: 10 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.747887:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2ac6738500) 00010000:00010000:3.0:1783144419.747889:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783144419.747891:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150600, rc 0) 00000100:00100000:3.0:1783144419.747928:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71601:x1869759481720576:12345-192.168.203.4@tcp:101:bash.0 Request processed in 943us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144419.747934:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1310 00000100:00100000:3.0:1783144419.749004:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144419.749063:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720704 00000100:00100000:1.0:1783144419.749068:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720704 00000100:00100000:1.0:1783144419.749107:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1311 00000100:00100000:1.0:1783144419.749357:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:71601:x1869759481720704:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1783144419.749369:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144419.749383:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304940e lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41da6 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.749419:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049415 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.749429:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049415 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.749438:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049415 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144419.749486:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783144419.749490:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783144419.749519:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0800/0xad8e53a42304940e lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41da6 expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.749540:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049415 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41da6 expref: 11 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144419.749548:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd096900) 00010000:00010000:1.0:1783144419.749551:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783144419.749554:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0e00, rc 0) 00000100:00100000:1.0:1783144419.749624:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71601:x1869759481720704:12345-192.168.203.4@tcp:101:bash.0 Request processed in 509us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144419.749632:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1311 00000100:00100000:0.0:1783144419.752302:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144419.752357:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144419.752406:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720960 00000100:00100000:3.0:1783144419.752418:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720960 00000100:00100000:3.0:1783144419.752470:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 720 00000100:00100000:3.0:1783144419.752481:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2406:x1869759481720960:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783144419.752489:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481720832 00000100:00100000:2.0:1783144419.752494:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481720832 00010000:00010000:3.0:1783144419.752504:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144419.752524:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049415 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41da6 expref: 12 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144419.752539:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd096900) 00010000:00010000:3.0:1783144419.752543:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144419.752563:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1312 00000100:00100000:2.0:1783144419.752571:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71601:x1869759481720832:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1783144419.752582:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783144419.752583:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2406:x1869759481720960:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144419.752592:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 720 00010000:00010000:2.0:1783144419.752592:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031a00/0xad8e53a42304941c lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dad expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752636:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752653:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752660:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752671:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752676:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752680:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752749:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423049431 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752757:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423049431 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752763:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423049431 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144419.752798:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1783144419.752802:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144419.752819:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423049431 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752830:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423049431 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752848:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752854:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 2/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752860:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752866:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144419.752871:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752878:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752888:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c29cd096900) 00010000:00010000:2.0:1783144419.752890:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144419.752893:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752898:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031200/0xad8e53a423049423 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752907:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752913:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752920:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752931:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144419.752938:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752945:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752953:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9c29cd29e000) 00010000:00010000:2.0:1783144419.752955:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144419.752958:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752964:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031400/0xad8e53a42304942a lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.752991:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac0031a00/0xad8e53a42304941c lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dad expref: 12 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.753003:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2ac7517a00/0xad8e53a423049431 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dad expref: 11 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.753011:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2af71e9b00) 00010000:00010000:2.0:1783144419.753013:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144419.753015:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517a00, rc 0) 00000100:00100000:2.0:1783144419.753048:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:71601:x1869759481720832:12345-192.168.203.4@tcp:101:bash.0 Request processed in 478us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144419.753056:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1312 00000100:00100000:0.0:1783144419.754256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144419.754292:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721088 00000100:00100000:2.0:1783144419.754303:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721088 00000100:00100000:2.0:1783144419.754339:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4989 00000100:00100000:2.0:1783144419.754348:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2404:x1869759481721088:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:2.0:1783144419.754358:0:26143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144419.754379:0:26143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048210891/0xad8e53a423049438 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41db4 expref: -99 pid: 26143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144419.754399:0:26143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x244:0x0] initial LVB size: 0, mtime: 0x6a489fc9, atime: 0x6a489fc9, ctime: 0x6a489fc9, blocks: 0x0 00010000:00010000:2.0:1783144419.754410:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x244:0x0].0x0 since=2954s v=(0 0) 00010000:00010000:2.0:1783144419.754414:0:26143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144419.754421:0:26143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048210891/0xad8e53a423049438 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41db4 expref: 7 pid: 26143 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.754432:0:26143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048210891/0xad8e53a423049438 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41db4 expref: 7 pid: 26143 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144419.754451:0:26143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac7517400, rc 0) 00000100:00100000:2.0:1783144419.754480:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481721088:12345-192.168.203.4@tcp:101:bash.0 Request processed in 133us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144419.754487:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4989 00010000:00010000:2.0:1783144420.303562:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144420.365993:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501401856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144420.366062:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.366120:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401856 00000100:00100000:1.0:1783144420.366128:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401856 00000100:00100000:1.0:1783144420.366185:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:1.0:1783144420.366194:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501401856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144420.366231:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144420.366279:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759501401856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144420.366286:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00080000:1.0:1783144420.366447:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144420.366465:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501402368:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.366497:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.366516:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501402880:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.366549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.366597:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501401856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783144420.366611:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501401984:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.366619:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501403392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144420.366662:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144420.366663:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.366686:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783144420.366694:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501402240:0@lo:400:kworker.0 00000100:00100000:3.0:1783144420.366705:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501402496:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.366740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144420.366763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.366769:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501402752:0@lo:400:kworker.0 00000100:00100000:3.0:1783144420.366790:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501403008:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.366802:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.366825:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501403264:0@lo:400:kworker.0 00000100:00100000:3.0:1783144420.366828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144420.366855:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783144420.366861:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144420.366864:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501402112:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.366891:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501402880 00000100:00100000:1.0:1783144420.366895:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501402880 00000100:00100000:3.0:1783144420.366901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144420.366925:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501402624:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.366930:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501402752 00000100:00100000:1.0:1783144420.366935:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501402752 00000100:00100000:3.0:1783144420.366954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.366961:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:1.0:1783144420.366970:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501402880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.366977:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501402368 00000100:00100000:2.0:1783144420.366983:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501402368 00000100:00100000:3.0:1783144420.366991:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501403136:0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367015:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501402240 00000100:00100000:1.0:1783144420.367017:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501402880:12345-0@lo:400:kworker.0 Request processed in 47us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144420.367020:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501402240 00000100:00100000:3.0:1783144420.367026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.367028:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:2.0:1783144420.367043:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501402496 00000100:00100000:1.0:1783144420.367047:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403136 00000100:00100000:2.0:1783144420.367048:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501402496 00000100:00100000:1.0:1783144420.367054:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403136 00000100:00100000:3.0:1783144420.367066:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403008 00000100:00100000:3.0:1783144420.367071:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403008 00000100:00100000:2.0:1783144420.367073:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403264 00000100:00100000:2.0:1783144420.367085:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403264 00000100:00100000:1.0:1783144420.367086:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1783144420.367097:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501402752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144420.367098:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501402112 00000100:00100000:3.0:1783144420.367110:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501402112 00000100:00100000:2.0:1783144420.367117:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1783144420.367130:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501402752:12345-0@lo:400:kworker.0 Request processed in 34us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144420.367137:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:3.0:1783144420.367140:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1783144420.367165:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501402240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.367165:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1783144420.367178:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501403136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144420.367218:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501402240:12345-0@lo:400:kworker.0 Request processed in 57us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144420.367228:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501403136:12345-0@lo:400:kworker.0 Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144420.367235:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501402368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144420.367241:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1783144420.367241:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1783144420.367266:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1783144420.367269:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403392 00000100:00100000:1.0:1783144420.367275:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403392 00000100:00100000:3.0:1783144420.367276:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501402496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367291:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501402368:12345-0@lo:400:kworker.0 Request processed in 164us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144420.367299:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1783144420.367303:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501402624 00000100:00100000:1.0:1783144420.367307:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501402624 00000100:00100000:3.0:1783144420.367318:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501402496:12345-0@lo:400:kworker.0 Request processed in 43us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144420.367323:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1783144420.367332:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:2.0:1783144420.367337:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501403008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783144420.367353:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1783144420.367362:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501403264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367377:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501403008:12345-0@lo:400:kworker.0 Request processed in 44us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144420.367383:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1783144420.367402:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1783144420.367403:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501403264:12345-0@lo:400:kworker.0 Request processed in 39us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144420.367413:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1783144420.367413:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501402112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367463:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869759501402112:12345-0@lo:400:kworker.0 Request processed in 54us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144420.367469:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1783144420.367495:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501401984 00000100:00100000:2.0:1783144420.367499:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501401984 00000100:00100000:2.0:1783144420.367524:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783144420.367530:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501401984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367560:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501401984:12345-0@lo:400:kworker.0 Request processed in 30us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144420.367566:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783144420.367575:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:1.0:1783144420.367586:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501403392:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144420.367595:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000004:00000024:1.0:1783144420.367605:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1783144420.367607:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501402624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.367645:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501403392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144420.367653:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1783144420.367658:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501402624:12345-0@lo:400:kworker.0 Request processed in 53us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144420.367666:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00080000:1.0:1783144420.367685:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144420.367690:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783144420.367693:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783144420.367696:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144420.367743:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1869759501402112:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.367801:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501402624:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.367814:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501403136:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.367823:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501401984:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.367832:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501402496:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.367842:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501403008:0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367906:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501402240:0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367922:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501402752:0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367946:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501403264:0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367957:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501403392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144420.367966:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501402368:0@lo:400:kworker.0 00000100:00100000:2.0:1783144420.367973:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501402880:0@lo:400:kworker.0 00000100:00100000:1.0:1783144420.368316:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501403520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144420.368339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144420.368364:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144420.368370:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501403648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144420.368398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144420.368419:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403520 00000100:00100000:3.0:1783144420.368425:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403520 00000100:00100000:0.0:1783144420.368454:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403648 00000100:00100000:0.0:1783144420.368460:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403648 00000100:00100000:0.0:1783144420.368487:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1783144420.368494:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501403648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783144420.368511:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444917248 avail 1298677760 00000100:00100000:3.0:1783144420.368536:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1783144420.368545:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501403648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144420.368551:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501403520:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783144420.368561:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00002000:00000024:3.0:1783144420.368565:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144420.368610:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501403520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144420.368612:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501403648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144420.368624:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1783144420.368634:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501403520:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1783144420.373477:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968830 is committed 00010000:00010000:2.0:1783144421.326142:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144421.478531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144421.479085:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721216 00000100:00100000:2.0:1783144421.479094:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721216 00000100:00100000:2.0:1783144421.479132:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1783144421.479139:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2403:x1869759481721216:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144421.479194:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2403:x1869759481721216:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 56us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144421.479199:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:2.0:1783144421.479517:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144421.480048:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144421.480367:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144421.480398:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144421.480440:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721600 00000100:00100000:2.0:1783144421.480445:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721600 00000100:00100000:2.0:1783144421.480482:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721728 00000100:00100000:2.0:1783144421.480485:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721728 00000100:00100000:2.0:1783144421.480503:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2096 00000100:00100000:2.0:1783144421.480510:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481721600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144421.480543:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481721600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144421.480559:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2096 00000100:00100000:2.0:1783144421.480574:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2097 00000100:00100000:2.0:1783144421.480580:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481721728:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144421.480606:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481721728:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144421.480612:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2097 00000100:00080000:2.0:1783144421.480652:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144421.480657:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144421.481174:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721344 00000100:00100000:3.0:1783144421.481179:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721344 00000100:00100000:3.0:1783144421.481231:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721472 00000100:00100000:3.0:1783144421.481234:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721472 00000100:00100000:3.0:1783144421.481260:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 873 00000100:00100000:3.0:1783144421.481268:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2404:x1869759481721344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144421.481305:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2404:x1869759481721344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 39us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144421.481312:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 873 00000100:00100000:3.0:1783144421.481326:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 874 00000100:00100000:3.0:1783144421.481333:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2403:x1869759481721472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:2.0:1783144421.481334:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783144421.481338:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144421.481360:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2403:x1869759481721472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144421.481367:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 874 00010000:00010000:1.0:1783144422.350026:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144422.925928:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501403776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783144422.926023:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501403904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144422.926052:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144422.926089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144422.926158:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403776 00000100:00100000:1.0:1783144422.926166:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403776 00000100:00100000:2.0:1783144422.926170:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501403904 00000100:00100000:2.0:1783144422.926177:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501403904 00000100:00100000:2.0:1783144422.926259:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00080000:3.0:1783144422.926260:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783144422.926265:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144422.926343:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501403904:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144422.926352:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:1.0:1783144422.926362:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501403776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144422.926371:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1783144422.926381:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144422.926451:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501403904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 183us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144422.926460:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:0.0:1783144422.926484:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501403904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144422.926497:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501403776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144422.926600:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501403776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 240us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144422.926607:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000020:00000080:2.0:1783144423.021217:0:95099:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc3b9b8630 20000000:00000080:2.0:1783144423.021231:0:95099:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c29c45ac000 uarg=0000000000000000 00000040:00100000:2.0:1783144423.022961:0:95099:0:(llog.c:1067:llog_reverse_process()) index 57 : idx 49 20000000:01000000:2.0:1783144423.022967:0:95099:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:2.0:1783144423.022981:0:95099:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1783144423.023396:0:95100:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 55 marker 43 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1783144423.023482:0:95100:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 57 marker 43 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783144423.023505:0:95100:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:2.0:1783144423.023705:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:2.0:1783144423.023752:0:95099:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1783144423.023771:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:2.0:1783144423.023792:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:2.0:1783144423.023820:0:95099:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1783144423.024512:0:95101:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 44 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1783144423.024543:0:95101:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 44 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783144423.024555:0:95101:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:2.0:1783144423.024680:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:2.0:1783144423.024690:0:95099:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1783144423.024705:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:2.0:1783144423.024755:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:2.0:1783144423.024772:0:95099:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1783144423.026199:0:95102:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 45 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1783144423.026235:0:95102:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 45 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783144423.026246:0:95102:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:2.0:1783144423.026499:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:2.0:1783144423.026510:0:95099:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1783144423.026525:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:2.0:1783144423.026541:0:95099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:2.0:1783144423.026552:0:95099:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783144423.026569:0:95099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026585:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423048f84 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026592:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049064 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026599:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304909c expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026605:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 23 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026612:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026618:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026636:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304910c expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026642:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304911a expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026649:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049144 expref: 23 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026657:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 9 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026665:0:95099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 9 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026672:0:95099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026706:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 9 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026744:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 9 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.026758:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404032:192.168.203.4@tcp:104: 00010000:00010000:2.0:1783144423.026850:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 9 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026858:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 9 pid: 94183 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.026873:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ae4e9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404160:192.168.203.4@tcp:104: 00010000:00010000:2.0:1783144423.026905:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423049144 expref: 23 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026913:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423049144 expref: 23 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.026922:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404288:0@lo:104: 00000100:00100000:2.0:1783144423.026961:0:95099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144423.026990:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304911a expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.026998:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304911a expref: 23 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027005:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404416:0@lo:104: 00010000:00010000:2.0:1783144423.027024:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304910c expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.027031:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304910c expref: 23 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027037:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404544:0@lo:104: 00010000:00010000:2.0:1783144423.027054:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.027061:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 23 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027076:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404672:0@lo:104: 00010000:00010000:2.0:1783144423.027113:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.027121:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 23 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027129:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404800:0@lo:104: 00010000:00010000:2.0:1783144423.027151:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 23 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.027160:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 23 pid: 94185 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027168:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404928:0@lo:104: 00010000:00010000:2.0:1783144423.027187:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304909c expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.027194:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304909c expref: 23 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027201:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501405056:0@lo:104: 00010000:00010000:2.0:1783144423.027220:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423049064 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.027227:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423049064 expref: 23 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027246:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501405184:0@lo:104: 00010000:00010000:2.0:1783144423.027267:0:95099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423048f84 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.027274:0:95099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423048f84 expref: 23 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027282:0:95099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa945f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501405312:0@lo:104: 00000100:00100000:2.0:1783144423.027295:0:95099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2afa847900 going to sleep for 11 seconds 00000100:00100000:0.0:1783144423.027369:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783144423.027389:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144423.027416:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144423.027441:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144423.027459:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144423.027467:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144423.027478:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144423.027490:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144423.027493:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501404288 00000100:00100000:3.0:1783144423.027500:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501404288 00000100:00100000:1.0:1783144423.027505:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:0.0:1783144423.027505:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501404416 00000100:00100000:0.0:1783144423.027511:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501404416 00000100:00100000:1.0:1783144423.027530:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144423.027542:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501404544 00000100:00100000:3.0:1783144423.027547:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501404672 00000100:00100000:0.0:1783144423.027547:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501404544 00000100:00100000:1.0:1783144423.027549:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501404800 00000100:00100000:3.0:1783144423.027554:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501404672 00000100:00100000:1.0:1783144423.027555:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501404800 00000100:00100000:0.0:1783144423.027564:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501404928 00000100:00100000:0.0:1783144423.027569:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501404928 00000100:00100000:3.0:1783144423.027582:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405056 00000100:00100000:1.0:1783144423.027588:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405184 00000100:00100000:0.0:1783144423.027590:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405312 00000100:00100000:3.0:1783144423.027592:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405056 00000100:00100000:1.0:1783144423.027594:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405184 00000100:00100000:0.0:1783144423.027595:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405312 00000100:00100000:3.0:1783144423.027626:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1783144423.027634:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:95099:x1869759501404416:12345-0@lo:104: 00000100:00100000:1.0:1783144423.027643:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00010000:00010000:3.0:1783144423.027644:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.027656:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac2ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:95099:x1869759501404288:12345-0@lo:104: 00000100:00100000:2.0:1783144423.027663:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00010000:00010000:1.0:1783144423.027667:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.027682:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:95099:x1869759501404544:12345-0@lo:104: 00010000:00010000:3.0:1783144423.027691:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1783144423.027693:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.027699:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+11:95099:x1869759501404416:12345-0@lo:104: Request processed in 65us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.027711:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1783144423.027745:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00010000:00010000:1.0:1783144423.027748:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783144423.027751:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:95099:x1869759501404672:12345-0@lo:104: 00010000:00010000:3.0:1783144423.027757:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.027764:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac2ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:95099:x1869759501404288:12345-0@lo:104: Request processed in 109us (801us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144423.027769:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783144423.027774:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1783144423.027779:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+10:95099:x1869759501404544:12345-0@lo:104: Request processed in 105us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144423.027788:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00010000:3.0:1783144423.027793:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783144423.027799:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+9:95099:x1869759501404672:12345-0@lo:104: Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.027805:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1783144423.027815:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1783144423.027827:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95099:x1869759501404800:12345-0@lo:104: 00000100:00100000:3.0:1783144423.027829:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1783144423.027837:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95099:x1869759501404928:12345-0@lo:104: 00000100:00100000:1.0:1783144423.027843:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00010000:00010000:2.0:1783144423.027844:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.027845:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.027857:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95099:x1869759501405056:12345-0@lo:104: 00010000:00010000:1.0:1783144423.027871:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.027882:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783144423.027890:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95099:x1869759501404928:12345-0@lo:104: Request processed in 53us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.027897:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00010000:2.0:1783144423.027902:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1783144423.027913:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95099:x1869759501404800:12345-0@lo:104: Request processed in 89us (451us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144423.027914:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1783144423.027924:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:95099:x1869759501405056:12345-0@lo:104: Request processed in 72us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.027927:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1783144423.027939:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac75c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:95099:x1869759501405184:12345-0@lo:104: 00000100:00100000:2.0:1783144423.027944:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00010000:3.0:1783144423.027951:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.027951:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1783144423.027967:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783144423.027978:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:95099:x1869759501405312:12345-0@lo:104: 00010000:00010000:1.0:1783144423.027985:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783144423.027987:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.027992:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.027996:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1783144423.028007:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac75c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:95099:x1869759501405184:12345-0@lo:104: Request processed in 68us (515us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144423.028008:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517200 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144423.028015:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.028020:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:2.0:1783144423.028028:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00010000:00010000:1.0:1783144423.028031:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.028038:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:95099:x1869759501405312:12345-0@lo:104: Request processed in 61us (506us total) trans 0 rc 0/0 10000000:00010000:1.0:1783144423.028042:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.028050:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 10000000:01000000:1.0:1783144423.028052:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144423.028077:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783144423.028079:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783144423.028083:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028084:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028086:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028105:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6f400 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:2.0:1783144423.028106:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7516800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:3.0:1783144423.028111:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144423.028113:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028125:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144423.028135:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028135:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028149:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144423.028154:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144423.028156:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028169:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517200/0xad8e53a42304911a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049121 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144423.028178:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783144423.028184:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144423.028191:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783144423.028196:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028199:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028206:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028207:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6fe00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144423.028213:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028215:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144423.028226:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144423.028231:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028233:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028247:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144423.028249:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028250:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7516800/0xad8e53a42304910c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049113 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144423.028268:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144423.028277:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783144423.028285:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028288:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028296:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00a00 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:3.0:1783144423.028297:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f400/0xad8e53a423049144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304914b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028298:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1783144423.028303:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028309:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028319:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783144423.028325:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028327:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028328:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6fe00/0xad8e53a4230490f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028334:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e000 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:3.0:1783144423.028338:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144423.028348:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028360:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144423.028360:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783144423.028362:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783144423.028370:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144423.028375:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028379:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00800 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:2.0:1783144423.028382:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144423.028386:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144423.028387:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144423.028400:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144423.028404:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028410:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028410:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144423.028412:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028443:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144423.028443:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00a00/0xad8e53a4230490b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490bf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144423.028444:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783144423.028454:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028459:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783144423.028466:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e000/0xad8e53a4230490e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028466:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028471:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028488:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144423.028490:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af9f6e400 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:3.0:1783144423.028493:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1783144423.028498:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028499:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028506:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028523:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00800/0xad8e53a42304909c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490a3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028524:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac7517c00 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:2.0:1783144423.028524:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783144423.028531:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144423.028548:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028550:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144423.028551:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.028555:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144423.028559:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783144423.028564:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1783144423.028569:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144423.028575:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144423.028587:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028594:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783144423.028597:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028602:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.028605:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501405440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144423.028607:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144423.028614:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e400/0xad8e53a423049064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304906b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028617:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.028634:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2ac7517c00/0xad8e53a423048f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423048f8b expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.028636:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144423.028640:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144423.028645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144423.028646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783144423.028653:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144423.028656:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144423.028660:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783144423.028669:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144423.028678:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404288:0@lo:104: 00000100:00100000:1.0:1783144423.028678:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501405952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144423.028682:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501405568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.028699:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404416:0@lo:104: 00000100:00100000:2.0:1783144423.028712:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404544:0@lo:104: 00000100:00100000:3.0:1783144423.028745:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501405696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144423.028748:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144423.028760:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404672:0@lo:104: 00000100:00100000:2.0:1783144423.028774:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404800:0@lo:104: 00000100:00100000:3.0:1783144423.028783:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144423.028788:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404928:0@lo:104: 00000100:00100000:1.0:1783144423.028790:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501406464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144423.028807:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501406208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.028808:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501405056:0@lo:104: 00000100:00100000:2.0:1783144423.028824:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa947480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501405184:0@lo:104: 00000100:00100000:1.0:1783144423.028830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144423.028837:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144423.028841:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa945f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501405312:0@lo:104: 00000100:00100000:3.0:1783144423.028866:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783144423.028872:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501405824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144423.028883:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405440 00000100:00100000:1.0:1783144423.028889:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405440 00000100:00100000:3.0:1783144423.028894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144423.028909:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304911a expref: 24 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.028923:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501406336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144423.028927:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405952 00000100:00100000:1.0:1783144423.028931:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405952 00010000:00010000:1.0:1783144423.028947:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 25 pid: 94185 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.028955:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144423.028969:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405696 00000100:00100000:1.0:1783144423.028973:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405696 00010000:00010000:1.0:1783144423.028985:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049144 expref: 26 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.028987:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406464 00000100:00100000:3.0:1783144423.028992:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406464 00000100:00100000:1.0:1783144423.029007:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406208 00010000:00010000:3.0:1783144423.029009:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048f84 expref: 27 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.029009:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405824 00000100:00100000:1.0:1783144423.029012:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406208 00000100:00100000:2.0:1783144423.029016:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405824 00000100:00100000:3.0:1783144423.029031:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406336 00010000:00010000:1.0:1783144423.029033:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304909c expref: 29 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.029035:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406336 00010000:00010000:2.0:1783144423.029041:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 29 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.029049:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049064 expref: 30 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.029059:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:1.0:1783144423.029070:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+30:3648:x1869759501405440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.029074:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:3.0:1783144423.029082:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:2.0:1783144423.029087:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+30:3648:x1869759501405952:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144423.029092:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+30:3650:x1869759501405696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144423.029092:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144423.029097:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144423.029101:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304911a expref: 30 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.029102:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144423.029105:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 30 pid: 94185 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.029108:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049144 expref: 30 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.029133:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 30 pid: 94185 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.029145:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423049144 expref: 30 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029156:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304911a expref: 30 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.029172:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516c00/0xad8e53a42304914b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423049144 expref: 30 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029178:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6f200/0xad8e53a423049121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304911a expref: 30 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029206:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144423.029207:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144423.029235:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01600/0xad8e53a4230490bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230490b8 expref: 28 pid: 94185 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.029248:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144423.029252:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+27:3650:x1869759501405696:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144423.029258:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+27:3648:x1869759501405440:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.029264:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1783144423.029274:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:2.0:1783144423.029283:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+26:3648:x1869759501405952:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.029290:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1783144423.029298:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3648:x1869759501406464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144423.029306:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144423.029311:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423048f84 expref: 25 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144423.029327:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501405440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144423.029344:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501405952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.029382:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1783144423.029394:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1783144423.029405:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501406208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.029409:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00010000:00010000:1.0:1783144423.029417:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144423.029430:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3650:x1869759501405824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144423.029435:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304909c expref: 24 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.029441:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144423.029446:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304909c expref: 24 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.029451:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 24 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029461:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6fc00/0xad8e53a4230490a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304909c expref: 24 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.029464:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 24 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029488:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144423.029491:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423048f84 expref: 23 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.029506:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1600/0xad8e53a4230490f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230490f0 expref: 23 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.029510:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517000/0xad8e53a423048f8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423048f84 expref: 23 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.029525:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3650:x1869759501406208:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (687us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144423.029531:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144423.029534:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144423.029536:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1783144423.029557:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1783144423.029566:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3650:x1869759501406336:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.029572:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3650:x1869759501405824:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.029583:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3648:x1869759501406464:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (753us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144423.029584:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144423.029589:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00010000:00010000:1.0:1783144423.029594:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049064 expref: 20 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.029599:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00010000:00010000:1.0:1783144423.029611:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423049064 expref: 19 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029625:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed01400/0xad8e53a42304906b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423049064 expref: 18 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144423.029629:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404032:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144423.029638:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144423.029641:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144423.029649:0:95099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ae4e9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95099:1869759501404160:192.168.203.4@tcp:104: 00000100:00100000:0.0:1783144423.029678:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501405568 00000100:00100000:0.0:1783144423.029684:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501405568 00000100:00100000:1.0:1783144423.029685:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:3650:x1869759501406336:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144423.029690:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501406080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144423.029697:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00010000:00010000:2.0:1783144423.029713:0:95099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.029743:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144423.029759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406080 00000100:00100000:1.0:1783144423.029765:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406080 00010000:00010000:1.0:1783144423.029783:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 18 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.029789:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501405824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144423.029806:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501406336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144423.029817:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1783144423.029821:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501405696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144423.029829:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:3649:x1869759501406080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144423.029841:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144423.029845:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 18 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029854:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 18 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029865:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7517800/0xad8e53a4230490e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230490e2 expref: 18 pid: 94184 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.029886:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144423.029910:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:3649:x1869759501406080:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144423.029915:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00010000:00010000:0.0:1783144423.029942:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304910c expref: 16 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144423.029971:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1783144423.029981:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:3649:x1869759501405568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144423.029989:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144423.029993:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304910c expref: 16 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144423.030003:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304910c expref: 16 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.030010:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501406464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783144423.030016:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00400/0xad8e53a423049113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304910c expref: 16 pid: 94188 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144423.030027:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144423.030054:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:3649:x1869759501405568:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144423.030061:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:3.0:1783144423.030091:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501406208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.030120:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144423.030135:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501405568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144423.030147:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501406080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.030157:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144423.030158:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721856 00000100:00100000:1.0:1783144423.030163:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721856 00000100:00100000:3.0:1783144423.030176:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481721984 00000100:00100000:3.0:1783144423.030182:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481721984 00010000:00010000:1.0:1783144423.030183:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 10 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030201:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 11 pid: 94183 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144423.030214:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2586 00000100:00100000:1.0:1783144423.030225:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2404:x1869759481721856:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783144423.030227:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2587 00010000:00010000:1.0:1783144423.030238:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144423.030244:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2404:x1869759481721984:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144423.030248:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 11 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.030261:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 11 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.030271:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98fe00/0xad8e53a423049167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d6e expref: 11 pid: 94189 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144423.030280:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144423.030313:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481721856:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 92us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144423.030320:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2586 00010000:00010000:3.0:1783144423.030328:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144423.030336:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 9 pid: 94183 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030349:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 9 pid: 94183 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030361:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afa98fc00/0xad8e53a423049159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d60 expref: 9 pid: 94183 timeout: 3057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030371:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030379:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030392:0:10343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030400:0:10343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030417:0:10343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030435:0:10343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030440:0:10343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:3.0:1783144423.030548:0:10343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030557:0:10343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030572:0:10343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144423.030581:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144423.030596:0:95099:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144423.030615:0:95099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.030617:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:2404:x1869759481721984:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 377us (462us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144423.030632:0:95099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac0031200/0xad8e53a42304943f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144423.030633:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2587 00010000:00010000:1.0:1783144423.373992:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144424.290344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144424.290408:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481722112 00000100:00100000:3.0:1783144424.290427:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481722112 00000100:00100000:3.0:1783144424.290481:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:3.0:1783144424.290491:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481722112:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.290506:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.290524:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dbb expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.290548:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.290571:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.290580:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151000, rc 0) 00000100:00100000:3.0:1783144424.290630:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481722112:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 141us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.290637:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:0.0:1783144424.291944:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144424.291987:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481722240 00000100:00100000:3.0:1783144424.291992:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481722240 00000100:00100000:3.0:1783144424.292030:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:3.0:1783144424.292037:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481722240:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.292154:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481722240:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 117us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.292162:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1783144424.293130:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144424.293166:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481722368 00000100:00100000:3.0:1783144424.293171:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481722368 00000100:00100000:3.0:1783144424.293207:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:3.0:1783144424.293215:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481722368:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.293307:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481722368:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.293315:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:1.0:1783144424.295149:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144424.295270:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481722496 00000100:00100000:3.0:1783144424.295277:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481722496 00000100:00100000:3.0:1783144424.295324:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:3.0:1783144424.295333:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73182:x1869759481722496:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783144424.295469:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73182:x1869759481722496:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 136us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.295477:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:0.0:1783144424.297236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144424.297297:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481722624 00000100:00100000:2.0:1783144424.297304:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481722624 00000100:00100000:2.0:1783144424.297355:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1783144424.297365:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73182:x1869759481722624:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783144424.297492:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73182:x1869759481722624:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 128us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.297500:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1783144424.299147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144424.299269:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481722752 00000100:00100000:3.0:1783144424.299286:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481722752 00000100:00100000:3.0:1783144424.299335:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:3.0:1783144424.299344:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481722752:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.299356:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.299383:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dc2 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.299420:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 10 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.299431:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 10 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.299439:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151800, rc 0) 00000100:00100000:3.0:1783144424.299488:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481722752:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 144us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.299500:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:1.0:1783144424.301476:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144424.301534:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481722880 00000100:00100000:3.0:1783144424.301542:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481722880 00000100:00100000:3.0:1783144424.301592:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:3.0:1783144424.301602:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481722880:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.301694:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481722880:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 93us (223us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144424.301713:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00010000:00010000:2.0:1783144424.398941:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783144424.526355:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783144424.526362:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c29c5808800 from 58 10000000:01000000:1.0:1783144424.526367:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783144424.526419:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.526431:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.526442:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144424.526465:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501406592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.526533:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.526580:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.526746:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406592 00000100:00100000:2.0:1783144424.526755:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406592 00000100:00100000:2.0:1783144424.526812:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783144424.526821:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501406592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144424.526834:0:94183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144424.526845:0:94183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049454 expref: -99 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144424.526863:0:94183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049454 expref: 16 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144424.526884:0:94183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049454 expref: 16 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144424.526890:0:94183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac0031400, rc 0) 00000100:00100000:2.0:1783144424.526927:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501406592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.526931:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783144424.527092:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501406592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144424.527106:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.527115:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144424.527167:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501406720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.527189:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.527215:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144424.527319:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406720 00000100:00100000:0.0:1783144424.527323:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406720 00000100:00100000:0.0:1783144424.527382:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783144424.527389:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501406720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.527508:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501406720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.527515:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783144424.527571:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501406720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.527605:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501406848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.527644:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144424.528982:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406848 00000100:00100000:3.0:1783144424.528993:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406848 00000100:00100000:1.0:1783144424.529008:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.529038:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783144424.529046:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501406848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.529157:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501406848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.529165:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783144424.529185:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501406848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.530323:0:95103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95103:1869759501406976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.530372:0:95103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.530405:0:95103:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.530470:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501406976 00000100:00100000:3.0:1783144424.530475:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501406976 00000100:00100000:3.0:1783144424.530510:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783144424.530517:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95103:x1869759501406976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.531221:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95103:x1869759501406976:12345-0@lo:502:llog_process_th.0 Request processed in 703us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.531230:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783144424.531316:0:95103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95103:1869759501406976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.531357:0:95103:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95103:1869759501407104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.531392:0:95103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.531470:0:95103:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac81cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.531505:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501407104 00000100:00100000:2.0:1783144424.531511:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501407104 00000100:00100000:2.0:1783144424.531547:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783144424.531554:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95103:x1869759501407104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144424.531665:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95103:x1869759501407104:12345-0@lo:502:llog_process_th.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.531672:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783144424.531901:0:95103:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95103:1869759501407104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144424.531921:0:95103:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1783144424.532229:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1783144424.532254:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144424.532264:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.532275:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144424.532284:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783144424.532287:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:0.0:1783144424.532290:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783144424.532312:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.532320:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.532329:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.532342:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.532372:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.532399:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.532460:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501407232 00000100:00100000:3.0:1783144424.532465:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501407232 00000100:00100000:3.0:1783144424.532532:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783144424.532540:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501407232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.532548:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.532560:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049462 expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.532578:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049462 expref: 17 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.532588:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049462 expref: 17 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.532604:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150000, rc 0) 00000100:00100000:3.0:1783144424.532638:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501407232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.532645:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783144424.532715:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144424.532750:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.532764:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.532810:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.532836:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.533050:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.533167:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501407360 00000100:00100000:2.0:1783144424.533172:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501407360 00000100:00100000:2.0:1783144424.533204:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783144424.533212:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501407360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144424.533308:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501407360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.533315:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783144424.533425:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.533452:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.533489:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.533517:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af79cbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144424.533535:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501407488 00000100:00100000:0.0:1783144424.533539:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501407488 00000100:00100000:0.0:1783144424.533578:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783144424.533585:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501407488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.533663:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501407488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.533671:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783144424.533691:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144424.534048:0:95104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95104:1869759501407616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144424.534084:0:95104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144424.534111:0:95104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.534123:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501407616 00000100:00100000:3.0:1783144424.534128:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501407616 00000100:00100000:3.0:1783144424.534158:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783144424.534164:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95104:x1869759501407616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.534267:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95104:x1869759501407616:12345-0@lo:502:llog_process_th.0 Request processed in 101us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.534274:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783144424.534458:0:95104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95104:1869759501407616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144424.534483:0:95104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144424.534492:0:95104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144424.534495:0:95104:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1783144424.534500:0:95104:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1783144424.534516:0:95104:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:2.0:1783144424.535055:0:95104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95104:1869759501407744:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783144424.535094:0:95105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c5808800 from lustre-MDT0000, refs=4 00000100:00100000:2.0:1783144424.535096:0:95104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1783144424.535101:0:95105:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c29c5808800 4 00000100:00100000:2.0:1783144424.535136:0:95104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.535199:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501407744 00000100:00100000:3.0:1783144424.535206:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501407744 00000100:00100000:3.0:1783144424.535241:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783144424.535248:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95104:x1869759501407744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.535321:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95104:x1869759501407744:12345-0@lo:502:llog_process_th.0 Request processed in 72us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.535329:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783144424.535444:0:95104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95104:1869759501407744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144424.535462:0:95104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144424.535467:0:95104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144424.535469:0:95104:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783144424.535473:0:95104:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:3.0:1783144424.535573:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:3.0:1783144424.535589:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783144424.535595:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.535603:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783144424.535629:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783144424.535631:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 58 10000000:01000000:3.0:1783144424.535633:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783144424.535654:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.535660:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.535668:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144424.535681:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.535706:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.535861:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501407872 00000100:00100000:1.0:1783144424.535866:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501407872 00000100:00100000:3.0:1783144424.535877:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783144424.535901:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783144424.535909:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501407872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144424.535917:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144424.535928:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049470 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.535947:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049470 expref: 18 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.535956:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049470 expref: 18 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.535970:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1000, rc 0) 00000100:00100000:1.0:1783144424.536007:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501407872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144424.536014:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783144424.536050:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501407872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.536062:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.536071:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144424.536112:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.536132:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144424.536151:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144424.536174:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408000 00000100:00100000:0.0:1783144424.536179:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408000 00000100:00100000:0.0:1783144424.536206:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783144424.536214:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501408000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.536313:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501408000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.536330:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783144424.536354:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.536382:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.536425:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144424.536444:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144424.536824:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408128 00000100:00100000:0.0:1783144424.536829:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408128 00000100:00100000:0.0:1783144424.537017:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783144424.537030:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501408128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.537134:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501408128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.537141:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783144424.537990:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.539492:0:95106:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95106:1869759501408256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.539553:0:95106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144424.539586:0:95106:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1783144424.539590:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408256 00000100:00100000:1.0:1783144424.539597:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408256 00000100:00100000:1.0:1783144424.539893:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783144424.539903:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95106:x1869759501408256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.540010:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95106:x1869759501408256:12345-0@lo:502:llog_process_th.0 Request processed in 107us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144424.540018:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783144424.540034:0:95106:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95106:1869759501408256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.540070:0:95106:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95106:1869759501408384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.540093:0:95106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144424.540114:0:95106:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac91f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1783144424.540178:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408384 00000100:00100000:0.0:1783144424.540183:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408384 00000100:00100000:0.0:1783144424.540215:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783144424.540221:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95106:x1869759501408384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144424.540307:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95106:x1869759501408384:12345-0@lo:502:llog_process_th.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.540314:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783144424.540357:0:95106:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95106:1869759501408384:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144424.540377:0:95106:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1783144424.541219:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1783144424.541240:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144424.541249:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.541260:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144424.541268:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783144424.541271:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:0.0:1783144424.541279:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783144424.541304:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.541318:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.541329:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.541344:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.541372:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.541400:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.541623:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408512 00000100:00100000:2.0:1783144424.541629:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408512 00000100:00100000:2.0:1783144424.541665:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783144424.541673:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501408512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144424.541681:0:94183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144424.541694:0:94183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304947e expref: -99 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144424.541714:0:94183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304947e expref: 19 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144424.541778:0:94183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304947e expref: 19 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144424.541786:0:94183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac0031200, rc 0) 00000100:00100000:2.0:1783144424.541833:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501408512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.541840:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783144424.542109:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144424.542132:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.542141:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.542187:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.542210:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.542238:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.542327:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408640 00000100:00100000:3.0:1783144424.542331:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408640 00000100:00100000:3.0:1783144424.542361:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783144424.542367:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501408640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.542552:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501408640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.542559:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783144424.542693:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.542717:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.542765:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.542825:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.542852:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408768 00000100:00100000:3.0:1783144424.542856:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408768 00000100:00100000:3.0:1783144424.542880:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783144424.542886:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501408768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.542987:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501408768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.542994:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783144424.543064:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501408768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144424.543535:0:95107:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95107:1869759501408896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144424.543572:0:95107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144424.543628:0:95107:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783144424.543660:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501408896 00000100:00100000:0.0:1783144424.543669:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501408896 00000100:00100000:0.0:1783144424.543785:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783144424.543793:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95107:x1869759501408896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144424.543909:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95107:x1869759501408896:12345-0@lo:502:llog_process_th.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.543916:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783144424.544004:0:95107:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95107:1869759501408896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144424.544026:0:95107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144424.544036:0:95107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144424.544039:0:95107:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1783144424.544044:0:95107:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1783144424.544058:0:95107:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:2.0:1783144424.544075:0:95107:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95107:1869759501409024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144424.544105:0:95107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144424.544140:0:95107:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6265600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.544185:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409024 00000100:00100000:3.0:1783144424.544189:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409024 00000100:00100000:3.0:1783144424.544217:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783144424.544224:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95107:x1869759501409024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.544310:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95107:x1869759501409024:12345-0@lo:502:llog_process_th.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.544316:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783144424.544345:0:95107:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95107:1869759501409024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144424.544372:0:95107:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144424.544377:0:95107:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144424.544379:0:95107:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1783144424.544551:0:95107:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:0.0:1783144424.544620:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:0.0:1783144424.544646:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783144424.544655:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.544666:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144424.544674:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783144424.544677:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 58 10000000:01000000:0.0:1783144424.544679:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783144424.544698:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.544706:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.544715:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.544814:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.544841:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.544857:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.544907:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409152 00000100:00100000:3.0:1783144424.544911:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409152 00000100:00100000:3.0:1783144424.544938:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783144424.544945:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501409152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.544952:0:94185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.544963:0:94185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304948c expref: -99 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.544978:0:94185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304948c expref: 20 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.544987:0:94185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304948c expref: 20 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.544994:0:94185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150e00, rc 0) 00000100:00100000:3.0:1783144424.545866:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501409152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 919us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.545938:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144424.545953:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.545962:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.546009:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.546041:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.546100:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.546124:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783144424.546144:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409280 00000100:00100000:3.0:1783144424.546148:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409280 00000100:00100000:2.0:1783144424.546185:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783144424.546194:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501409280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144424.546395:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501409280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.546401:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783144424.546522:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.546546:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.546577:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.546630:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.546656:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409408 00000100:00100000:3.0:1783144424.546660:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409408 00000100:00100000:3.0:1783144424.546747:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783144424.546754:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501409408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.546821:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501409408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.546828:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783144424.546910:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.547158:0:95108:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95108:1869759501409536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.547207:0:95108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.547231:0:95108:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6265600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.547240:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409536 00000100:00100000:2.0:1783144424.547245:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409536 00000100:00100000:2.0:1783144424.547354:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783144424.547361:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95108:x1869759501409536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144424.547442:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95108:x1869759501409536:12345-0@lo:502:llog_process_th.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.547457:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783144424.547470:0:95108:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95108:1869759501409536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.547506:0:95108:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95108:1869759501409664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.547529:0:95108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.547541:0:95108:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac85eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.547550:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409664 00000100:00100000:2.0:1783144424.547555:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409664 00000100:00100000:2.0:1783144424.547619:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783144424.547626:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95108:x1869759501409664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144424.547695:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95108:x1869759501409664:12345-0@lo:502:llog_process_th.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.547701:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783144424.547935:0:95108:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95108:1869759501409664:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144424.547955:0:95108:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1783144424.548169:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1783144424.548188:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783144424.548196:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.548205:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144424.548213:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783144424.548215:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1783144424.548218:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783144424.548237:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.548254:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.548262:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.548336:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.548362:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.548431:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.548465:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409792 00000100:00100000:3.0:1783144424.548469:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409792 00000100:00100000:3.0:1783144424.548527:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783144424.548535:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501409792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.548542:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.548552:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304949a expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.548568:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304949a expref: 21 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.548576:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304949a expref: 21 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.548583:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151200, rc 0) 00000100:00100000:3.0:1783144424.548616:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501409792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.548622:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783144424.548639:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144424.548649:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.548656:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144424.548686:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.548705:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.548822:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6265600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.548845:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501409920 00000100:00100000:2.0:1783144424.548850:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501409920 00000100:00100000:2.0:1783144424.548906:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783144424.548913:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501409920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144424.548998:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501409920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.549006:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783144424.549013:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501409920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.549034:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.549060:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.549112:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6265600 going to sleep for 11 seconds 00000100:00100000:0.0:1783144424.549133:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410048 00000100:00100000:0.0:1783144424.549136:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410048 00000100:00100000:0.0:1783144424.549160:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783144424.549165:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501410048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.549288:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501410048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144424.549293:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783144424.549346:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144424.550092:0:95109:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783144424.550158:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783144424.550189:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783144424.550197:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.550207:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144424.550213:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783144424.550214:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 58 10000000:01000000:0.0:1783144424.550216:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783144424.550241:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.550249:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.550256:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.550280:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.550312:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144424.550365:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410176 00000100:00100000:3.0:1783144424.550370:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410176 00000100:00100000:0.0:1783144424.550376:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.550395:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783144424.550402:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501410176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.550419:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.550434:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230494a8 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.550450:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 22 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.550460:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 22 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.550467:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150c00, rc 0) 00000100:00100000:3.0:1783144424.550496:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501410176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.550503:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783144424.550512:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144424.550522:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.550530:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.550571:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.550595:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.550614:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.550637:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410304 00000100:00100000:3.0:1783144424.550641:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410304 00000100:00100000:3.0:1783144424.550664:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783144424.550670:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501410304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.550774:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501410304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.550781:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783144424.550796:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.550820:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.550852:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.550876:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823780 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.550934:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410432 00000100:00100000:3.0:1783144424.550938:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410432 00000100:00100000:3.0:1783144424.550968:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783144424.550975:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501410432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.551034:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501410432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.551039:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783144424.551113:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.551508:0:95110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95110:1869759501410560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144424.551534:0:95110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.551552:0:95110:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4823780 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.551605:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410560 00000100:00100000:2.0:1783144424.551609:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410560 00000100:00100000:2.0:1783144424.551638:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783144424.551645:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:95110:x1869759501410560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.551753:0:95110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95110:1869759501410560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.551796:0:95110:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95110:1869759501410688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144424.551826:0:95110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144424.551855:0:95110:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01574780 going to sleep for 11 seconds 00000100:00100000:1.0:1783144424.551871:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410688 00000100:00100000:1.0:1783144424.551875:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410688 00000100:00100000:1.0:1783144424.551905:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783144424.551912:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:95110:x1869759501410688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144424.551987:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:95110:x1869759501410688:12345-0@lo:502:llog_process_th.0 Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144424.551994:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783144424.552103:0:95110:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95110:1869759501410688:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783144424.552124:0:95110:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000100:00100000:2.0:1783144424.552220:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:95110:x1869759501410560:12345-0@lo:502:llog_process_th.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.552229:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000020:01000000:1.0:1783144424.552397:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1783144424.552425:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783144424.552433:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.552443:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144424.552452:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783144424.552455:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783144424.552457:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783144424.552473:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.552478:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.552484:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144424.552492:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.552513:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.552530:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac85eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.552546:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410816 00000100:00100000:3.0:1783144424.552550:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410816 00000100:00100000:3.0:1783144424.552581:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783144424.552588:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501410816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.552596:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.552607:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230494b6 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.552623:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.552630:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.552635:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150a00, rc 0) 00000100:00100000:3.0:1783144424.552662:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501410816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.552667:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783144424.552683:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144424.552695:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144424.552709:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144424.552934:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.552951:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.552972:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac85eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.552988:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501410944 00000100:00100000:3.0:1783144424.552992:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501410944 00000100:00100000:3.0:1783144424.553021:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783144424.553027:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501410944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144424.553118:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501410944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.553133:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783144424.553141:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501410944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.553164:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501411072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144424.553261:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144424.553314:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac85eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.553363:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411072 00000100:00100000:2.0:1783144424.553368:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411072 00000100:00100000:2.0:1783144424.553437:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783144424.553445:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501411072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144424.553527:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501411072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144424.553534:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783144424.553592:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501411072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144424.554637:0:95111:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783144424.554848:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783144424.554866:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783144424.554873:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.554883:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144424.554891:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783144424.554894:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:0.0:1783144424.554896:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783144424.554919:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.554927:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.554936:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.554951:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501411200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.554985:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.555052:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9680c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144424.555090:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411200 00000100:00100000:3.0:1783144424.555095:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411200 00000100:00100000:3.0:1783144424.555161:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783144424.555170:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501411200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144424.555187:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144424.555199:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230494c4 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.555216:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 24 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.555225:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 24 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144424.555232:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34e00, rc 0) 00000100:00100000:3.0:1783144424.555273:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501411200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144424.555279:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783144424.555336:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501411200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144424.555347:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.555355:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144424.555397:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501411328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144424.555432:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144424.555578:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af9680c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144424.555643:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411328 00000100:00100000:2.0:1783144424.555647:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411328 00000100:00100000:2.0:1783144424.555681:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783144424.555687:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501411328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144424.555773:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501411328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144424.555780:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783144424.556201:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501411328:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783144424.556225:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783144424.556231:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144424.556238:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.424856:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144425.485860:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501411456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144425.485918:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144425.485935:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501411584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144425.485944:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144425.485980:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144425.486000:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411456 00000100:00100000:3.0:1783144425.486007:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411456 00000100:00100000:1.0:1783144425.486025:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411584 00000100:00100000:1.0:1783144425.486031:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411584 00000100:00100000:3.0:1783144425.486055:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:3.0:1783144425.486066:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501411456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144425.486077:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:1.0:1783144425.486087:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501411584:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1783144425.486091:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000004:00000024:1.0:1783144425.486113:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444917248 avail 1298677760 00000100:00100000:3.0:1783144425.486136:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501411456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.486142:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00080000:3.0:1783144425.486161:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144425.486162:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501411584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144425.486171:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1783144425.486191:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501411456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144425.486235:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501411584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144425.486370:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783144425.486382:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501411712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144425.486433:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144425.486543:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411712 00000100:00100000:0.0:1783144425.486549:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411712 00000100:00100000:0.0:1783144425.486579:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1783144425.486587:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501411712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783144425.486605:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1783144425.486643:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501411712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144425.486648:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1783144425.486693:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501411712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144425.487000:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501411968:0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487029:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144425.487047:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501412480:0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487069:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144425.487301:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869759501412992:0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487334:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144425.487355:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783144425.487361:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501411840:0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487394:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144425.487434:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501412352:0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144425.487479:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501412864:0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144425.487536:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411968 00000100:00100000:1.0:1783144425.487541:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411968 00000100:00100000:1.0:1783144425.487581:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412992 00000100:00100000:1.0:1783144425.487584:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412992 00000100:00100000:1.0:1783144425.487603:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412352 00000100:00100000:1.0:1783144425.487606:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412352 00000100:00100000:1.0:1783144425.487626:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1783144425.487634:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869759501411968:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783144425.487647:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783144425.487652:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144425.487679:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869759501411968:12345-0@lo:400:kworker.0 Request processed in 45us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144425.487686:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1783144425.487703:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501411968:0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487705:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1783144425.487717:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869759501412992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.487784:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869759501412992:12345-0@lo:400:kworker.0 Request processed in 68us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144425.487791:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1783144425.487811:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1783144425.487912:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412480 00000100:00100000:2.0:1783144425.487916:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412480 00000100:00100000:0.0:1783144425.487923:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869759501412992:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.487954:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412864 00000100:00100000:2.0:1783144425.487958:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412864 00000100:00100000:0.0:1783144425.487963:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:0.0:1783144425.487972:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501412480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.487985:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:2.0:1783144425.487996:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501412864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144425.488007:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501412480:12345-0@lo:400:kworker.0 Request processed in 37us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144425.488012:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:0.0:1783144425.488040:0:3649:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968830 gen 2 00000100:00100000:2.0:1783144425.488045:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501412864:12345-0@lo:400:kworker.0 Request processed in 50us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144425.488051:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501412864:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488058:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1783144425.488064:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501412480:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488085:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501411840 00000100:00100000:2.0:1783144425.488089:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501411840 00000100:00100000:2.0:1783144425.488116:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783144425.488124:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501411840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488162:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501411840:12345-0@lo:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.488169:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783144425.488176:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501411840:0@lo:400:kworker.0 00000100:00080000:2.0:1783144425.488231:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144425.488271:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501412096:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.488318:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501412608:0@lo:400:kworker.0 00000100:00100000:0.0:1783144425.488324:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412096 00000100:00100000:0.0:1783144425.488328:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412096 00000100:00100000:2.0:1783144425.488341:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.488364:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501413120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783144425.488370:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1783144425.488377:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501412096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144425.488429:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501412096:12345-0@lo:400:kworker.0 Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144425.488437:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1783144425.488441:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501412096:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488454:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783144425.488461:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501412224:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488482:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.488503:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501412736:0@lo:400:kworker.0 00000100:00100000:0.0:1783144425.488503:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412224 00000100:00100000:0.0:1783144425.488508:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412224 00000100:00100000:0.0:1783144425.488530:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1783144425.488536:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144425.488541:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501412224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488565:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412608 00000100:00100000:2.0:1783144425.488570:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412608 00000100:00100000:0.0:1783144425.488591:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501412224:12345-0@lo:400:kworker.0 Request processed in 51us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144425.488600:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1783144425.488605:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:2.0:1783144425.488613:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501412608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144425.488616:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501412736 00000100:00100000:0.0:1783144425.488622:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501412736 00000100:00100000:0.0:1783144425.488646:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1783144425.488654:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501412608:12345-0@lo:400:kworker.0 Request processed in 40us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144425.488657:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501412736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.488666:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:2.0:1783144425.488693:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501413120 00000100:00100000:2.0:1783144425.488697:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501413120 00000100:00100000:0.0:1783144425.488702:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501412736:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144425.488714:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1783144425.488753:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1783144425.488761:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501413120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783144425.488778:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144425.488807:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501413120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144425.488999:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501412352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144425.489037:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501412352:12345-0@lo:400:kworker.0 Request processed in 1221us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144425.489044:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1783144425.489069:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501412352:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.489186:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00080000:2.0:1783144425.489206:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144425.489210:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783144425.489212:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144425.489231:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501412224:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.489242:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c9e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501412736:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.489250:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501412608:0@lo:400:kworker.0 00000100:00100000:2.0:1783144425.489267:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501413120:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1783144425.826927:0:95209:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd42035cb0 20000000:00000080:0.0:1783144425.826943:0:95209:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c29c47c6000 uarg=0000000000000000 00000040:00100000:0.0:1783144425.827513:0:95209:0:(llog.c:1067:llog_reverse_process()) index 60 : idx 49 20000000:01000000:0.0:1783144425.827519:0:95209:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1783144425.827532:0:95209:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1783144425.827983:0:95210:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 40 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:0.0:1783144425.828024:0:95210:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 54 marker 40 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:0.0:1783144425.828039:0:95210:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:3.0:1783144425.828239:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:3.0:1783144425.828252:0:95209:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783144425.828269:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:3.0:1783144425.828286:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:3.0:1783144425.828301:0:95209:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1783144425.828602:0:95211:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 41 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:0.0:1783144425.828633:0:95211:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 41 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:0.0:1783144425.828650:0:95211:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:3.0:1783144425.829966:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:3.0:1783144425.829979:0:95209:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783144425.829992:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:3.0:1783144425.830006:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:3.0:1783144425.830017:0:95209:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1783144425.830422:0:95212:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 42 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1783144425.830454:0:95212:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 42 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1783144425.830468:0:95212:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:3.0:1783144425.830844:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:3.0:1783144425.830854:0:95209:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1783144425.830867:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:3.0:1783144425.830882:0:95209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:3.0:1783144425.830895:0:95209:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783144425.830913:0:95209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.830932:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.830941:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.830956:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049454 expref: 23 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.830964:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049462 expref: 23 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.830972:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049470 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.830984:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304947e expref: 23 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.830991:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304948c expref: 23 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831000:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304949a expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831008:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831015:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831023:0:95209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831031:0:95209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831076:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831090:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 23 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.831106:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413248:0@lo:104: 00000100:00100000:3.0:1783144425.831165:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783144425.831212:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144425.831219:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501413248 00000100:00100000:1.0:1783144425.831227:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501413248 00010000:00010000:3.0:1783144425.831232:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 23 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.831243:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413376:0@lo:104: 00000100:00100000:3.0:1783144425.831272:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783144425.831471:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.831481:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 23 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.831490:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413504:0@lo:104: 00000100:00100000:1.0:1783144425.831496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501413376 00000100:00100000:1.0:1783144425.831502:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501413376 00000100:00100000:3.0:1783144425.831515:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.832538:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501413504 00000100:00100000:2.0:1783144425.832545:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501413504 00000100:00100000:2.0:1783144425.832576:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00010000:00010000:3.0:1783144425.832577:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304949a expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.832588:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:95209:x1869759501413248:12345-0@lo:104: 00010000:00010000:3.0:1783144425.832593:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304949a expref: 23 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.832604:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.832628:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413632:0@lo:104: 00000100:00100000:3.0:1783144425.832665:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783144425.832676:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783144425.832684:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:95209:x1869759501413248:12345-0@lo:104: Request processed in 100us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.832692:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:3.0:1783144425.832699:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304948c expref: 23 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.832710:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304948c expref: 23 pid: 94185 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.832710:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501413632 00000100:00100000:2.0:1783144425.832715:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501413632 00000100:00100000:3.0:1783144425.832746:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413760:0@lo:104: 00000100:00100000:2.0:1783144425.832772:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1783144425.832777:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.832785:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:95209:x1869759501413376:12345-0@lo:104: 00010000:00010000:2.0:1783144425.832794:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.832808:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304947e expref: 23 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.832823:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304947e expref: 23 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.832834:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413888:0@lo:104: 00010000:00010000:2.0:1783144425.832855:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783144425.832862:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:95209:x1869759501413376:12345-0@lo:104: Request processed in 81us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.832870:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.832875:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:3.0:1783144425.832892:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423049470 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.832897:0:93006:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1783144425.832903:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423049470 expref: 23 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.832909:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501413760 00000100:00100000:2.0:1783144425.832914:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501413760 00000100:00100000:3.0:1783144425.832915:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ceadb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414016:0@lo:104: 00000100:00100000:2.0:1783144425.832936:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501413888 00000100:00100000:2.0:1783144425.832940:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501413888 00000100:00100000:3.0:1783144425.832946:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.832955:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501414016 00000100:00100000:2.0:1783144425.832959:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501414016 00010000:00010000:3.0:1783144425.832972:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423049462 expref: 23 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.832978:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1783144425.832985:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95209:x1869759501413504:12345-0@lo:104: 00010000:00010000:2.0:1783144425.832997:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.833002:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423049462 expref: 23 pid: 94189 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.833017:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cead9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414144:0@lo:104: 00010000:00010000:2.0:1783144425.833043:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783144425.833051:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95209:x1869759501413504:12345-0@lo:104: Request processed in 65us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.833052:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.833062:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:3.0:1783144425.833077:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a423049454 expref: 23 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.833078:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501414144 00000100:00100000:2.0:1783144425.833083:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501414144 00010000:00010000:3.0:1783144425.833091:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a423049454 expref: 23 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.833099:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cead8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414272:0@lo:104: 00000100:00100000:2.0:1783144425.833103:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1783144425.833111:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95209:x1869759501413632:12345-0@lo:104: 00010000:00010000:2.0:1783144425.833118:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.833127:0:95209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783144425.833154:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833161:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1783144425.833166:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 9 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.833176:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95209:x1869759501413632:12345-0@lo:104: Request processed in 64us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.833182:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cead8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414400:192.168.203.4@tcp:104: 00000100:00100000:2.0:1783144425.833188:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1783144425.833202:0:93006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501414272 00000100:00100000:2.0:1783144425.833205:0:93006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501414272 00000100:00100000:2.0:1783144425.833221:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1783144425.833228:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95209:x1869759501413760:12345-0@lo:104: 00010000:00010000:2.0:1783144425.833235:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.833239:0:95209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.833254:0:95209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 9 pid: 94184 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.833263:0:95209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cead8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414528:192.168.203.4@tcp:104: 00010000:00010000:2.0:1783144425.833275:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1783144425.833282:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+7:95209:x1869759501413760:12345-0@lo:104: Request processed in 55us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.833289:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783144425.833300:0:95209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01574d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783144425.833303:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783144425.833313:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef510050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:95209:x1869759501413888:12345-0@lo:104: 00010000:00010000:2.0:1783144425.833320:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833419:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1783144425.833424:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef510050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+6:95209:x1869759501413888:12345-0@lo:104: Request processed in 114us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.833430:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783144425.833458:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1783144425.833463:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:95209:x1869759501414016:12345-0@lo:104: 00010000:00010000:2.0:1783144425.833470:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833504:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1783144425.833509:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+5:95209:x1869759501414016:12345-0@lo:104: Request processed in 47us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.833515:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1783144425.833527:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783144425.833533:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:95209:x1869759501414144:12345-0@lo:104: 00010000:00010000:2.0:1783144425.833540:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833566:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1783144425.833570:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+4:95209:x1869759501414144:12345-0@lo:104: Request processed in 38us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.833576:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783144425.833587:0:93006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1783144425.833593:0:93006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:95209:x1869759501414272:12345-0@lo:104: 00010000:00010000:2.0:1783144425.833605:0:93006:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833632:0:93006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1783144425.833637:0:93006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:95209:x1869759501414272:12345-0@lo:104: Request processed in 45us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.833643:0:93006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:2.0:1783144425.833663:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783144425.833668:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833686:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.833691:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833699:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.833706:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.833712:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.833763:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833771:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.833789:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833796:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9800/0xad8e53a4230494c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833809:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783144425.833813:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833819:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0400 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.833822:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833839:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.833845:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.833850:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.833863:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833869:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.833884:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833891:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe0400/0xad8e53a4230494b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833900:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783144425.833903:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833908:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.833911:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833918:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.833924:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.833936:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.833948:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833953:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.833959:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833966:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8800/0xad8e53a4230494a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833974:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783144425.833977:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833982:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9200 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.833985:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.833991:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.833997:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.834002:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.834012:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834017:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.834028:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834034:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9200/0xad8e53a42304949a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230494a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834043:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783144425.834045:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834051:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.834054:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834060:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.834067:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.834072:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.834084:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834090:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.834094:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834100:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9000/0xad8e53a42304948c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049493 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834108:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783144425.834116:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834121:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8200 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.834124:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834131:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.834137:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.834142:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.834153:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834159:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.834163:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834169:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8200/0xad8e53a42304947e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049485 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834177:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783144425.834180:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834185:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.834188:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834204:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.834210:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.834215:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.834228:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834234:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.834238:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834245:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2b02150800/0xad8e53a423049470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049477 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834255:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783144425.834258:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834263:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8e00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.834266:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834273:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.834279:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.834290:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.834304:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834309:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.834315:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834322:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe8e00/0xad8e53a423049462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049469 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834330:0:9525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783144425.834333:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834460:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1a00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:2.0:1783144425.834465:0:9525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834473:0:9525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783144425.834479:0:9525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144425.834484:0:9525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783144425.834498:0:9525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834503:0:9525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783144425.834514:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834521:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af5fe1a00/0xad8e53a423049454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a42304945b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.834534:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144425.834537:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144425.834538:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144425.834546:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144425.834552:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144425.834671:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501414656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144425.834706:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144425.834815:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413248:0@lo:104: 00000100:00100000:2.0:1783144425.834817:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.834837:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413376:0@lo:104: 00000100:00100000:3.0:1783144425.834849:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413504:0@lo:104: 00000100:00100000:2.0:1783144425.834857:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144425.834863:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413632:0@lo:104: 00000100:00100000:3.0:1783144425.834875:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413760:0@lo:104: 00000100:00100000:2.0:1783144425.834883:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.834887:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501413888:0@lo:104: 00000100:00100000:3.0:1783144425.834897:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ceadb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414016:0@lo:104: 00000100:00100000:3.0:1783144425.834906:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cead9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414144:0@lo:104: 00000100:00100000:2.0:1783144425.834913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144425.834917:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cead8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414272:0@lo:104: 00000100:00100000:2.0:1783144425.834938:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783144425.834948:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144425.834968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.834990:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.835012:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501414656 00000100:00100000:2.0:1783144425.835012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144425.835019:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501414656 00010000:00010000:3.0:1783144425.835046:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 24 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835056:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501414784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.835069:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415168 00000100:00100000:3.0:1783144425.835073:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415168 00000100:00100000:2.0:1783144425.835084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783144425.835087:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304948c expref: 25 pid: 94185 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835099:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501415296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.835100:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415680 00000100:00100000:3.0:1783144425.835103:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415680 00010000:00010000:3.0:1783144425.835118:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049454 expref: 26 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144425.835129:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415040 00000100:00100000:3.0:1783144425.835131:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415040 00010000:00010000:3.0:1783144425.835142:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304949a expref: 27 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835152:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783144425.835162:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415552 00000100:00100000:2.0:1783144425.835162:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501414912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.835167:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415552 00010000:00010000:3.0:1783144425.835181:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049462 expref: 28 pid: 94189 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.835205:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501415424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144425.835226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144425.835249:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501414784 00000100:00100000:2.0:1783144425.835254:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501414784 00010000:00010000:2.0:1783144425.835270:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 29 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835271:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415296 00000100:00100000:3.0:1783144425.835286:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415296 00000100:00100000:2.0:1783144425.835290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501414912 00000100:00100000:2.0:1783144425.835295:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501414912 00010000:00010000:3.0:1783144425.835302:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304947e expref: 31 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.835309:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 31 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835318:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415424 00000100:00100000:3.0:1783144425.835322:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415424 00000100:00100000:2.0:1783144425.835329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00010000:00010000:3.0:1783144425.835337:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049470 expref: 32 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835355:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:3.0:1783144425.835362:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+32:3651:x1869759501415168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144425.835372:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144425.835378:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304948c expref: 32 pid: 94185 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835388:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304948c expref: 32 pid: 94185 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835412:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+32:3651:x1869759501414656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144425.835415:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150e00/0xad8e53a423049493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304948c expref: 32 pid: 94185 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.835429:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144425.835431:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144425.835437:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 31 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.835449:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 31 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.835462:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af6f34e00/0xad8e53a4230494cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230494c4 expref: 31 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835471:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+30:3651:x1869759501415168:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (616us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144425.835472:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144425.835486:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1783144425.835507:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+29:3651:x1869759501414656:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.835508:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:3.0:1783144425.835519:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+29:3651:x1869759501415680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144425.835532:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783144425.835536:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00010000:00010000:3.0:1783144425.835541:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049454 expref: 29 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835552:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423049454 expref: 28 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835564:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac0031400/0xad8e53a42304945b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423049454 expref: 28 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835575:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144425.835580:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:2.0:1783144425.835588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+27:3651:x1869759501415040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144425.835596:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144425.835601:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304949a expref: 27 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835607:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+27:3651:x1869759501415680:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (692us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144425.835619:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304949a expref: 27 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835620:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00010000:00010000:2.0:1783144425.835634:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02151200/0xad8e53a4230494a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304949a expref: 26 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835638:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1783144425.835649:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3651:x1869759501415552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144425.835649:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144425.835659:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144425.835664:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049462 expref: 25 pid: 94189 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835675:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423049462 expref: 25 pid: 94189 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835680:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3651:x1869759501415040:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (709us total) trans 0 rc 0/0 00010000:00010000:3.0:1783144425.835692:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150000/0xad8e53a423049469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423049462 expref: 25 pid: 94189 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.835692:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:2.0:1783144425.835709:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:2.0:1783144425.835741:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3648:x1869759501414784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783144425.835748:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144425.835771:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3651:x1869759501415552:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.835860:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00010000:00010000:2.0:1783144425.835866:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144425.835873:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 22 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835882:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00010000:00010000:2.0:1783144425.835884:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 22 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.835896:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3648:x1869759501415296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144425.835898:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150a00/0xad8e53a4230494bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230494b6 expref: 22 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835914:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144425.835926:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304947e expref: 21 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.835926:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144425.835940:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304947e expref: 21 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835953:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac0031200/0xad8e53a423049485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304947e expref: 21 pid: 94183 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.835964:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144425.836004:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3648:x1869759501414784:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.836011:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:3648:x1869759501415296:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.836015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00010000:00010000:1.0:1783144425.836015:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144425.836028:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1783144425.836036:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1783144425.836044:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1783144425.836050:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae0857c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:3648:x1869759501414912:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144425.836057:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:3648:x1869759501415424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144425.836060:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144425.836067:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144425.836068:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 18 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.836074:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a423049470 expref: 18 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144425.836085:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 18 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144425.836116:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501414784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144425.836134:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501415296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783144425.836171:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a423049470 expref: 18 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.836180:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af5fe1000/0xad8e53a423049477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a423049470 expref: 18 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.836188:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144425.836246:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02150c00/0xad8e53a4230494af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230494a8 expref: 17 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.836248:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:3648:x1869759501415424:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.836263:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00010000:00010000:1.0:1783144425.836266:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144425.836302:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144425.836311:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae0857c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:3648:x1869759501414912:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.836315:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144425.836325:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501414656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144425.836336:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:0.0:1783144425.836418:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501415424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144425.836435:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501414912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144425.836472:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144425.836488:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501415680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.836504:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cead8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414400:192.168.203.4@tcp:104: 00000100:00100000:3.0:1783144425.836517:0:95209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cead8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95209:1869759501414528:192.168.203.4@tcp:104: 00010000:00010000:3.0:1783144425.836557:0:95209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.837482:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144425.837508:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144425.837578:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723008 00000100:00100000:3.0:1783144425.837585:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723008 00010000:00010000:3.0:1783144425.837612:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 10 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.837635:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723136 00000100:00100000:3.0:1783144425.837639:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723136 00010000:00010000:3.0:1783144425.837651:0:26153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 11 pid: 94184 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.837658:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2597 00000100:00100000:2.0:1783144425.837682:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2404:x1869759481723008:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783144425.837691:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2598 00010000:00010000:2.0:1783144425.837694:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783144425.837704:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a1ed6386-b53d-4b75-b3e0-82656a667de7+11:2403:x1869759481723136:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783144425.837704:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 11 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.837719:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144425.837749:0:26153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 11 pid: 94184 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.837761:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 11 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.837914:0:26153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 11 pid: 94184 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.837937:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02151800/0xad8e53a42304944d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc2 expref: 11 pid: 94188 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.837940:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2b02151000/0xad8e53a423049446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dbb expref: 11 pid: 94184 timeout: 3060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.837965:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.837974:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.837981:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144425.837989:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.837998:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.838005:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.838011:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.838024:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34600 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:2.0:1783144425.838029:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.838037:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144425.838044:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:2403:x1869759481723136:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 346us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144425.838050:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2598 00010000:00010000:2.0:1783144425.838053:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144425.838065:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144425.838070:0:95209:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.838076:0:95209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144425.838092:0:95209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144425.838092:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:2404:x1869759481723008:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 420us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144425.838117:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2597 00010000:00010000:2.0:1783144426.445935:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144426.594445:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144426.594485:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144426.594510:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723392 00000100:00100000:2.0:1783144426.594520:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723392 00000100:00100000:1.0:1783144426.594525:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144426.594579:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723264 00000100:00100000:2.0:1783144426.594583:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723264 00000100:00100000:3.0:1783144426.594606:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723648 00000100:00100000:3.0:1783144426.594612:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723648 00000100:00100000:2.0:1783144426.594617:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 881 00000100:00100000:1.0:1783144426.594624:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144426.594634:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2405:x1869759481723392:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144426.594648:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723520 00000100:00100000:3.0:1783144426.594652:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723520 00000100:00100000:1.0:1783144426.594669:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 882 00000100:00100000:3.0:1783144426.594684:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2101 00000100:00100000:1.0:1783144426.594685:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2406:x1869759481723264:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144426.594697:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2405:x1869759481723648:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144426.594718:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2405:x1869759481723392:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144426.594758:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 881 00000100:00100000:1.0:1783144426.594768:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2406:x1869759481723264:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144426.594777:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 882 00000100:00080000:2.0:1783144426.594781:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783144426.594787:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783144426.594790:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783144426.594793:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144426.594818:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2405:x1869759481723648:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144426.594818:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2102 00000100:00100000:0.0:1783144426.594831:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481723520:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144426.594835:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2101 00000100:00100000:0.0:1783144426.594862:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481723520:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144426.594868:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2102 00010000:00010000:2.0:1783144427.470604:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144427.620307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144427.620528:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723776 00000100:00100000:3.0:1783144427.620552:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723776 00000100:00100000:3.0:1783144427.620606:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:3.0:1783144427.620616:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+8:70816:x1869759481723776:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144427.620631:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144427.620651:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dc9 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.620686:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc9 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.620697:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc9 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.620715:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34600, rc 0) 00000100:00100000:3.0:1783144427.620816:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481723776:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 201us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.620823:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:1.0:1783144427.623425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144427.623483:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481723904 00000100:00100000:0.0:1783144427.623490:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481723904 00000100:00100000:0.0:1783144427.623534:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:0.0:1783144427.623543:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481723904:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.623748:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481723904:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 181us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.623756:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:0.0:1783144427.626910:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144427.626976:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481724032 00000100:00100000:2.0:1783144427.626984:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481724032 00000100:00100000:2.0:1783144427.627031:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:2.0:1783144427.627040:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481724032:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.627168:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481724032:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 128us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.627176:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:1.0:1783144427.630029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144427.630097:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481724160 00000100:00100000:3.0:1783144427.630106:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481724160 00000100:00100000:3.0:1783144427.630202:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:3.0:1783144427.630213:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73202:x1869759481724160:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783144427.630617:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73202:x1869759481724160:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 406us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.630626:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:1.0:1783144427.633350:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144427.634478:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481724288 00000100:00100000:0.0:1783144427.634486:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481724288 00000100:00100000:0.0:1783144427.634533:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:0.0:1783144427.634542:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73202:x1869759481724288:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783144427.634675:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:73202:x1869759481724288:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 133us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.634683:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:0.0:1783144427.638415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144427.638634:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481724416 00000100:00100000:2.0:1783144427.638643:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481724416 00000100:00100000:2.0:1783144427.638691:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:2.0:1783144427.638700:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481724416:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144427.638714:0:94183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144427.638773:0:94183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043f600/0xad8e53a4230494e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dd0 expref: -99 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.638800:0:94183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043f600/0xad8e53a4230494e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dd0 expref: 10 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.638823:0:94183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043f600/0xad8e53a4230494e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dd0 expref: 10 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.638832:0:94183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043f600, rc 0) 00000100:00100000:2.0:1783144427.638892:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481724416:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 192us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.638899:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:1.0:1783144427.641649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144427.641754:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481724544 00000100:00100000:3.0:1783144427.641762:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481724544 00000100:00100000:3.0:1783144427.641813:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:3.0:1783144427.641823:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481724544:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.642100:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481724544:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 276us (455us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144427.642110:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 10000000:01000000:2.0:1783144427.661814:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144427.661822:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c29c5808800 from 61 10000000:01000000:2.0:1783144427.661843:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144427.661884:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.661896:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.661907:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.661929:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501415808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.661989:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.662036:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13acf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.662046:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415808 00000100:00100000:3.0:1783144427.662052:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415808 00000100:00100000:3.0:1783144427.662098:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783144427.662108:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+15:6518:x1869759501415808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144427.662122:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144427.662133:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af6f34200/0xad8e53a4230494ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230494e7 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.662151:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f34200/0xad8e53a4230494ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230494e7 expref: 16 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.662163:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af6f34200/0xad8e53a4230494ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494e7 expref: 16 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.662177:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34200, rc 0) 00000100:00100000:3.0:1783144427.662229:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501415808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.662235:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783144427.662301:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501415808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144427.662315:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.662325:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.662482:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501415936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.662563:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.662580:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13acf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.662746:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501415936 00000100:00100000:0.0:1783144427.662751:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501415936 00000100:00100000:0.0:1783144427.662840:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783144427.662849:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501415936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.664039:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501415936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1191us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.664045:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783144427.664074:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501415936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.664101:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.664132:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.664161:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13acf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.664215:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416064 00000100:00100000:3.0:1783144427.664219:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416064 00000100:00100000:3.0:1783144427.664252:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783144427.664257:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501416064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.664339:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501416064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.664346:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783144427.664370:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.664976:0:95213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95213:1869759501416192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.665004:0:95213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.665022:0:95213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c495b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.665038:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416192 00000100:00100000:3.0:1783144427.665042:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416192 00000100:00100000:3.0:1783144427.665062:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783144427.665066:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95213:x1869759501416192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144427.665125:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95213:x1869759501416192:12345-0@lo:502:llog_process_th.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.665129:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783144427.665180:0:95213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95213:1869759501416192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.665224:0:95213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95213:1869759501416320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.665456:0:95213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.665479:0:95213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac3975f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783144427.665494:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416320 00000100:00100000:2.0:1783144427.665498:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416320 00000100:00100000:2.0:1783144427.665520:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783144427.665527:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95213:x1869759501416320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144427.665601:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:95213:x1869759501416320:12345-0@lo:502:llog_process_th.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.665608:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783144427.665666:0:95213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95213:1869759501416320:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783144427.665685:0:95213:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783144427.665780:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783144427.665815:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144427.665823:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.665833:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144427.665841:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783144427.665843:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:2.0:1783144427.665846:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783144427.665863:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.665870:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.665877:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.665888:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.665912:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.665943:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13acf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.665956:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416448 00000100:00100000:0.0:1783144427.665961:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416448 00000100:00100000:0.0:1783144427.665994:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783144427.666001:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+16:6518:x1869759501416448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144427.666010:0:94183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144427.666021:0:94183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230494fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a4230494f5 expref: -99 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.666053:0:94183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230494fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a4230494f5 expref: 17 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.666062:0:94183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230494fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494f5 expref: 17 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.666069:0:94183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9e00, rc 0) 00000100:00100000:0.0:1783144427.666099:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501416448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.666106:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783144427.666132:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144427.666141:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.666147:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.666187:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.666210:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.666230:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13acf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.666359:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416576 00000100:00100000:3.0:1783144427.666364:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416576 00000100:00100000:3.0:1783144427.666402:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783144427.666410:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501416576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.666492:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501416576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.666499:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783144427.666520:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.666708:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.666759:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.666779:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13acf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.666792:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416704 00000100:00100000:0.0:1783144427.666798:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416704 00000100:00100000:0.0:1783144427.666821:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783144427.666827:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501416704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.666899:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501416704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.666908:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783144427.666923:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501416704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.668368:0:95214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95214:1869759501416832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144427.668429:0:95214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.668456:0:95214:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.668535:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416832 00000100:00100000:0.0:1783144427.668539:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416832 00000100:00100000:0.0:1783144427.668566:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783144427.668572:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95214:x1869759501416832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.668641:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95214:x1869759501416832:12345-0@lo:502:llog_process_th.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.668646:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783144427.668682:0:95214:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95214:1869759501416832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144427.668713:0:95214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783144427.668740:0:95214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144427.668742:0:95214:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:2.0:1783144427.668749:0:95214:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1783144427.669364:0:95214:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95214:1869759501416960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144427.669415:0:95214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.669442:0:95214:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad13ac480 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.669494:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501416960 00000100:00100000:3.0:1783144427.669499:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501416960 00000100:00100000:3.0:1783144427.669533:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783144427.669541:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95214:x1869759501416960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144427.669625:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:95214:x1869759501416960:12345-0@lo:502:llog_process_th.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.669633:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783144427.669805:0:95214:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95214:1869759501416960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783144427.669823:0:95214:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783144427.669827:0:95214:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783144427.669829:0:95214:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:2.0:1783144427.669833:0:95214:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:0.0:1783144427.669903:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:0.0:1783144427.669927:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783144427.670002:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.670011:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a4230494fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144427.670020:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783144427.670022:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2ac91e0000 from 61 10000000:01000000:0.0:1783144427.670025:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783144427.670045:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.670053:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.670062:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144427.670075:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.670107:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.670130:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144427.670142:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417088 00000100:00100000:2.0:1783144427.670147:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417088 00000100:00100000:2.0:1783144427.670224:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783144427.670233:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+17:6518:x1869759501417088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144427.670241:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144427.670251:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af043fe00/0xad8e53a42304950a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049503 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.670268:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af043fe00/0xad8e53a42304950a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049503 expref: 18 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.670278:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af043fe00/0xad8e53a42304950a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049503 expref: 18 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.670285:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043fe00, rc 0) 00000100:00100000:2.0:1783144427.670319:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501417088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.670326:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783144427.670366:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144427.670377:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304950a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.670398:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304950a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144427.670442:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.670478:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.670559:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417216 00000100:00100000:2.0:1783144427.670563:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417216 00000100:00100000:2.0:1783144427.670598:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783144427.670606:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501417216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.670677:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501417216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.670684:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783144427.670918:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.670996:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.671022:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.671057:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.671083:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.671489:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417344 00000100:00100000:3.0:1783144427.671494:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417344 00000100:00100000:3.0:1783144427.671525:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783144427.671532:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501417344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.671620:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501417344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.671627:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783144427.671680:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144427.672276:0:95215:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95215:1869759501417472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.672321:0:95215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144427.672349:0:95215:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144427.672352:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417472 00000100:00100000:2.0:1783144427.672356:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417472 00000100:00100000:2.0:1783144427.672377:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783144427.672383:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95215:x1869759501417472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144427.672460:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95215:x1869759501417472:12345-0@lo:502:llog_process_th.0 Request processed in 77us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.672464:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783144427.672605:0:95215:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95215:1869759501417472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.672640:0:95215:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95215:1869759501417600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.672672:0:95215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144427.672691:0:95215:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783144427.672780:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417600 00000100:00100000:2.0:1783144427.672784:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417600 00000100:00100000:2.0:1783144427.672820:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783144427.672827:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95215:x1869759501417600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144427.672898:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:95215:x1869759501417600:12345-0@lo:502:llog_process_th.0 Request processed in 71us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.672904:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783144427.672957:0:95215:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95215:1869759501417600:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783144427.672980:0:95215:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783144427.673046:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783144427.673077:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144427.673084:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304950a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.673093:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304950a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144427.673102:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783144427.673104:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:2.0:1783144427.673113:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783144427.673130:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.673137:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.673145:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.673157:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.673197:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.673219:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.673695:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417728 00000100:00100000:3.0:1783144427.673700:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417728 00000100:00100000:3.0:1783144427.673755:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783144427.673764:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+18:6518:x1869759501417728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144427.673773:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144427.673784:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af6f35600/0xad8e53a423049518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049511 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.673810:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f35600/0xad8e53a423049518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049511 expref: 19 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.673819:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af6f35600/0xad8e53a423049518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049511 expref: 19 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.673826:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35600, rc 0) 00000100:00100000:3.0:1783144427.673865:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501417728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.673872:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783144427.673941:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144427.673953:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049518 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.673960:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049518 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.673999:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.674024:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.674061:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417856 00000100:00100000:0.0:1783144427.674066:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417856 00000100:00100000:0.0:1783144427.674097:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783144427.674103:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501417856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.674199:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721600 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.674205:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501417856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.674213:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783144427.674216:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.674249:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.674283:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.674301:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721600 going to sleep for 11 seconds 00000100:00100000:1.0:1783144427.674331:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501417984 00000100:00100000:1.0:1783144427.674336:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501417984 00000100:00100000:1.0:1783144427.674369:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783144427.674382:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501417984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144427.674466:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501417984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144427.674474:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783144427.674483:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501417984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144427.675190:0:95216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95216:1869759501418112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.675220:0:95216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144427.675329:0:95216:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.675359:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501418112 00000100:00100000:3.0:1783144427.675363:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501418112 00000100:00100000:3.0:1783144427.675403:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783144427.675411:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95216:x1869759501418112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144427.675495:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95216:x1869759501418112:12345-0@lo:502:llog_process_th.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.675501:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783144427.675544:0:95216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95216:1869759501418112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144427.675565:0:95216:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783144427.675574:0:95216:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144427.675576:0:95216:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:1.0:1783144427.675582:0:95216:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1783144427.675778:0:95216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95216:1869759501418240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.675816:0:95216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144427.675832:0:95216:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.676102:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501418240 00000100:00100000:0.0:1783144427.676107:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501418240 00000100:00100000:0.0:1783144427.676138:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783144427.676144:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95216:x1869759501418240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.676230:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:95216:x1869759501418240:12345-0@lo:502:llog_process_th.0 Request processed in 86us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.676237:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783144427.676259:0:95216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95216:1869759501418240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783144427.676286:0:95216:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783144427.676291:0:95216:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783144427.676293:0:95216:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:1.0:1783144427.676296:0:95216:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:2.0:1783144427.676353:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:2.0:1783144427.676376:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783144427.676383:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049518 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.676405:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049518 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144427.676414:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144427.676417:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2b017f2000 from 61 10000000:01000000:2.0:1783144427.676419:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144427.676436:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.676443:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.676450:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.676462:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501418368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.676486:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.676553:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721600 going to sleep for 11 seconds 00000100:00100000:1.0:1783144427.676580:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501418368 00000100:00100000:1.0:1783144427.676583:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501418368 00000100:00100000:1.0:1783144427.676638:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783144427.676646:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+19:6518:x1869759501418368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144427.676653:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144427.676663:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a423049526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304951f expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144427.676688:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a423049526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304951f expref: 20 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144427.676696:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a423049526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304951f expref: 20 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144427.676704:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0a00, rc 0) 00000100:00100000:1.0:1783144427.676764:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501418368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144427.676770:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783144427.676867:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501418368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144427.676882:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049526 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.676901:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049526 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144427.676944:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501418496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.676969:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.676995:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c4a99300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.677064:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501418496 00000100:00100000:3.0:1783144427.677068:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501418496 00000100:00100000:3.0:1783144427.677095:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783144427.677101:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501418496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.677179:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501418496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.677185:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783144427.677244:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef486680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501418496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.677267:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501418624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.677300:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.677323:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.677364:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501418624 00000100:00100000:3.0:1783144427.677368:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501418624 00000100:00100000:3.0:1783144427.677404:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783144427.677414:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501418624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.677489:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501418624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.677496:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783144427.677608:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501418624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783144427.678403:0:95217:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95217:1869759501418752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.678438:0:95217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144427.678461:0:95217:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.678473:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501418752 00000100:00100000:3.0:1783144427.678479:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501418752 00000100:00100000:3.0:1783144427.678510:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783144427.678518:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95217:x1869759501418752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144427.678595:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95217:x1869759501418752:12345-0@lo:502:llog_process_th.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.678602:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783144427.678642:0:95217:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95217:1869759501418752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.678676:0:95217:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95217:1869759501418880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783144427.678708:0:95217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144427.678752:0:95217:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac6dbd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.679350:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501418880 00000100:00100000:3.0:1783144427.679355:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501418880 00000100:00100000:3.0:1783144427.679430:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783144427.679438:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af9f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95217:x1869759501418880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144427.679513:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af9f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:95217:x1869759501418880:12345-0@lo:502:llog_process_th.0 Request processed in 76us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.679520:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783144427.679551:0:95217:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95217:1869759501418880:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783144427.679572:0:95217:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783144427.679633:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783144427.679660:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144427.679668:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049526 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.679676:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049526 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144427.679684:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783144427.679686:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783144427.679688:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783144427.679705:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.679713:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.679747:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.679763:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.679805:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.679832:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.679872:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419008 00000100:00100000:0.0:1783144427.679877:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419008 00000100:00100000:0.0:1783144427.679904:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783144427.679911:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+20:6518:x1869759501419008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144427.679919:0:94185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144427.679938:0:94185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8c00/0xad8e53a423049534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304952d expref: -99 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.679958:0:94185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8c00/0xad8e53a423049534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304952d expref: 21 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.679967:0:94185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8c00/0xad8e53a423049534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304952d expref: 21 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.679973:0:94185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8c00, rc 0) 00000100:00100000:0.0:1783144427.680004:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501419008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.680010:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783144427.680035:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144427.680049:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049534 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.680058:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049534 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.680109:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.680135:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.680162:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.680337:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419136 00000100:00100000:3.0:1783144427.680343:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419136 00000100:00100000:3.0:1783144427.680372:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783144427.680378:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501419136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.680467:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501419136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.680473:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783144427.680537:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.680563:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.680596:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.680617:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.680654:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419264 00000100:00100000:3.0:1783144427.680658:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419264 00000100:00100000:3.0:1783144427.680687:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783144427.680693:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501419264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.680969:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501419264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.680975:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783144427.681037:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783144427.681862:0:95218:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1783144427.681987:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1783144427.682004:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783144427.682010:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049534 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.682020:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049534 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144427.682028:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783144427.682030:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c2afaac8800 from 61 10000000:01000000:2.0:1783144427.682032:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783144427.682049:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.682056:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.682064:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.682083:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.682111:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.682129:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721840 going to sleep for 11 seconds 00000100:00100000:0.0:1783144427.682189:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419392 00000100:00100000:0.0:1783144427.682194:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419392 00000100:00100000:0.0:1783144427.682224:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783144427.682238:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:6518:x1869759501419392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144427.682246:0:94185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144427.682255:0:94185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9400/0xad8e53a423049542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a42304953b expref: -99 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.682270:0:94185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9400/0xad8e53a423049542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a42304953b expref: 22 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.682279:0:94185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9400/0xad8e53a423049542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304953b expref: 22 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.682286:0:94185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9400, rc 0) 00000100:00100000:0.0:1783144427.682325:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501419392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144427.682331:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783144427.682366:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144427.682378:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.682397:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144427.682440:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cead8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.682479:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144427.682504:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d83240 going to sleep for 11 seconds 00000100:00100000:1.0:1783144427.682519:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419520 00000100:00100000:1.0:1783144427.682524:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419520 00000100:00100000:1.0:1783144427.682646:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783144427.682653:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501419520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144427.682792:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501419520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144427.682799:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783144427.682939:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cead8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.682964:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.682995:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.683022:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.683033:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419648 00000100:00100000:3.0:1783144427.683039:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419648 00000100:00100000:3.0:1783144427.683120:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783144427.683128:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501419648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.683267:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501419648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.683275:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783144427.683290:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501419648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.683554:0:95219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95219:1869759501419776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.683589:0:95219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.683611:0:95219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:2.0:1783144427.683655:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419776 00000100:00100000:2.0:1783144427.683660:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419776 00000100:00100000:2.0:1783144427.683691:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783144427.683697:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:95219:x1869759501419776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783144427.683790:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:95219:x1869759501419776:12345-0@lo:502:llog_process_th.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144427.683798:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783144427.683826:0:95219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95219:1869759501419776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.683874:0:95219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95219:1869759501419904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783144427.683905:0:95219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.683927:0:95219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.683945:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501419904 00000100:00100000:3.0:1783144427.683950:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501419904 00000100:00100000:3.0:1783144427.683980:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783144427.683995:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:95219:x1869759501419904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783144427.684066:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:95219:x1869759501419904:12345-0@lo:502:llog_process_th.0 Request processed in 72us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.684074:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783144427.684080:0:95219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:95219:1869759501419904:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783144427.684157:0:95219:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783144427.684246:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783144427.684266:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783144427.684272:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.684281:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144427.684288:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783144427.684296:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783144427.684299:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783144427.684314:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.684321:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.684328:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.684339:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.684363:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.684383:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c27219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.684682:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420032 00000100:00100000:3.0:1783144427.684686:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420032 00000100:00100000:3.0:1783144427.684707:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783144427.684711:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501420032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144427.684717:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144427.684741:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af6f35400/0xad8e53a423049550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049549 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.684753:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f35400/0xad8e53a423049550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049549 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.684760:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af6f35400/0xad8e53a423049550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049549 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.684765:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35400, rc 0) 00000100:00100000:3.0:1783144427.684801:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501420032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.684808:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783144427.684826:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144427.684839:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.684913:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144427.684975:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.685000:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.685025:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:1.0:1783144427.685036:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420160 00000100:00100000:1.0:1783144427.685042:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420160 00000100:00100000:1.0:1783144427.685070:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783144427.685076:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501420160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.685358:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783144427.685360:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501420160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144427.685372:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783144427.685400:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783144427.685436:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144427.685457:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2b01016540 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.685480:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420288 00000100:00100000:3.0:1783144427.685485:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420288 00000100:00100000:3.0:1783144427.685518:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783144427.685527:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501420288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.685606:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501420288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.685620:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783144427.685775:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef484a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783144427.686575:0:95220:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783144427.686680:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783144427.686698:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783144427.686706:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.686716:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783144427.686758:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783144427.686761:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2ac6dd99c0 from 1 10000000:01000000:2.0:1783144427.686764:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783144427.686785:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.686794:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.686814:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.686830:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.686863:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.686892:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.686909:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420416 00000100:00100000:3.0:1783144427.686915:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420416 00000100:00100000:3.0:1783144427.686949:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783144427.686957:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b00d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501420416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783144427.686967:0:94184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144427.686978:0:94184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2af6f35800/0xad8e53a42304955e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049557 expref: -99 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.686998:0:94184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2af6f35800/0xad8e53a42304955e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049557 expref: 24 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.687008:0:94184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2af6f35800/0xad8e53a42304955e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049557 expref: 24 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144427.687015:0:94184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35800, rc 0) 00000100:00100000:3.0:1783144427.687109:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b00d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501420416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144427.687116:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783144427.687162:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783144427.687173:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144427.687182:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144427.687214:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783144427.687232:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144427.687248:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c2721600 going to sleep for 11 seconds 00000100:00100000:3.0:1783144427.687269:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420544 00000100:00100000:3.0:1783144427.687273:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420544 00000100:00100000:3.0:1783144427.687303:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783144427.687310:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501420544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783144427.687377:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501420544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (143us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783144427.687384:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783144427.687458:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501420544:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783144427.687478:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783144427.687483:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144427.687502:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144428.045966:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144428.045992:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501420672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144428.046057:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144428.046104:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420672 00000100:00100000:1.0:1783144428.046112:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420672 00000100:00080000:2.0:1783144428.046158:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783144428.046192:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:3.0:1783144428.046203:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501420672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783144428.046231:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783144428.046292:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501420672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144428.046299:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1783144428.046439:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501420672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144428.046845:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501420800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783144428.046877:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144428.046917:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420800 00000100:00100000:2.0:1783144428.046921:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420800 00000100:00080000:3.0:1783144428.046946:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144428.046959:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:2.0:1783144428.046965:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501420800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783144428.046979:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783144428.047020:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501420800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144428.047033:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:3.0:1783144428.047145:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501420800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783144428.493932:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144428.885161:0:95318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 01:53:48 (1783144428) 00000100:00100000:1.0:1783144428.911907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.911987:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481724800 00000100:00100000:0.0:1783144428.911997:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481724800 00000100:00100000:0.0:1783144428.912072:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1313 00000100:00080000:1.0:1783144428.912074:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783144428.912096:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:73377:x1869759481724800:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:0.0:1783144428.912147:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144428.912171:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049382 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d75 expref: 10 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912188:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:0.0:1783144428.912193:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144428.912243:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912255:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912264:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912277:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912283:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912289:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912742:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912752:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912813:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144428.912834:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7624390 reply state 00000000902bde74 transno 120259084289 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912845:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912851:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144428.912853:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144428.912855:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783144428.912859:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1783144428.912866:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912872:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912877:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912883:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144428.912887:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912894:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912901:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:0.0:1783144428.912903:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144428.912907:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912920:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049565 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144428.912929:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7624390 reply state 00000000902bde74 transno 120259084289 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912936:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.912941:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c29ca14f100) 00010000:00010000:0.0:1783144428.912943:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144428.912945:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783144428.913091:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:73377:x1869759481724800:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 998us (1188us total) trans 120259084289 rc 0/0 00000100:00100000:0.0:1783144428.913099:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1313 00000100:00100000:0.0:1783144428.927962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144428.928013:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481724928 00000100:00100000:2.0:1783144428.928023:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481724928 00000100:00100000:2.0:1783144428.928077:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1314 00000100:00100000:2.0:1783144428.928084:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:73379:x1869759481724928:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144428.928102:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144428.928117:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ea00/0xad8e53a42304957a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dd7 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.928167:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a423049581 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.928180:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a423049581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.928190:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a423049581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144428.928233:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144428.928237:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144428.928258:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a423049581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.928286:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ea00/0xad8e53a42304957a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dd7 expref: 13 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.928301:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a423049581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dd7 expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.928321:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:2.0:1783144428.928324:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144428.928327:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043e800, rc 0) 00000100:00100000:2.0:1783144428.928397:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:73379:x1869759481724928:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 311us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144428.928406:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1314 00000100:00100000:2.0:1783144428.931116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144428.931157:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481725184 00000100:00100000:3.0:1783144428.931165:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481725184 00000100:00100000:3.0:1783144428.931218:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1315 00000100:00100000:3.0:1783144428.931313:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:73379:x1869759481725184:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1783144428.931333:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144428.931335:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783144428.931357:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a423049581 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dd7 expref: 12 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931373:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:3.0:1783144428.931386:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144428.931397:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a423049588 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dde expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931521:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931533:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931542:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931553:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931560:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931567:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931624:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931633:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931640:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144428.931648:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1783144428.931662:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931679:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931686:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931691:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144428.931696:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931704:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931713:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144428.931715:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144428.931742:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931750:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304959d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931777:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931784:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931790:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931804:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931815:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144428.931822:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931829:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931837:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:3.0:1783144428.931839:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144428.931842:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931848:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a42304958f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931858:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931865:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931871:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931877:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144428.931880:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931887:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931906:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c29ca14f100) 00010000:00010000:3.0:1783144428.931909:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144428.931912:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931918:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931945:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a423049588 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dde expref: 12 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931954:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:3.0:1783144428.931956:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144428.931960:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a423049588 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dde expref: 12 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.931969:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34400, rc 0) 00000100:00100000:3.0:1783144428.932023:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:73379:x1869759481725184:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 796us (910us total) trans 0 rc 301/301 00000100:00100000:3.0:1783144428.932034:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1315 00000100:00100000:3.0:1783144428.933410:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144428.933455:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481725312 00000100:00100000:2.0:1783144428.933461:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481725312 00000100:00100000:2.0:1783144428.933509:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1316 00000100:00100000:2.0:1783144428.933518:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:73379:x1869759481725312:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1783144428.933529:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144428.933542:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a4230495a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41de5 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.933593:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e000/0xad8e53a4230495ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.933603:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e000/0xad8e53a4230495ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.933614:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e000/0xad8e53a4230495ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144428.933636:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144428.933639:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144428.933650:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e000/0xad8e53a4230495ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.933676:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a4230495a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41de5 expref: 13 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.933692:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e000/0xad8e53a4230495ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41de5 expref: 12 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.933700:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:2.0:1783144428.933703:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144428.933711:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043e000, rc 0) 00000100:00100000:2.0:1783144428.933776:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:73379:x1869759481725312:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 259us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144428.933784:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1316 00000100:00100000:2.0:1783144428.936809:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.937082:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481725568 00000100:00100000:0.0:1783144428.937090:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481725568 00000100:00100000:0.0:1783144428.937138:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1317 00000100:00100000:0.0:1783144428.937148:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:73379:x1869759481725568:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1783144428.937166:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144428.937181:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a4230495b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dec expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937242:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937255:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937272:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937284:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937291:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937298:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144428.937390:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1783144428.937449:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937457:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937463:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937469:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937475:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144428.937479:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937486:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937507:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:0.0:1783144428.937510:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144428.937514:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937520:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937530:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937536:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937541:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937547:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144428.937550:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937556:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937563:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c29ca14f100) 00010000:00010000:0.0:1783144428.937566:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144428.937568:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937571:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937602:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a4230495b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dec expref: 14 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937609:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:0.0:1783144428.937611:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783144428.937613:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a4230495b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dec expref: 14 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.937618:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9200, rc 0) 00000100:00100000:0.0:1783144428.937659:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:73379:x1869759481725568:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 513us (856us total) trans 120259084290 rc 301/301 00000100:00100000:0.0:1783144428.937666:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1317 00000100:00100000:2.0:1783144428.939198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.939249:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481725824 00000100:00100000:0.0:1783144428.939256:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481725824 00000100:00100000:0.0:1783144428.939306:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1318 00000100:00100000:0.0:1783144428.939316:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:73379:x1869759481725824:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1783144428.939369:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.939392:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.939402:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144428.939507:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000994f5a84 reply state 00000000358eb3df transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.939531:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.939538:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144428.939541:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1783144428.939544:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783144428.939550:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000100:00100000:0.0:1783144428.939599:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:73379:x1869759481725824:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 285us (403us total) trans 120259084291 rc 0/0 00000100:00100000:0.0:1783144428.939607:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1318 00000100:00100000:1.0:1783144428.940529:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.940561:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481726080 00000100:00100000:0.0:1783144428.940566:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481726080 00000100:00100000:0.0:1783144428.940601:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:0.0:1783144428.940611:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:73379:x1869759481726080:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:0.0:1783144428.940738:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:73379:x1869759481726080:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 128us (210us total) trans 120259084292 rc 0/0 00000100:00100000:0.0:1783144428.940744:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:2.0:1783144428.950070:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.950740:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481726208 00000100:00100000:0.0:1783144428.950749:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481726208 00000100:00100000:0.0:1783144428.950795:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1319 00000100:00100000:0.0:1783144428.950806:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:73384:x1869759481726208:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144428.950827:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144428.950845:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a4230495d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41df3 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.950904:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.950924:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.950934:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.950945:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.950952:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.950958:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951024:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8a00/0xad8e53a4230495ea lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951033:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8a00/0xad8e53a4230495ea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951040:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8a00/0xad8e53a4230495ea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144428.951071:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1783144428.951074:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783144428.951104:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8a00/0xad8e53a4230495ea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951115:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951130:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951137:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951142:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144428.951146:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951152:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951163:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:0.0:1783144428.951166:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144428.951171:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951177:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230495dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951187:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951193:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951198:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951203:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144428.951211:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951218:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951225:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c29ca14f100) 00010000:00010000:0.0:1783144428.951227:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144428.951230:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951236:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230495e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951259:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a4230495d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41df3 expref: 18 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951272:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8a00/0xad8e53a4230495ea lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41df3 expref: 17 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.951279:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144428.951281:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783144428.951283:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8a00, rc 0) 00000100:00100000:0.0:1783144428.951342:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:73384:x1869759481726208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 538us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144428.951350:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1319 00000100:00100000:2.0:1783144428.955587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144428.955635:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481726464 00000100:00100000:1.0:1783144428.955643:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481726464 00000100:00100000:1.0:1783144428.955768:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1320 00000100:00100000:1.0:1783144428.955780:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:73384:x1869759481726464:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1783144428.955799:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144428.955817:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230495f1 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41dfa expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.955908:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.955934:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.955953:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.955967:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.955975:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.955982:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783144428.956236:0:66113:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x703:0x0], count =95 00000004:00080000:1.0:1783144428.956241:0:66113:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x703:0x0]+95 in llog 00000004:00080000:1.0:1783144428.956255:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x762:0x0], index 0: 0 00010000:00010000:1.0:1783144428.956367:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049606 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956386:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049606 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956394:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049606 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956426:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956434:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956441:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956455:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956460:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144428.956464:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956471:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956495:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144428.956498:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144428.956502:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956509:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230495f8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144428.956520:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000601639 reply state 00000000ce396116 transno 120259084293 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956531:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956537:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9c2af565c600) 00010000:00010000:1.0:1783144428.956540:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144428.956542:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144428.956568:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a4230495f1 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dfa expref: 20 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956582:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049606 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dfa expref: 19 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.956597:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565cd00) 00010000:00010000:1.0:1783144428.956599:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144428.956602:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0200, rc 0) 00000100:00100000:1.0:1783144428.956666:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:73384:x1869759481726464:12345-192.168.203.4@tcp:101:touch.0 Request processed in 888us (1086us total) trans 120259084293 rc 0/0 00000100:00100000:1.0:1783144428.956674:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1320 00000100:00100000:1.0:1783144428.958999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144428.959031:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481726720 00000100:00100000:1.0:1783144428.959039:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481726720 00000100:00100000:1.0:1783144428.959082:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1321 00000100:00100000:1.0:1783144428.959093:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:73384:x1869759481726720:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1783144428.959136:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144428.959157:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049606 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dfa expref: 20 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.959170:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565cd00) 00010000:00010000:1.0:1783144428.959177:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144428.959209:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.959218:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.959227:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144428.960089:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000255259ee reply state 000000007ea92e04 transno 120259084294 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.960108:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.960114:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:1.0:1783144428.960117:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144428.960120:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144428.960185:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+21:73384:x1869759481726720:12345-192.168.203.4@tcp:36:touch.0 Request processed in 1094us (1189us total) trans 120259084294 rc 0/0 00000100:00100000:1.0:1783144428.960191:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1321 00000100:00100000:2.0:1783144428.963538:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144428.963576:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481726848 00000100:00100000:2.0:1783144428.963584:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481726848 00000100:00100000:2.0:1783144428.963655:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1322 00000100:00100000:2.0:1783144428.963673:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+21:73384:x1869759481726848:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144428.963703:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144428.964123:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a42304961b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e01 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.964193:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a42304961b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e01 expref: 22 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.964220:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ec00/0xad8e53a42304961b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e01 expref: 22 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.964240:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:2.0:1783144428.964244:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144428.964248:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043ec00, rc 0) 00000100:00100000:2.0:1783144428.964317:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:73384:x1869759481726848:12345-192.168.203.4@tcp:101:touch.0 Request processed in 649us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144428.964325:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1322 00000100:00100000:1.0:1783144428.966402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144428.966574:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481726976 00000100:00100000:3.0:1783144428.966588:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481726976 00000100:00100000:3.0:1783144428.966668:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4990 00000100:00100000:3.0:1783144428.966685:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2406:x1869759481726976:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1783144428.967070:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2406:x1869759481726976:12345-192.168.203.4@tcp:2:touch.0 Request processed in 392us (674us total) trans 4294968831 rc 0/0 00000100:00100000:3.0:1783144428.967088:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4990 00000100:00080000:3.0:1783144428.967269:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144428.968578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144428.968713:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481727232 00000100:00100000:2.0:1783144428.968747:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481727232 00000100:00100000:2.0:1783144428.968805:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:2.0:1783144428.968818:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:73384:x1869759481727232:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1783144428.969135:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:73384:x1869759481727232:12345-192.168.203.4@tcp:35:touch.0 Request processed in 320us (561us total) trans 120259084295 rc 0/0 00000100:00100000:2.0:1783144428.969143:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 241 00000100:00100000:2.0:1783144428.970359:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144428.970420:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481727488 00000100:00100000:3.0:1783144428.970429:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481727488 00000100:00100000:3.0:1783144428.970484:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1323 00000100:00100000:3.0:1783144428.970501:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:73384:x1869759481727488:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144428.970522:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144428.970546:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a423049622 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e08 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.970675:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.970692:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.970706:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.970830:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.970839:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.970847:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144428.971129:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x763:0x0], index 0: 0 00010000:00010000:3.0:1783144428.971245:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049637 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971262:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049637 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971268:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049637 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971303:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971310:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971317:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971324:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971331:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144428.971336:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971345:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971362:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144428.971366:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144428.971371:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971390:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049629 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144428.971415:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002759a40f reply state 00000000a56848ac transno 120259084296 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971428:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971436:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9c2ac676cf00) 00010000:00010000:3.0:1783144428.971438:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144428.971441:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144428.971474:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a423049622 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e08 expref: 26 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971494:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049637 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e08 expref: 25 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.971502:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c2ac676c800) 00010000:00010000:3.0:1783144428.971505:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144428.971507:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34a00, rc 0) 00000100:00100000:3.0:1783144428.971553:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:73384:x1869759481727488:12345-192.168.203.4@tcp:101:touch.0 Request processed in 1059us (1199us total) trans 120259084296 rc 0/0 00000100:00100000:3.0:1783144428.971559:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1323 00000100:00100000:3.0:1783144428.973578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.973640:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481727744 00000100:00100000:0.0:1783144428.973651:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481727744 00000100:00100000:0.0:1783144428.973703:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1324 00000100:00100000:0.0:1783144428.973714:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:73384:x1869759481727744:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144428.973800:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144428.973824:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049637 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e08 expref: 26 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.973837:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c2ac676c800) 00010000:00010000:0.0:1783144428.973845:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144428.973885:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.973895:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.973905:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144428.974125:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b936198 reply state 00000000812c0287 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.974135:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.974139:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:0.0:1783144428.974142:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144428.974143:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144428.974211:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:73384:x1869759481727744:12345-192.168.203.4@tcp:36:touch.0 Request processed in 499us (641us total) trans 120259084297 rc 0/0 00000100:00100000:0.0:1783144428.974218:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1324 00000100:00100000:1.0:1783144428.975238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144428.975296:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481727872 00000100:00100000:3.0:1783144428.975306:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481727872 00000100:00100000:3.0:1783144428.975352:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1325 00000100:00100000:3.0:1783144428.975363:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:73384:x1869759481727872:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144428.975395:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144428.975420:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35200/0xad8e53a42304964c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e0f expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.975467:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35200/0xad8e53a42304964c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e0f expref: 28 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.975478:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35200/0xad8e53a42304964c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e0f expref: 28 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.975492:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:3.0:1783144428.975495:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144428.975497:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35200, rc 0) 00000100:00100000:3.0:1783144428.975547:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:73384:x1869759481727872:12345-192.168.203.4@tcp:101:touch.0 Request processed in 188us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144428.975552:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1325 00000100:00100000:2.0:1783144428.977225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144428.977264:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481728000 00000100:00100000:3.0:1783144428.977275:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481728000 00000100:00100000:3.0:1783144428.977333:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4991 00000100:00100000:3.0:1783144428.977346:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2405:x1869759481728000:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1783144428.977550:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2405:x1869759481728000:12345-192.168.203.4@tcp:2:touch.0 Request processed in 208us (328us total) trans 4294968832 rc 0/0 00000100:00100000:3.0:1783144428.977555:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4991 00000100:00100000:1.0:1783144428.979172:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.979481:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481728256 00000100:00100000:0.0:1783144428.979491:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481728256 00000100:00100000:0.0:1783144428.979541:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:0.0:1783144428.979574:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:73384:x1869759481728256:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144428.979859:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:73384:x1869759481728256:12345-192.168.203.4@tcp:35:touch.0 Request processed in 287us (690us total) trans 120259084298 rc 0/0 00000100:00100000:0.0:1783144428.979866:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:0.0:1783144428.982142:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144428.982243:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481728512 00000100:00100000:1.0:1783144428.982249:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481728512 00000100:00100000:1.0:1783144428.982291:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1326 00000100:00100000:1.0:1783144428.982298:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:73384:x1869759481728512:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1783144428.982316:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144428.982334:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049653 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e16 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982421:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982434:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982443:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982466:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982473:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982478:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783144428.982802:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x764:0x0], index 0: 0 00010000:00010000:1.0:1783144428.982905:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049668 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982914:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049668 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982932:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049668 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982962:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982970:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982976:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982982:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.982988:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144428.982997:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.983004:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.983014:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144428.983017:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144428.983021:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.983027:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a42304965a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144428.983037:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091453e2b reply state 0000000002f8ce82 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.983046:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.983052:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9c2af565cd00) 00010000:00010000:1.0:1783144428.983054:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144428.983056:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144428.983078:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049653 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e16 expref: 32 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.983091:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049668 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e16 expref: 31 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.983097:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c800) 00010000:00010000:1.0:1783144428.983099:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144428.983106:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0200, rc 0) 00000100:00100000:1.0:1783144428.983148:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:73384:x1869759481728512:12345-192.168.203.4@tcp:101:touch.0 Request processed in 850us (1010us total) trans 120259084299 rc 0/0 00000100:00100000:1.0:1783144428.983155:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1326 00000100:00100000:2.0:1783144428.985556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144428.985595:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481728768 00000100:00100000:1.0:1783144428.985603:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481728768 00000100:00100000:1.0:1783144428.985673:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1327 00000100:00100000:1.0:1783144428.985682:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:73384:x1869759481728768:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1783144428.985719:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144428.985758:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049668 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e16 expref: 32 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.985773:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c800) 00010000:00010000:1.0:1783144428.985779:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144428.985807:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.985814:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.985820:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144428.985877:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047f12004 reply state 00000000d617f4d3 transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.985884:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144428.985888:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:1.0:1783144428.985896:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144428.985898:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144428.985958:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:73384:x1869759481728768:12345-192.168.203.4@tcp:36:touch.0 Request processed in 278us (405us total) trans 120259084300 rc 0/0 00000100:00100000:1.0:1783144428.985963:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1327 00000100:00100000:3.0:1783144428.986944:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144428.986974:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481728896 00000100:00100000:2.0:1783144428.986978:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481728896 00000100:00100000:2.0:1783144428.987006:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1328 00000100:00100000:2.0:1783144428.987011:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:73384:x1869759481728896:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144428.987020:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144428.987028:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a42304967d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e1d expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.987065:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a42304967d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e1d expref: 34 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.987073:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e800/0xad8e53a42304967d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e1d expref: 34 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144428.987083:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:2.0:1783144428.987085:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144428.987086:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043e800, rc 0) 00000100:00100000:2.0:1783144428.987111:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:73384:x1869759481728896:12345-192.168.203.4@tcp:101:touch.0 Request processed in 100us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144428.987115:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1328 00000100:00100000:2.0:1783144428.988416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.988452:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481729024 00000100:00100000:0.0:1783144428.988458:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481729024 00000100:00100000:0.0:1783144428.988500:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4992 00000100:00100000:0.0:1783144428.988514:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481729024:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1783144428.988655:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2403:x1869759481729024:12345-192.168.203.4@tcp:2:touch.0 Request processed in 147us (242us total) trans 4294968833 rc 0/0 00000100:00100000:0.0:1783144428.988671:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4992 00000100:00100000:0.0:1783144428.989921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144428.989968:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481729280 00000100:00100000:1.0:1783144428.989974:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481729280 00000100:00100000:1.0:1783144428.990014:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:1.0:1783144428.990022:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:73384:x1869759481729280:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1783144428.990428:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:73384:x1869759481729280:12345-192.168.203.4@tcp:35:touch.0 Request processed in 406us (508us total) trans 120259084301 rc 0/0 00000100:00100000:1.0:1783144428.990443:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 243 00000100:00100000:3.0:1783144428.992315:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.992349:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481729536 00000100:00100000:0.0:1783144428.992354:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481729536 00000100:00100000:0.0:1783144428.992396:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1329 00000100:00100000:0.0:1783144428.992406:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:73384:x1869759481729536:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144428.992419:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144428.992432:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8000/0xad8e53a423049684 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e24 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992505:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992516:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992535:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992545:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992549:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992553:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783144428.992791:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x765:0x0], index 0: 0 00010000:00010000:0.0:1783144428.992890:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049699 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992898:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049699 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992903:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049699 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992926:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992931:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992934:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992938:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992947:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144428.992950:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992955:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992963:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144428.992965:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144428.992967:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992972:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304968b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144428.992979:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efd4b413 reply state 000000003ea73895 transno 120259084302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992986:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.992989:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9c29ca14fe00) 00010000:00010000:0.0:1783144428.992991:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144428.992992:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783144428.993010:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8000/0xad8e53a423049684 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e24 expref: 38 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.993017:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049699 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e24 expref: 37 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.993029:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:0.0:1783144428.993031:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144428.993032:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8200, rc 0) 00000100:00100000:0.0:1783144428.993070:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:73384:x1869759481729536:12345-192.168.203.4@tcp:101:touch.0 Request processed in 665us (757us total) trans 120259084302 rc 0/0 00000100:00100000:0.0:1783144428.993077:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1329 00000100:00100000:2.0:1783144428.994793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144428.994996:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481729792 00000100:00100000:0.0:1783144428.995002:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481729792 00000100:00100000:0.0:1783144428.995039:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1330 00000100:00100000:0.0:1783144428.995048:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:73384:x1869759481729792:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144428.995083:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144428.995099:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049699 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e24 expref: 38 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.995111:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:0.0:1783144428.995119:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144428.995148:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.995158:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.995167:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144428.995232:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d5b8d93 reply state 00000000ab18ce75 transno 120259084303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.995257:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144428.995263:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:0.0:1783144428.995266:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144428.995268:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144428.995318:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:73384:x1869759481729792:12345-192.168.203.4@tcp:36:touch.0 Request processed in 271us (527us total) trans 120259084303 rc 0/0 00000100:00100000:0.0:1783144428.995325:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1330 00000100:00100000:2.0:1783144428.997239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144428.997288:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481729920 00000100:00100000:3.0:1783144428.997299:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481729920 00000100:00100000:3.0:1783144428.997336:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1331 00000100:00100000:3.0:1783144428.997346:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:73384:x1869759481729920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144428.997366:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144428.997384:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a4230496ae lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e2b expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.997413:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a4230496ae lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e2b expref: 40 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.997421:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34400/0xad8e53a4230496ae lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e2b expref: 40 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144428.997440:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:3.0:1783144428.997442:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144428.997444:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34400, rc 0) 00000100:00100000:3.0:1783144428.997474:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:73384:x1869759481729920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 130us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144428.997478:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1331 00000100:00100000:3.0:1783144428.998596:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144428.998632:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481730048 00000100:00100000:2.0:1783144428.998637:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481730048 00000100:00100000:2.0:1783144428.998678:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4993 00000100:00100000:2.0:1783144428.998687:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2404:x1869759481730048:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144428.998852:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2404:x1869759481730048:12345-192.168.203.4@tcp:2:touch.0 Request processed in 167us (257us total) trans 4294968834 rc 0/0 00000100:00100000:2.0:1783144428.998859:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4993 00000100:00100000:2.0:1783144428.999872:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.000060:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481730304 00000100:00100000:1.0:1783144429.000066:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481730304 00000100:00100000:1.0:1783144429.000110:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:1.0:1783144429.000119:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:73384:x1869759481730304:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1783144429.000294:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+41:73384:x1869759481730304:12345-192.168.203.4@tcp:35:touch.0 Request processed in 175us (423us total) trans 120259084304 rc 0/0 00000100:00100000:1.0:1783144429.000301:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:0.0:1783144429.001719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.001810:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481730560 00000100:00100000:1.0:1783144429.001818:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481730560 00000100:00100000:1.0:1783144429.001863:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1332 00000100:00100000:1.0:1783144429.001873:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+41:73384:x1869759481730560:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1783144429.001889:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144429.001904:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230496b5 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e32 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.001994:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002009:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002018:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002031:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002038:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002044:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783144429.002270:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x766:0x0], index 0: 0 00010000:00010000:1.0:1783144429.002369:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230496ca lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002390:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230496ca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002398:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230496ca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002437:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002453:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002463:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002478:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002484:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144429.002488:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002496:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002514:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144429.002518:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144429.002529:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002536:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a4230496bc lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144429.002548:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ace24ab8 reply state 00000000704fd9e6 transno 120259084305 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002557:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002563:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9c2af565c800) 00010000:00010000:1.0:1783144429.002571:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144429.002573:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144429.002597:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230496b5 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e32 expref: 44 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002609:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230496ca lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e32 expref: 43 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.002617:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:1.0:1783144429.002619:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144429.002621:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1a00, rc 0) 00000100:00100000:1.0:1783144429.002670:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:73384:x1869759481730560:12345-192.168.203.4@tcp:101:touch.0 Request processed in 800us (961us total) trans 120259084305 rc 0/0 00000100:00100000:1.0:1783144429.002687:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1332 00000100:00100000:3.0:1783144429.004502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.004898:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481730816 00000100:00100000:1.0:1783144429.004904:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481730816 00000100:00100000:1.0:1783144429.004939:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1333 00000100:00100000:1.0:1783144429.004946:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:73384:x1869759481730816:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1783144429.004986:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144429.005008:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230496ca lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e32 expref: 44 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.005020:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:1.0:1783144429.005026:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144429.005073:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.005085:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.005106:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144429.005175:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008dd929ee reply state 0000000003d97d1b transno 120259084306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.005183:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.005187:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:1.0:1783144429.005189:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144429.005190:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144429.005245:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:73384:x1869759481730816:12345-192.168.203.4@tcp:36:touch.0 Request processed in 299us (748us total) trans 120259084306 rc 0/0 00000100:00100000:1.0:1783144429.005251:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1333 00000100:00100000:2.0:1783144429.006294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.006436:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481730944 00000100:00100000:0.0:1783144429.006442:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481730944 00000100:00100000:0.0:1783144429.006481:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1334 00000100:00100000:0.0:1783144429.006491:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:73384:x1869759481730944:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144429.006506:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144429.006517:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8000/0xad8e53a4230496df lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e39 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.006562:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8000/0xad8e53a4230496df lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e39 expref: 46 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.006575:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8000/0xad8e53a4230496df lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e39 expref: 46 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.006599:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:0.0:1783144429.006602:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783144429.006605:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8000, rc 0) 00000100:00100000:0.0:1783144429.006647:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+46:73384:x1869759481730944:12345-192.168.203.4@tcp:101:touch.0 Request processed in 158us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144429.006655:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1334 00000100:00100000:0.0:1783144429.007924:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.007950:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481731072 00000100:00100000:2.0:1783144429.007961:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481731072 00000100:00100000:2.0:1783144429.007995:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4994 00000100:00100000:2.0:1783144429.008002:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2403:x1869759481731072:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.008173:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2403:x1869759481731072:12345-192.168.203.4@tcp:2:touch.0 Request processed in 170us (251us total) trans 4294968835 rc 0/0 00000100:00100000:2.0:1783144429.008184:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4994 00000100:00100000:3.0:1783144429.010684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.010807:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481731328 00000100:00100000:1.0:1783144429.010814:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481731328 00000100:00100000:1.0:1783144429.010866:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:1.0:1783144429.010876:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+46:73384:x1869759481731328:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1783144429.011068:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:73384:x1869759481731328:12345-192.168.203.4@tcp:35:touch.0 Request processed in 193us (398us total) trans 120259084307 rc 0/0 00000100:00100000:1.0:1783144429.011076:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 245 00000100:00100000:0.0:1783144429.012656:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.012775:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481731584 00000100:00100000:3.0:1783144429.012782:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481731584 00000100:00100000:3.0:1783144429.012819:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1335 00000100:00100000:3.0:1783144429.012827:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:73384:x1869759481731584:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.012842:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.012859:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a4230496e6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e40 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.012959:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.012973:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.012983:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.012996:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013002:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013007:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144429.013233:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x767:0x0], index 0: 0 00010000:00010000:3.0:1783144429.013339:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a4230496fb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013349:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a4230496fb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013356:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a4230496fb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013395:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013412:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013418:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013425:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013431:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144429.013435:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013442:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013452:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144429.013455:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144429.013459:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013465:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a4230496ed lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144429.013476:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000648b1ac6 reply state 0000000011dcb95e transno 120259084308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013486:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013492:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9c2ac676c700) 00010000:00010000:3.0:1783144429.013498:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144429.013500:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144429.013521:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a4230496e6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e40 expref: 50 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013534:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a4230496fb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e40 expref: 49 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.013541:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2ac676c100) 00010000:00010000:3.0:1783144429.013543:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144429.013546:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34000, rc 0) 00000100:00100000:3.0:1783144429.013591:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+50:73384:x1869759481731584:12345-192.168.203.4@tcp:101:touch.0 Request processed in 765us (940us total) trans 120259084308 rc 0/0 00000100:00100000:3.0:1783144429.013598:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1335 00000100:00100000:0.0:1783144429.016014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.016056:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481731840 00000100:00100000:1.0:1783144429.016064:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481731840 00000100:00100000:1.0:1783144429.016106:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1336 00000100:00100000:1.0:1783144429.016117:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+50:73384:x1869759481731840:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1783144429.016169:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144429.016192:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a4230496fb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e40 expref: 50 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.016207:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2ac676c100) 00010000:00010000:1.0:1783144429.016215:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144429.016252:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.016262:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.016270:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144429.016349:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f614b0a reply state 00000000e7bb4b67 transno 120259084309 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.016361:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.016367:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:1.0:1783144429.016370:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144429.016372:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144429.016444:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:73384:x1869759481731840:12345-192.168.203.4@tcp:36:touch.0 Request processed in 330us (432us total) trans 120259084309 rc 0/0 00000100:00100000:1.0:1783144429.016452:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1336 00000100:00100000:1.0:1783144429.019671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.019765:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481731968 00000100:00100000:3.0:1783144429.019770:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481731968 00000100:00100000:3.0:1783144429.019803:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1337 00000100:00100000:3.0:1783144429.019810:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:73384:x1869759481731968:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.019823:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.019833:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35000/0xad8e53a423049710 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e47 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.019865:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35000/0xad8e53a423049710 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e47 expref: 52 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.019873:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35000/0xad8e53a423049710 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e47 expref: 52 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.019898:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:3.0:1783144429.019900:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.019902:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f35000, rc 0) 00000100:00100000:3.0:1783144429.019937:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+52:73384:x1869759481731968:12345-192.168.203.4@tcp:101:touch.0 Request processed in 129us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.019942:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1337 00000100:00100000:0.0:1783144429.022789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.022843:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481732096 00000100:00100000:2.0:1783144429.022850:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481732096 00000100:00100000:2.0:1783144429.022895:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4995 00000100:00100000:2.0:1783144429.022903:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2406:x1869759481732096:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.023072:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2406:x1869759481732096:12345-192.168.203.4@tcp:2:touch.0 Request processed in 169us (287us total) trans 4294968836 rc 0/0 00000100:00100000:2.0:1783144429.023080:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4995 00000100:00100000:0.0:1783144429.025697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.025830:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481732352 00000100:00100000:2.0:1783144429.025846:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481732352 00000100:00100000:2.0:1783144429.025885:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:2.0:1783144429.025902:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+52:73384:x1869759481732352:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1783144429.026111:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+53:73384:x1869759481732352:12345-192.168.203.4@tcp:35:touch.0 Request processed in 210us (418us total) trans 120259084310 rc 0/0 00000100:00100000:2.0:1783144429.026116:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:1.0:1783144429.027429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.027479:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481732608 00000100:00100000:2.0:1783144429.027484:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481732608 00000100:00100000:2.0:1783144429.027518:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1338 00000100:00100000:2.0:1783144429.027523:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+53:73384:x1869759481732608:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.027535:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.027568:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ea00/0xad8e53a423049717 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e4e expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.027651:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.027661:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.027668:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.027677:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.027681:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.027685:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144429.027944:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x768:0x0], index 0: 0 00010000:00010000:2.0:1783144429.028022:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a42304972c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028028:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a42304972c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028033:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a42304972c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028054:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028074:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028083:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028089:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028097:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144429.028101:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028109:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028119:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144429.028122:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144429.028132:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028138:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a42304971e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.028149:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fad849c7 reply state 000000008b26b36a transno 120259084311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028158:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028176:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9c2afa089600) 00010000:00010000:2.0:1783144429.028184:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.028187:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783144429.028210:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ea00/0xad8e53a423049717 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e4e expref: 56 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028223:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a42304972c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e4e expref: 55 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.028230:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089400) 00010000:00010000:2.0:1783144429.028232:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144429.028235:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49c400, rc 0) 00000100:00100000:2.0:1783144429.028275:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+56:73384:x1869759481732608:12345-192.168.203.4@tcp:101:touch.0 Request processed in 751us (848us total) trans 120259084311 rc 0/0 00000100:00100000:2.0:1783144429.028283:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1338 00000100:00100000:1.0:1783144429.029941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.029990:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481732864 00000100:00100000:2.0:1783144429.029995:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481732864 00000100:00100000:2.0:1783144429.030030:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1339 00000100:00100000:2.0:1783144429.030038:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+56:73384:x1869759481732864:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1783144429.030069:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144429.030082:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a42304972c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e4e expref: 56 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.030093:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089400) 00010000:00010000:2.0:1783144429.030100:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144429.030138:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.030147:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.030212:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.030271:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb45b5b2 reply state 00000000094de110 transno 120259084312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.030281:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.030287:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144429.030289:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.030291:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144429.030341:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+57:73384:x1869759481732864:12345-192.168.203.4@tcp:36:touch.0 Request processed in 303us (401us total) trans 120259084312 rc 0/0 00000100:00100000:2.0:1783144429.030355:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1339 00000100:00100000:0.0:1783144429.031354:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.031437:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481732992 00000100:00100000:2.0:1783144429.031441:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481732992 00000100:00100000:2.0:1783144429.031468:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1340 00000100:00100000:2.0:1783144429.031475:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+57:73384:x1869759481732992:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.031491:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.031501:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49de00/0xad8e53a423049741 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e55 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.031540:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49de00/0xad8e53a423049741 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e55 expref: 58 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.031548:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49de00/0xad8e53a423049741 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e55 expref: 58 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.031568:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144429.031570:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144429.031572:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49de00, rc 0) 00000100:00100000:2.0:1783144429.031605:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+58:73384:x1869759481732992:12345-192.168.203.4@tcp:101:touch.0 Request processed in 131us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144429.031609:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1340 00000100:00100000:1.0:1783144429.032816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.032850:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481733120 00000100:00100000:2.0:1783144429.032855:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481733120 00000100:00100000:2.0:1783144429.032887:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4996 00000100:00100000:2.0:1783144429.032896:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2403:x1869759481733120:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.033011:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:2403:x1869759481733120:12345-192.168.203.4@tcp:2:touch.0 Request processed in 117us (198us total) trans 4294968837 rc 0/0 00000100:00100000:2.0:1783144429.033016:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4996 00000100:00100000:0.0:1783144429.034328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.034374:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481733376 00000100:00100000:2.0:1783144429.034387:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481733376 00000100:00100000:2.0:1783144429.034452:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:2.0:1783144429.034461:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+58:73384:x1869759481733376:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1783144429.034620:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+59:73384:x1869759481733376:12345-192.168.203.4@tcp:35:touch.0 Request processed in 161us (292us total) trans 120259084313 rc 0/0 00000100:00100000:2.0:1783144429.034626:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 247 00000100:00100000:0.0:1783144429.035567:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.035608:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481733632 00000100:00100000:3.0:1783144429.035614:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481733632 00000100:00100000:3.0:1783144429.035641:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1341 00000100:00100000:3.0:1783144429.035653:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+59:73384:x1869759481733632:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.035666:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.035679:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049748 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e5c expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.035766:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.035779:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.035788:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.035798:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.035802:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.035817:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144429.036021:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x769:0x0], index 0: 0 00010000:00010000:3.0:1783144429.036125:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304975d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036134:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304975d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036141:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304975d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036170:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036176:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036181:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036186:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036192:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144429.036196:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036203:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036222:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144429.036225:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144429.036228:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036233:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304974f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144429.036244:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5d73e83 reply state 000000008af17171 transno 120259084314 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036252:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036259:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9c2ac676cd00) 00010000:00010000:3.0:1783144429.036261:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144429.036263:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144429.036289:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a423049748 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e5c expref: 62 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036307:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304975d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e5c expref: 61 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.036314:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2ac676c100) 00010000:00010000:3.0:1783144429.036316:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144429.036318:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34a00, rc 0) 00000100:00100000:3.0:1783144429.036353:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+62:73384:x1869759481733632:12345-192.168.203.4@tcp:101:touch.0 Request processed in 705us (785us total) trans 120259084314 rc 0/0 00000100:00100000:3.0:1783144429.036360:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1341 00000100:00100000:1.0:1783144429.038100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.038153:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481733888 00000100:00100000:0.0:1783144429.038158:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481733888 00000100:00100000:0.0:1783144429.038198:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1342 00000100:00100000:0.0:1783144429.038204:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+62:73384:x1869759481733888:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144429.038244:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144429.038260:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304975d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e5c expref: 62 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.038273:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2ac676c100) 00010000:00010000:0.0:1783144429.038290:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144429.038326:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.038336:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.038344:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144429.038427:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000493e1f60 reply state 00000000dae47499 transno 120259084315 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.038436:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.038440:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:0.0:1783144429.038441:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144429.038443:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144429.038494:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+63:73384:x1869759481733888:12345-192.168.203.4@tcp:36:touch.0 Request processed in 290us (397us total) trans 120259084315 rc 0/0 00000100:00100000:0.0:1783144429.038498:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1342 00000100:00100000:0.0:1783144429.039603:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.039639:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481734016 00000100:00100000:3.0:1783144429.039643:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481734016 00000100:00100000:3.0:1783144429.039678:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1343 00000100:00100000:3.0:1783144429.039687:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+63:73384:x1869759481734016:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.039699:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.039710:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34e00/0xad8e53a423049772 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e63 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.039763:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34e00/0xad8e53a423049772 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e63 expref: 64 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.039776:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34e00/0xad8e53a423049772 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e63 expref: 64 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.039791:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:3.0:1783144429.039794:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.039798:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34e00, rc 0) 00000100:00100000:3.0:1783144429.039836:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+64:73384:x1869759481734016:12345-192.168.203.4@tcp:101:touch.0 Request processed in 150us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.039843:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1343 00000100:00100000:2.0:1783144429.041765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.041801:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481734144 00000100:00100000:3.0:1783144429.041805:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481734144 00000100:00100000:3.0:1783144429.041832:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4997 00000100:00100000:3.0:1783144429.041839:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:2404:x1869759481734144:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1783144429.041963:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2404:x1869759481734144:12345-192.168.203.4@tcp:2:touch.0 Request processed in 125us (201us total) trans 4294968838 rc 0/0 00000100:00100000:3.0:1783144429.041967:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4997 00000100:00100000:3.0:1783144429.042818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.042844:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481734400 00000100:00100000:0.0:1783144429.042848:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481734400 00000100:00100000:0.0:1783144429.042879:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 248 00000100:00100000:0.0:1783144429.042884:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef5c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+64:73384:x1869759481734400:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.043297:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef5c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+65:73384:x1869759481734400:12345-192.168.203.4@tcp:35:touch.0 Request processed in 412us (479us total) trans 120259084316 rc 0/0 00000100:00100000:0.0:1783144429.043302:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 248 00000100:00100000:0.0:1783144429.044444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.044494:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481734656 00000100:00100000:2.0:1783144429.044500:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481734656 00000100:00100000:2.0:1783144429.044538:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1344 00000100:00100000:2.0:1783144429.044546:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+65:73384:x1869759481734656:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.044565:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.044578:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c800/0xad8e53a423049779 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e6a expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.044643:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.044656:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.044665:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.044677:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.044684:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.044691:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144429.044942:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76a:0x0], index 0: 0 00010000:00010000:2.0:1783144429.045032:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a42304978e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045041:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a42304978e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045049:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a42304978e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045087:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045094:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045100:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045107:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045113:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49c600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144429.045117:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045124:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045134:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144429.045136:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144429.045140:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045147:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049780 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.045157:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001197430c reply state 00000000caaff676 transno 120259084317 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045167:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045178:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9c2afa089400) 00010000:00010000:2.0:1783144429.045180:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.045183:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783144429.045204:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c800/0xad8e53a423049779 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e6a expref: 68 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045216:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a42304978e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e6a expref: 67 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.045223:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2afa089f00) 00010000:00010000:2.0:1783144429.045226:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144429.045228:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49d600, rc 0) 00000100:00100000:2.0:1783144429.045265:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+68:73384:x1869759481734656:12345-192.168.203.4@tcp:101:touch.0 Request processed in 720us (822us total) trans 120259084317 rc 0/0 00000100:00100000:2.0:1783144429.045271:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1344 00000100:00100000:2.0:1783144429.046628:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.046678:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481734912 00000100:00100000:1.0:1783144429.046683:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481734912 00000100:00100000:1.0:1783144429.046714:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1345 00000100:00100000:1.0:1783144429.046747:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+68:73384:x1869759481734912:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1783144429.046775:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144429.046788:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a42304978e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e6a expref: 68 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.046899:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2afa089f00) 00010000:00010000:1.0:1783144429.046906:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144429.046938:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.046948:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.046956:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144429.047010:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de08e0a7 reply state 0000000012d30b09 transno 120259084318 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.047019:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.047025:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:1.0:1783144429.047028:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144429.047030:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144429.047199:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+69:73384:x1869759481734912:12345-192.168.203.4@tcp:36:touch.0 Request processed in 477us (571us total) trans 120259084318 rc 0/0 00000100:00100000:1.0:1783144429.047217:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1345 00000100:00100000:3.0:1783144429.048548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.048606:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481735040 00000100:00100000:2.0:1783144429.048612:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481735040 00000100:00100000:2.0:1783144429.048647:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1346 00000100:00100000:2.0:1783144429.048656:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+69:73384:x1869759481735040:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.048670:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.048680:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49dc00/0xad8e53a4230497a3 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e71 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.048708:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49dc00/0xad8e53a4230497a3 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e71 expref: 70 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.048764:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49dc00/0xad8e53a4230497a3 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e71 expref: 70 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.048780:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:2.0:1783144429.048782:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144429.048785:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49dc00, rc 0) 00000100:00100000:2.0:1783144429.048812:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+70:73384:x1869759481735040:12345-192.168.203.4@tcp:101:touch.0 Request processed in 158us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144429.048818:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1346 00000100:00100000:0.0:1783144429.050565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.050626:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481735168 00000100:00100000:2.0:1783144429.050632:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481735168 00000100:00100000:2.0:1783144429.050665:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4998 00000100:00100000:2.0:1783144429.050673:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2403:x1869759481735168:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.050858:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:2403:x1869759481735168:12345-192.168.203.4@tcp:2:touch.0 Request processed in 185us (295us total) trans 4294968839 rc 0/0 00000100:00100000:2.0:1783144429.050866:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4998 00000100:00100000:0.0:1783144429.052456:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.052499:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481735424 00000100:00100000:2.0:1783144429.052505:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481735424 00000100:00100000:2.0:1783144429.052540:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:2.0:1783144429.052549:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+70:73384:x1869759481735424:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1783144429.052772:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+71:73384:x1869759481735424:12345-192.168.203.4@tcp:35:touch.0 Request processed in 223us (315us total) trans 120259084319 rc 0/0 00000100:00100000:2.0:1783144429.052781:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 249 00000100:00100000:3.0:1783144429.053896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.053938:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481735680 00000100:00100000:0.0:1783144429.053944:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481735680 00000100:00100000:0.0:1783144429.053983:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1347 00000100:00100000:0.0:1783144429.053991:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+71:73384:x1869759481735680:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:0.0:1783144429.054013:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144429.054028:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230497aa lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e78 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054095:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054109:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054119:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054132:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054140:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054146:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783144429.054370:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76b:0x0], index 0: 0 00010000:00010000:0.0:1783144429.054494:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230497bf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054504:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230497bf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054511:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230497bf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054552:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054559:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054565:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054577:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054583:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144429.054587:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054594:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054606:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144429.054609:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144429.054613:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054620:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a4230497b1 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144429.054631:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001da37fdd reply state 0000000005700fad transno 120259084320 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054641:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054653:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9c29ca14f900) 00010000:00010000:0.0:1783144429.054655:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144429.054673:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783144429.054695:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a4230497aa lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e78 expref: 74 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054708:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230497bf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e78 expref: 73 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.054715:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:0.0:1783144429.054717:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144429.054749:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01600, rc 0) 00000100:00100000:0.0:1783144429.054790:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+74:73384:x1869759481735680:12345-192.168.203.4@tcp:101:touch.0 Request processed in 799us (893us total) trans 120259084320 rc 0/0 00000100:00100000:0.0:1783144429.054797:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1347 00000100:00100000:0.0:1783144429.056113:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.056148:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481735936 00000100:00100000:1.0:1783144429.056154:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481735936 00000100:00100000:1.0:1783144429.056190:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1348 00000100:00100000:1.0:1783144429.056199:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+74:73384:x1869759481735936:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:1.0:1783144429.056229:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144429.056244:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a4230497bf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e78 expref: 74 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.056257:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c29ca14f300) 00010000:00010000:1.0:1783144429.056266:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144429.056293:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.056300:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.056306:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144429.056359:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052233c82 reply state 000000000a6f576c transno 120259084321 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.056369:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.056374:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:1.0:1783144429.056386:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144429.056393:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144429.056443:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+75:73384:x1869759481735936:12345-192.168.203.4@tcp:36:touch.0 Request processed in 245us (330us total) trans 120259084321 rc 0/0 00000100:00100000:1.0:1783144429.056451:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1348 00000100:00100000:2.0:1783144429.057239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.057296:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481736064 00000100:00100000:3.0:1783144429.057301:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481736064 00000100:00100000:3.0:1783144429.057343:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1349 00000100:00100000:3.0:1783144429.057351:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+75:73384:x1869759481736064:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.057362:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.057373:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a4230497d4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e7f expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.057414:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a4230497d4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e7f expref: 76 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.057426:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34800/0xad8e53a4230497d4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e7f expref: 76 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.057441:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:3.0:1783144429.057445:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.057448:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af6f34800, rc 0) 00000100:00100000:3.0:1783144429.057475:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+76:73384:x1869759481736064:12345-192.168.203.4@tcp:101:touch.0 Request processed in 126us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.057480:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1349 00000100:00100000:3.0:1783144429.058302:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.058366:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481736192 00000100:00100000:0.0:1783144429.058370:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481736192 00000100:00100000:0.0:1783144429.058412:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4999 00000100:00100000:0.0:1783144429.058418:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:2404:x1869759481736192:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1783144429.058514:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:2404:x1869759481736192:12345-192.168.203.4@tcp:2:touch.0 Request processed in 96us (211us total) trans 4294968840 rc 0/0 00000100:00100000:0.0:1783144429.058518:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4999 00000100:00100000:0.0:1783144429.059930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.059966:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481736448 00000100:00100000:1.0:1783144429.059970:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481736448 00000100:00100000:1.0:1783144429.059998:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:1.0:1783144429.060003:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+76:73384:x1869759481736448:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:1.0:1783144429.060155:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+77:73384:x1869759481736448:12345-192.168.203.4@tcp:35:touch.0 Request processed in 150us (225us total) trans 120259084322 rc 0/0 00000100:00100000:1.0:1783144429.060160:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:2.0:1783144429.061426:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144429.061492:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481736704 00000100:00100000:1.0:1783144429.061497:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481736704 00000100:00100000:1.0:1783144429.061528:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1350 00000100:00100000:1.0:1783144429.061536:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+77:73384:x1869759481736704:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:1.0:1783144429.061548:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144429.061562:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230497db lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e86 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.061628:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.061641:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.061648:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.061657:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.061670:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.061674:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783144429.061959:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76c:0x0], index 0: 0 00010000:00010000:1.0:1783144429.062060:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0000/0xad8e53a4230497f0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062068:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0000/0xad8e53a4230497f0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062075:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0000/0xad8e53a4230497f0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062100:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062107:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062112:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062117:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062122:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144429.062125:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062141:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062152:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144429.062155:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144429.062159:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062166:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1a00/0xad8e53a4230497e2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144429.062177:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea4810eb reply state 0000000000c65b2a transno 120259084323 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062187:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062193:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9c2af565cf00) 00010000:00010000:1.0:1783144429.062195:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144429.062198:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144429.062219:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a4230497db lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e86 expref: 80 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062232:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0000/0xad8e53a4230497f0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e86 expref: 79 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144429.062239:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2af565c400) 00010000:00010000:1.0:1783144429.062242:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144429.062244:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0000, rc 0) 00000100:00100000:1.0:1783144429.062279:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+80:73384:x1869759481736704:12345-192.168.203.4@tcp:101:touch.0 Request processed in 744us (855us total) trans 120259084323 rc 0/0 00000100:00100000:1.0:1783144429.062284:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1350 00000100:00100000:3.0:1783144429.063776:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.063823:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481736960 00000100:00100000:2.0:1783144429.063829:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481736960 00000100:00100000:2.0:1783144429.063867:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1351 00000100:00100000:2.0:1783144429.063876:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+80:73384:x1869759481736960:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1783144429.063918:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144429.063933:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0000/0xad8e53a4230497f0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e86 expref: 80 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.063945:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2af565c400) 00010000:00010000:2.0:1783144429.063951:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144429.063981:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.063990:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.063998:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.064052:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebfd54e3 reply state 000000007900a774 transno 120259084324 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.064061:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.064067:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:2.0:1783144429.064069:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.064071:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144429.064123:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+81:73384:x1869759481736960:12345-192.168.203.4@tcp:36:touch.0 Request processed in 247us (348us total) trans 120259084324 rc 0/0 00000100:00100000:2.0:1783144429.064140:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1351 00000100:00100000:0.0:1783144429.065474:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.065509:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481737088 00000100:00100000:2.0:1783144429.065515:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481737088 00000100:00100000:2.0:1783144429.065548:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1352 00000100:00100000:2.0:1783144429.065553:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+81:73384:x1869759481737088:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.065562:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.065570:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d800/0xad8e53a423049805 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e8d expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.065610:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d800/0xad8e53a423049805 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e8d expref: 82 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.065622:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d800/0xad8e53a423049805 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e8d expref: 82 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.065637:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:2.0:1783144429.065640:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144429.065643:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49d800, rc 0) 00000100:00100000:2.0:1783144429.065685:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+82:73384:x1869759481737088:12345-192.168.203.4@tcp:101:touch.0 Request processed in 130us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144429.065692:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1352 00000100:00100000:0.0:1783144429.066715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.066813:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481737216 00000100:00100000:3.0:1783144429.066817:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481737216 00000100:00100000:2.0:1783144429.066914:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5000 00000100:00100000:2.0:1783144429.066925:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:2404:x1869759481737216:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.067048:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:2404:x1869759481737216:12345-192.168.203.4@tcp:2:touch.0 Request processed in 125us (332us total) trans 4294968841 rc 0/0 00000100:00100000:2.0:1783144429.067065:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5000 00000100:00100000:1.0:1783144429.067872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.067913:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481737472 00000100:00100000:2.0:1783144429.067918:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481737472 00000100:00100000:2.0:1783144429.067952:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:2.0:1783144429.067960:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+82:73384:x1869759481737472:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1783144429.068114:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+83:73384:x1869759481737472:12345-192.168.203.4@tcp:35:touch.0 Request processed in 154us (243us total) trans 120259084325 rc 0/0 00000100:00100000:2.0:1783144429.068121:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 251 00000100:00100000:0.0:1783144429.069278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.069322:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481737728 00000100:00100000:3.0:1783144429.069334:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481737728 00000100:00100000:3.0:1783144429.069363:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1353 00000100:00100000:3.0:1783144429.069371:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+83:73384:x1869759481737728:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.069393:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.069406:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304980c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e94 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069471:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069483:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069492:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069513:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069521:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069527:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144429.069758:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76d:0x0], index 0: 0 00010000:00010000:3.0:1783144429.069853:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031400/0xad8e53a423049821 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069862:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031400/0xad8e53a423049821 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069879:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031400/0xad8e53a423049821 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069909:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069923:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069928:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069934:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069939:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144429.069943:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069950:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069960:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144429.069962:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144429.069964:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069969:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a423049813 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144429.069977:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000944e311d reply state 00000000715916a9 transno 120259084326 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069988:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.069992:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9c2ac676c800) 00010000:00010000:3.0:1783144429.069993:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144429.069995:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144429.070012:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a42304980c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e94 expref: 86 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.070020:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031400/0xad8e53a423049821 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e94 expref: 85 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.070024:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2ac676c100) 00010000:00010000:3.0:1783144429.070026:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144429.070027:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac0031400, rc 0) 00000100:00100000:3.0:1783144429.070052:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+86:73384:x1869759481737728:12345-192.168.203.4@tcp:101:touch.0 Request processed in 683us (777us total) trans 120259084326 rc 0/0 00000100:00100000:3.0:1783144429.070056:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1353 00000100:00100000:1.0:1783144429.071038:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.071082:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481737984 00000100:00100000:0.0:1783144429.071087:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481737984 00000100:00100000:0.0:1783144429.071121:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1354 00000100:00100000:0.0:1783144429.071129:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+86:73384:x1869759481737984:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144429.071168:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144429.071181:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031400/0xad8e53a423049821 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e94 expref: 86 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.071194:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2ac676c100) 00010000:00010000:0.0:1783144429.071201:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144429.071227:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.071237:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.071244:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144429.071297:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f317e7e9 reply state 000000005583ad78 transno 120259084327 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.071307:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.071314:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:0.0:1783144429.071316:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144429.071318:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144429.071364:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+87:73384:x1869759481737984:12345-192.168.203.4@tcp:36:touch.0 Request processed in 236us (327us total) trans 120259084327 rc 0/0 00000100:00100000:0.0:1783144429.071393:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1354 00000100:00100000:1.0:1783144429.072062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.072096:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481738112 00000100:00100000:3.0:1783144429.072101:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481738112 00000100:00100000:3.0:1783144429.072132:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1355 00000100:00100000:3.0:1783144429.072141:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+87:73384:x1869759481738112:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.072153:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.072163:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031a00/0xad8e53a423049836 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41e9b expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.072191:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031a00/0xad8e53a423049836 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e9b expref: 88 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.072209:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031a00/0xad8e53a423049836 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41e9b expref: 88 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.072224:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:3.0:1783144429.072227:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.072229:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2ac0031a00, rc 0) 00000100:00100000:3.0:1783144429.072259:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+88:73384:x1869759481738112:12345-192.168.203.4@tcp:101:touch.0 Request processed in 121us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.072266:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1355 00000100:00100000:1.0:1783144429.073127:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.073165:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481738240 00000100:00100000:0.0:1783144429.073170:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481738240 00000100:00100000:0.0:1783144429.073206:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5001 00000100:00100000:0.0:1783144429.073214:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:2403:x1869759481738240:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1783144429.073334:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:2403:x1869759481738240:12345-192.168.203.4@tcp:2:touch.0 Request processed in 120us (207us total) trans 4294968842 rc 0/0 00000100:00100000:0.0:1783144429.073341:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5001 00000100:00100000:1.0:1783144429.074111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.074164:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481738496 00000100:00100000:0.0:1783144429.074168:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481738496 00000100:00100000:0.0:1783144429.074197:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:0.0:1783144429.074204:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+88:73384:x1869759481738496:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.074396:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+89:73384:x1869759481738496:12345-192.168.203.4@tcp:35:touch.0 Request processed in 191us (284us total) trans 120259084328 rc 0/0 00000100:00100000:0.0:1783144429.074403:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 252 00000100:00100000:1.0:1783144429.075259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.075303:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481738752 00000100:00100000:2.0:1783144429.075309:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481738752 00000100:00100000:2.0:1783144429.075341:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1356 00000100:00100000:2.0:1783144429.075350:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+89:73384:x1869759481738752:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.075363:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.075384:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a42304983d lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ea2 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075463:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075475:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075484:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075498:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075515:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075522:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144429.075747:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76e:0x0], index 0: 0 00010000:00010000:2.0:1783144429.075833:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049852 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075840:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049852 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075845:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049852 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075863:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075867:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075870:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075874:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075878:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49c000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144429.075880:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075893:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075903:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144429.075906:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144429.075910:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075916:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049844 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.075926:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001727b613 reply state 000000004352ac8e transno 120259084329 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075936:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075942:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9c2afa089800) 00010000:00010000:2.0:1783144429.075943:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.075945:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783144429.075962:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a42304983d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ea2 expref: 92 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075971:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049852 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ea2 expref: 91 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.075976:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089d00) 00010000:00010000:2.0:1783144429.075977:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144429.075978:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49d000, rc 0) 00000100:00100000:2.0:1783144429.076007:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+92:73384:x1869759481738752:12345-192.168.203.4@tcp:101:touch.0 Request processed in 660us (750us total) trans 120259084329 rc 0/0 00000100:00100000:2.0:1783144429.076013:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1356 00000100:00100000:1.0:1783144429.077034:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.077068:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481739008 00000100:00100000:2.0:1783144429.077074:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481739008 00000100:00100000:2.0:1783144429.077105:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1357 00000100:00100000:2.0:1783144429.077113:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+92:73384:x1869759481739008:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1783144429.077139:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144429.077152:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049852 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ea2 expref: 92 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.077163:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089d00) 00010000:00010000:2.0:1783144429.077170:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144429.077193:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.077202:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.077209:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.077266:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058da00a7 reply state 000000002575aa08 transno 120259084330 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.077276:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.077282:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:2.0:1783144429.077284:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.077292:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144429.077341:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+93:73384:x1869759481739008:12345-192.168.203.4@tcp:36:touch.0 Request processed in 228us (308us total) trans 120259084330 rc 0/0 00000100:00100000:2.0:1783144429.077353:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1357 00000100:00100000:1.0:1783144429.078094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.078133:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481739136 00000100:00100000:2.0:1783144429.078138:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481739136 00000100:00100000:2.0:1783144429.078215:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1358 00000100:00100000:2.0:1783144429.078224:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+93:73384:x1869759481739136:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.078234:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.078243:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049867 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ea9 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.078267:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049867 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ea9 expref: 94 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.078277:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c600/0xad8e53a423049867 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ea9 expref: 94 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.078289:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:2.0:1783144429.078292:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144429.078294:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49c600, rc 0) 00000100:00100000:2.0:1783144429.078323:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+94:73384:x1869759481739136:12345-192.168.203.4@tcp:101:touch.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144429.078329:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1358 00000100:00100000:1.0:1783144429.079156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.079325:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481739264 00000100:00100000:0.0:1783144429.079330:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481739264 00000100:00100000:0.0:1783144429.079361:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5002 00000100:00100000:0.0:1783144429.079368:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:2403:x1869759481739264:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:0.0:1783144429.079495:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:2403:x1869759481739264:12345-192.168.203.4@tcp:2:touch.0 Request processed in 127us (339us total) trans 4294968843 rc 0/0 00000100:00100000:0.0:1783144429.079503:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5002 00000100:00100000:1.0:1783144429.080222:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.080268:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481739520 00000100:00100000:0.0:1783144429.080273:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481739520 00000100:00100000:0.0:1783144429.080300:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:0.0:1783144429.080316:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+94:73384:x1869759481739520:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.080455:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+95:73384:x1869759481739520:12345-192.168.203.4@tcp:35:touch.0 Request processed in 140us (238us total) trans 120259084331 rc 0/0 00000100:00100000:0.0:1783144429.080462:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 253 00000100:00100000:1.0:1783144429.081326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.081391:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481739776 00000100:00100000:3.0:1783144429.081394:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481739776 00000100:00100000:3.0:1783144429.081429:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1359 00000100:00100000:3.0:1783144429.081437:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+95:73384:x1869759481739776:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.081449:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.081460:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031400/0xad8e53a42304986e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41eb0 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081516:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081524:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081530:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081538:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081547:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081551:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144429.081783:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76f:0x0], index 0: 0 00010000:00010000:3.0:1783144429.081886:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049883 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081894:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049883 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081901:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049883 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081925:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081932:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081937:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081942:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081947:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144429.081950:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081966:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081975:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144429.081977:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144429.081981:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.081986:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35a00/0xad8e53a423049875 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144429.081996:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5c4ee5c reply state 00000000fddc69c7 transno 120259084332 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.082005:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.082011:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9c2ac676c100) 00010000:00010000:3.0:1783144429.082013:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144429.082014:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144429.082033:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031400/0xad8e53a42304986e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eb0 expref: 98 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.082044:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049883 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eb0 expref: 97 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.082062:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c2ac6738e00) 00010000:00010000:3.0:1783144429.082064:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144429.082067:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fc00, rc 0) 00000100:00100000:3.0:1783144429.082104:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+98:73384:x1869759481739776:12345-192.168.203.4@tcp:101:touch.0 Request processed in 668us (778us total) trans 120259084332 rc 0/0 00000100:00100000:3.0:1783144429.082111:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1359 00000100:00100000:1.0:1783144429.083217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.083257:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481740032 00000100:00100000:0.0:1783144429.083263:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481740032 00000100:00100000:0.0:1783144429.083297:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1360 00000100:00100000:0.0:1783144429.083305:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+98:73384:x1869759481740032:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144429.083327:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144429.083341:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049883 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eb0 expref: 98 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.083352:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c2ac6738e00) 00010000:00010000:0.0:1783144429.083358:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144429.083394:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.083403:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.083411:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144429.083453:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c55a9672 reply state 0000000067556e69 transno 120259084333 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.083462:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.083478:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:0.0:1783144429.083480:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144429.083482:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144429.083529:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+99:73384:x1869759481740032:12345-192.168.203.4@tcp:36:touch.0 Request processed in 225us (311us total) trans 120259084333 rc 0/0 00000100:00100000:0.0:1783144429.083536:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1360 00000100:00100000:1.0:1783144429.084320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.084355:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481740160 00000100:00100000:3.0:1783144429.084360:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481740160 00000100:00100000:3.0:1783144429.084411:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1361 00000100:00100000:3.0:1783144429.084419:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+99:73384:x1869759481740160:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.084431:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.084441:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fe00/0xad8e53a423049898 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41eb7 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.084469:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fe00/0xad8e53a423049898 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eb7 expref: 100 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.084480:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fe00/0xad8e53a423049898 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eb7 expref: 100 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.084493:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:3.0:1783144429.084496:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.084498:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fe00, rc 0) 00000100:00100000:3.0:1783144429.084529:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+100:73384:x1869759481740160:12345-192.168.203.4@tcp:101:touch.0 Request processed in 110us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.084535:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1361 00000100:00100000:1.0:1783144429.085655:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.085696:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481740288 00000100:00100000:2.0:1783144429.085701:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481740288 00000100:00100000:2.0:1783144429.085763:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5003 00000100:00100000:2.0:1783144429.085773:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:2404:x1869759481740288:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.085911:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:2404:x1869759481740288:12345-192.168.203.4@tcp:2:touch.0 Request processed in 140us (255us total) trans 4294968844 rc 0/0 00000100:00100000:2.0:1783144429.085918:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5003 00000100:00100000:1.0:1783144429.086593:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.086649:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481740544 00000100:00100000:0.0:1783144429.086655:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481740544 00000100:00100000:0.0:1783144429.086685:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:0.0:1783144429.086694:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3674050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+100:73384:x1869759481740544:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.086832:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3674050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+101:73384:x1869759481740544:12345-192.168.203.4@tcp:35:touch.0 Request processed in 140us (240us total) trans 120259084334 rc 0/0 00000100:00100000:0.0:1783144429.086837:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 254 00000100:00100000:1.0:1783144429.087737:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.087794:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481740800 00000100:00100000:2.0:1783144429.087798:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481740800 00000100:00100000:2.0:1783144429.087825:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1362 00000100:00100000:2.0:1783144429.087833:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+101:73384:x1869759481740800:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.087843:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.087856:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304989f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ebe expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.087924:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.087935:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.087944:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.087956:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.087963:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.087968:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144429.088200:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x770:0x0], index 0: 0 00010000:00010000:2.0:1783144429.088294:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a4230498b4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088303:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a4230498b4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088309:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a4230498b4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088333:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088340:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088346:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088352:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088358:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49d200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144429.088362:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088369:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088390:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144429.088394:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144429.088398:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088422:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a4230498a6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.088434:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3afd62d reply state 00000000db99d94d transno 120259084335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088443:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088449:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9c2afa089d00) 00010000:00010000:2.0:1783144429.088451:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.088453:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783144429.088475:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304989f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ebe expref: 104 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088486:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a4230498b4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ebe expref: 103 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.088493:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c2afa089700) 00010000:00010000:2.0:1783144429.088495:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144429.088508:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49d600, rc 0) 00000100:00100000:2.0:1783144429.088543:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+104:73384:x1869759481740800:12345-192.168.203.4@tcp:101:touch.0 Request processed in 711us (820us total) trans 120259084335 rc 0/0 00000100:00100000:2.0:1783144429.088560:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1362 00000100:00100000:1.0:1783144429.089759:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.089802:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481741056 00000100:00100000:0.0:1783144429.089809:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481741056 00000100:00100000:0.0:1783144429.089841:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1363 00000100:00100000:0.0:1783144429.089849:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+104:73384:x1869759481741056:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144429.089877:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144429.089891:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a4230498b4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ebe expref: 104 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.089904:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c2afa089700) 00010000:00010000:0.0:1783144429.089912:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144429.089942:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.089963:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.089971:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144429.090024:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000178824f2 reply state 000000006f6a2f6b transno 120259084336 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.090034:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.090040:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:0.0:1783144429.090042:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144429.090044:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144429.090106:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+105:73384:x1869759481741056:12345-192.168.203.4@tcp:36:touch.0 Request processed in 257us (349us total) trans 120259084336 rc 0/0 00000100:00100000:0.0:1783144429.090113:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1363 00000100:00100000:1.0:1783144429.091085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.091119:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481741184 00000100:00100000:2.0:1783144429.091125:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481741184 00000100:00100000:2.0:1783144429.091156:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1364 00000100:00100000:2.0:1783144429.091164:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+105:73384:x1869759481741184:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.091182:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.091192:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c800/0xad8e53a4230498c9 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ec5 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.091221:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c800/0xad8e53a4230498c9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ec5 expref: 106 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.091232:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c800/0xad8e53a4230498c9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ec5 expref: 106 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.091246:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:2.0:1783144429.091249:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144429.091251:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49c800, rc 0) 00000100:00100000:2.0:1783144429.091282:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+106:73384:x1869759481741184:12345-192.168.203.4@tcp:101:touch.0 Request processed in 119us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144429.091289:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1364 00000100:00100000:1.0:1783144429.092288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.092323:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481741312 00000100:00100000:2.0:1783144429.092328:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481741312 00000100:00100000:2.0:1783144429.092366:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5004 00000100:00100000:2.0:1783144429.092374:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:2403:x1869759481741312:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.092508:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:2403:x1869759481741312:12345-192.168.203.4@tcp:2:touch.0 Request processed in 124us (210us total) trans 4294968845 rc 0/0 00000100:00100000:2.0:1783144429.092516:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5004 00000100:00100000:1.0:1783144429.093950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.093982:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481741568 00000100:00100000:0.0:1783144429.093988:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481741568 00000100:00100000:0.0:1783144429.094020:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 255 00000100:00100000:0.0:1783144429.094030:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+106:73384:x1869759481741568:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.094185:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+107:73384:x1869759481741568:12345-192.168.203.4@tcp:35:touch.0 Request processed in 156us (235us total) trans 120259084337 rc 0/0 00000100:00100000:0.0:1783144429.094192:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 255 00000100:00100000:1.0:1783144429.095425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.095512:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481741824 00000100:00100000:3.0:1783144429.095517:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481741824 00000100:00100000:3.0:1783144429.095552:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1365 00000100:00100000:3.0:1783144429.095560:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+107:73384:x1869759481741824:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.095594:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.095609:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a4230498d0 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ecc expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.095672:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.095683:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.095691:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.095703:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.095708:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.095714:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144429.096032:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x771:0x0], index 0: 0 00010000:00010000:3.0:1783144429.096132:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a4230498e5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096140:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a4230498e5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096146:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a4230498e5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096185:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096191:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096197:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096203:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096209:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144429.096213:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096220:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096231:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144429.096234:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144429.096237:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096243:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a4230498d7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144429.096253:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa163421 reply state 00000000ddcc2f1c transno 120259084338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096263:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096276:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9c2ac6738000) 00010000:00010000:3.0:1783144429.096279:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144429.096281:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144429.096310:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a4230498d0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ecc expref: 110 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096324:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a4230498e5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ecc expref: 109 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.096331:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2ac6738800) 00010000:00010000:3.0:1783144429.096334:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144429.096336:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e400, rc 0) 00000100:00100000:3.0:1783144429.096419:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+110:73384:x1869759481741824:12345-192.168.203.4@tcp:101:touch.0 Request processed in 860us (994us total) trans 120259084338 rc 0/0 00000100:00100000:3.0:1783144429.096423:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1365 00000100:00100000:1.0:1783144429.097565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.097601:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481742080 00000100:00100000:2.0:1783144429.097607:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481742080 00000100:00100000:2.0:1783144429.097647:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1366 00000100:00100000:2.0:1783144429.097663:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+110:73384:x1869759481742080:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1783144429.097701:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144429.097716:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a4230498e5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ecc expref: 110 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.097764:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2ac6738800) 00010000:00010000:2.0:1783144429.097772:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144429.097803:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.097813:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.097822:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.097878:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000314a8493 reply state 0000000005f070fb transno 120259084339 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.097894:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.097901:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:2.0:1783144429.097903:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.097905:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144429.097956:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+111:73384:x1869759481742080:12345-192.168.203.4@tcp:36:touch.0 Request processed in 294us (390us total) trans 120259084339 rc 0/0 00000100:00100000:2.0:1783144429.097963:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1366 00000100:00100000:1.0:1783144429.098813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.098842:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481742208 00000100:00100000:3.0:1783144429.098847:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481742208 00000100:00100000:3.0:1783144429.098886:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1367 00000100:00100000:3.0:1783144429.098895:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+111:73384:x1869759481742208:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.098910:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.098919:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a4230498fa lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ed3 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.098940:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a4230498fa lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ed3 expref: 112 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.098947:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e600/0xad8e53a4230498fa lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ed3 expref: 112 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.098964:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:3.0:1783144429.098965:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.098968:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e600, rc 0) 00000100:00100000:3.0:1783144429.098992:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+112:73384:x1869759481742208:12345-192.168.203.4@tcp:101:touch.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.098999:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1367 00000100:00100000:1.0:1783144429.100150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.100192:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481742336 00000100:00100000:2.0:1783144429.100197:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481742336 00000100:00100000:2.0:1783144429.100231:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5005 00000100:00100000:2.0:1783144429.100306:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:2404:x1869759481742336:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.100446:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+21:2404:x1869759481742336:12345-192.168.203.4@tcp:2:touch.0 Request processed in 144us (303us total) trans 4294968846 rc 0/0 00000100:00100000:2.0:1783144429.100453:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5005 00000100:00100000:1.0:1783144429.101596:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.101676:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481742592 00000100:00100000:0.0:1783144429.101682:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481742592 00000100:00100000:0.0:1783144429.101793:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 256 00000100:00100000:0.0:1783144429.101811:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+112:73384:x1869759481742592:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.102031:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+113:73384:x1869759481742592:12345-192.168.203.4@tcp:35:touch.0 Request processed in 223us (436us total) trans 120259084340 rc 0/0 00000100:00100000:0.0:1783144429.102039:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 256 00000100:00100000:1.0:1783144429.103622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.103664:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481742848 00000100:00100000:2.0:1783144429.103669:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481742848 00000100:00100000:2.0:1783144429.103705:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1368 00000100:00100000:2.0:1783144429.103713:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+113:73384:x1869759481742848:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.103746:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.103760:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049901 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41eda expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.103830:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.103854:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.103863:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.103876:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.103882:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.103888:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144429.104065:0:94197:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94197:1869759501420928:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783144429.104108:0:94197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783144429.104133:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x772:0x0], index 0: 0 00000100:00100000:1.0:1783144429.104140:0:94197:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c5ad0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144429.104198:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501420928 00000100:00100000:3.0:1783144429.104203:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501420928 00010000:00010000:2.0:1783144429.104236:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a423049916 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104246:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a423049916 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104253:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a423049916 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144429.104258:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5006 00000100:00100000:3.0:1783144429.104272:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94197:x1869759501420928:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1783144429.104288:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104296:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783144429.104303:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00010000:00010000:2.0:1783144429.104303:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104324:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104330:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49d200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144429.104334:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104342:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104353:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144429.104357:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144429.104368:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104385:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049908 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.104400:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086a986c0 reply state 00000000977c7113 transno 120259084341 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104411:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104419:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9c2afa089000) 00010000:00010000:2.0:1783144429.104422:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.104425:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783144429.104449:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049901 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eda expref: 116 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104463:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a423049916 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eda expref: 115 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.104471:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:2.0:1783144429.104474:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144429.104476:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49d600, rc 0) 00000100:00100000:2.0:1783144429.104518:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+116:73384:x1869759481742848:12345-192.168.203.4@tcp:101:touch.0 Request processed in 805us (897us total) trans 120259084341 rc 0/0 00000100:00100000:2.0:1783144429.104526:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1368 00000100:00080000:1.0:1783144429.104689:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783144429.105750:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:94197:x1869759501420928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1480us (1640us total) trans 4294968847 rc 0/0 00000100:00100000:3.0:1783144429.105759:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5006 00000100:00100000:1.0:1783144429.105782:0:94197:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94197:1869759501420928:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783144429.105800:0:94197:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x772:0x0]-[0x280000401:0x7a1:0x0] 00000100:00100000:1.0:1783144429.106018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.106076:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481743104 00000100:00100000:0.0:1783144429.106081:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481743104 00000100:00100000:0.0:1783144429.106116:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1369 00000100:00100000:0.0:1783144429.106124:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+116:73384:x1869759481743104:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144429.106149:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144429.106161:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a423049916 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eda expref: 116 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.106172:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:0.0:1783144429.106179:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144429.106204:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.106213:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.106220:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144429.106263:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eaa8a445 reply state 000000006b938711 transno 120259084342 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.106272:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.106289:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:0.0:1783144429.106291:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144429.106293:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144429.106347:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+117:73384:x1869759481743104:12345-192.168.203.4@tcp:36:touch.0 Request processed in 223us (328us total) trans 120259084342 rc 0/0 00000100:00100000:0.0:1783144429.106353:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1369 00000100:00100000:0.0:1783144429.107340:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.107401:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481743232 00000100:00100000:2.0:1783144429.107405:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481743232 00000100:00100000:2.0:1783144429.107438:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1370 00000100:00100000:2.0:1783144429.107446:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+117:73384:x1869759481743232:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.107465:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.107477:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ea00/0xad8e53a42304992b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ee1 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.107508:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ea00/0xad8e53a42304992b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ee1 expref: 118 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.107520:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043ea00/0xad8e53a42304992b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ee1 expref: 118 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.107536:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:2.0:1783144429.107538:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144429.107541:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af043ea00, rc 0) 00000100:00100000:2.0:1783144429.107574:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+118:73384:x1869759481743232:12345-192.168.203.4@tcp:101:touch.0 Request processed in 129us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144429.107581:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1370 00000100:00100000:1.0:1783144429.108957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.108996:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481743360 00000100:00100000:3.0:1783144429.109002:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481743360 00000100:00100000:3.0:1783144429.109037:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5007 00000100:00100000:3.0:1783144429.109044:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+21:2403:x1869759481743360:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1783144429.109271:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2403:x1869759481743360:12345-192.168.203.4@tcp:2:touch.0 Request processed in 225us (317us total) trans 4294968848 rc 0/0 00000100:00100000:3.0:1783144429.109278:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5007 00000100:00100000:1.0:1783144429.111131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.111170:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481743616 00000100:00100000:0.0:1783144429.111176:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481743616 00000100:00100000:0.0:1783144429.111217:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:0.0:1783144429.111225:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+118:73384:x1869759481743616:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.111421:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+119:73384:x1869759481743616:12345-192.168.203.4@tcp:35:touch.0 Request processed in 196us (291us total) trans 120259084343 rc 0/0 00000100:00100000:0.0:1783144429.111429:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 257 00000100:00100000:1.0:1783144429.112623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.112667:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481743872 00000100:00100000:3.0:1783144429.112673:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481743872 00000100:00100000:3.0:1783144429.112707:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1371 00000100:00100000:3.0:1783144429.112714:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+119:73384:x1869759481743872:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.112754:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.112767:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049932 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ee8 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.112854:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.112868:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.112879:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.112901:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.112910:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.112917:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144429.113262:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x773:0x0], index 0: 0 00010000:00010000:3.0:1783144429.113351:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423049947 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113358:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423049947 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113363:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423049947 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113407:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113414:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113421:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113426:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113430:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144429.113433:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113438:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113446:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144429.113448:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144429.113451:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113455:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049939 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144429.113462:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f5f7beb reply state 000000002aebff8b transno 120259084344 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113469:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113478:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9c2ac6738300) 00010000:00010000:3.0:1783144429.113479:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144429.113481:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144429.113503:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049932 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ee8 expref: 122 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113516:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423049947 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ee8 expref: 121 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.113524:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2ac6738900) 00010000:00010000:3.0:1783144429.113527:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144429.113529:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fa00, rc 0) 00000100:00100000:3.0:1783144429.113563:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+122:73384:x1869759481743872:12345-192.168.203.4@tcp:101:touch.0 Request processed in 850us (943us total) trans 120259084344 rc 0/0 00000100:00100000:3.0:1783144429.113568:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1371 00000100:00100000:1.0:1783144429.115047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.115092:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481744128 00000100:00100000:2.0:1783144429.115099:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481744128 00000100:00100000:2.0:1783144429.115139:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1372 00000100:00100000:2.0:1783144429.115148:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+122:73384:x1869759481744128:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1783144429.115184:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144429.115200:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fa00/0xad8e53a423049947 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ee8 expref: 122 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.115213:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2ac6738900) 00010000:00010000:2.0:1783144429.115221:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144429.115255:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.115279:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.115288:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.115354:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7045497 reply state 000000003e603c1e transno 120259084345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.115364:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.115371:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:2.0:1783144429.115374:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.115389:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144429.115446:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+123:73384:x1869759481744128:12345-192.168.203.4@tcp:36:touch.0 Request processed in 298us (401us total) trans 120259084345 rc 0/0 00000100:00100000:2.0:1783144429.115454:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1372 00000100:00100000:1.0:1783144429.116285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.116324:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481744256 00000100:00100000:3.0:1783144429.116329:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481744256 00000100:00100000:3.0:1783144429.116365:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1373 00000100:00100000:3.0:1783144429.116373:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+123:73384:x1869759481744256:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.116395:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.116405:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a42304995c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41eef expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.116434:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a42304995c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eef expref: 124 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.116445:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f600/0xad8e53a42304995c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41eef expref: 124 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.116468:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:3.0:1783144429.116470:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.116472:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f600, rc 0) 00000100:00100000:3.0:1783144429.116506:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+124:73384:x1869759481744256:12345-192.168.203.4@tcp:101:touch.0 Request processed in 135us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.116510:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1373 00000100:00100000:1.0:1783144429.117499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.117539:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481744384 00000100:00100000:2.0:1783144429.117543:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481744384 00000100:00100000:2.0:1783144429.117574:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5008 00000100:00100000:2.0:1783144429.117582:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2404:x1869759481744384:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.117755:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:2404:x1869759481744384:12345-192.168.203.4@tcp:2:touch.0 Request processed in 139us (222us total) trans 4294968849 rc 0/0 00000100:00100000:2.0:1783144429.117763:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5008 00000100:00100000:1.0:1783144429.118614:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.118669:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481744640 00000100:00100000:0.0:1783144429.118673:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481744640 00000100:00100000:0.0:1783144429.118710:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 258 00000100:00100000:0.0:1783144429.118719:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+124:73384:x1869759481744640:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.118915:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+125:73384:x1869759481744640:12345-192.168.203.4@tcp:35:touch.0 Request processed in 198us (301us total) trans 120259084346 rc 0/0 00000100:00100000:0.0:1783144429.118923:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 258 00000100:00100000:1.0:1783144429.119816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.119852:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481744896 00000100:00100000:2.0:1783144429.119857:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481744896 00000100:00100000:2.0:1783144429.119891:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1374 00000100:00100000:2.0:1783144429.119908:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+125:73384:x1869759481744896:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.119920:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.119933:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a423049963 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ef6 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.119996:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120008:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120017:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120031:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120038:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120045:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783144429.120280:0:66113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x774:0x0], index 0: 0 00010000:00010000:2.0:1783144429.120394:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049978 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120404:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049978 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120412:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049978 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120447:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120455:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120460:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120467:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120473:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49d000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144429.120478:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120485:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120495:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144429.120498:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144429.120502:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120509:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a42304996a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.120520:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bff2d3cd reply state 0000000079259e27 transno 120259084347 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120531:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120543:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9c2afa089700) 00010000:00010000:2.0:1783144429.120545:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.120547:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783144429.120568:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d600/0xad8e53a423049963 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ef6 expref: 128 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120582:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049978 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ef6 expref: 127 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.120589:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c2afa089f00) 00010000:00010000:2.0:1783144429.120592:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144429.120594:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287600, rc 0) 00000100:00100000:2.0:1783144429.120626:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+128:73384:x1869759481744896:12345-192.168.203.4@tcp:101:touch.0 Request processed in 719us (812us total) trans 120259084347 rc 0/0 00000100:00100000:2.0:1783144429.120633:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1374 00000100:00100000:1.0:1783144429.121881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.121963:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481745152 00000100:00100000:0.0:1783144429.121969:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481745152 00000100:00100000:0.0:1783144429.122008:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1375 00000100:00100000:0.0:1783144429.122017:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+128:73384:x1869759481745152:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:0.0:1783144429.122058:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144429.122073:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049978 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ef6 expref: 128 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.122086:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c2afa089f00) 00010000:00010000:0.0:1783144429.122094:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144429.122137:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.122147:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.122154:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144429.122213:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031968ae0 reply state 00000000a6ec098f transno 120259084348 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.122223:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144429.122228:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:0.0:1783144429.122231:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144429.122233:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144429.122283:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+129:73384:x1869759481745152:12345-192.168.203.4@tcp:36:touch.0 Request processed in 267us (404us total) trans 120259084348 rc 0/0 00000100:00100000:0.0:1783144429.122294:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1375 00000100:00100000:1.0:1783144429.123133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.123198:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481745280 00000100:00100000:2.0:1783144429.123203:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481745280 00000100:00100000:2.0:1783144429.123233:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1376 00000100:00100000:2.0:1783144429.123239:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+129:73384:x1869759481745280:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:2.0:1783144429.123257:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144429.123267:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287400/0xad8e53a42304998d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41efd expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.123296:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287400/0xad8e53a42304998d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41efd expref: 130 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.123306:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287400/0xad8e53a42304998d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41efd expref: 130 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.123327:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:2.0:1783144429.123330:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783144429.123332:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287400, rc 0) 00000100:00100000:2.0:1783144429.123410:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+130:73384:x1869759481745280:12345-192.168.203.4@tcp:101:touch.0 Request processed in 170us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144429.123416:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1376 00000100:00100000:1.0:1783144429.124390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.124432:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481745408 00000100:00100000:3.0:1783144429.124437:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481745408 00000100:00100000:3.0:1783144429.124475:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5009 00000100:00100000:3.0:1783144429.124491:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:2404:x1869759481745408:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:3.0:1783144429.124639:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+24:2404:x1869759481745408:12345-192.168.203.4@tcp:2:touch.0 Request processed in 149us (261us total) trans 4294968850 rc 0/0 00000100:00100000:3.0:1783144429.124647:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5009 00000100:00100000:1.0:1783144429.125400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.125438:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481745664 00000100:00100000:2.0:1783144429.125443:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481745664 00000100:00100000:2.0:1783144429.125477:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00100000:2.0:1783144429.125484:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+130:73384:x1869759481745664:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:2.0:1783144429.125638:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+131:73384:x1869759481745664:12345-192.168.203.4@tcp:35:touch.0 Request processed in 154us (238us total) trans 120259084349 rc 0/0 00000100:00100000:2.0:1783144429.125645:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 259 00000100:00100000:1.0:1783144429.126617:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.126657:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481745920 00000100:00100000:3.0:1783144429.126662:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481745920 00000100:00100000:3.0:1783144429.126698:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1377 00000100:00100000:3.0:1783144429.126706:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+131:73384:x1869759481745920:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.126718:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.126757:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049994 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f04 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.126832:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.126845:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.126865:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.126880:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.126888:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.126895:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783144429.127120:0:66947:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x775:0x0], index 0: 0 00010000:00010000:3.0:1783144429.127218:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a4230499a9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127227:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a4230499a9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127234:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a4230499a9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127264:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127272:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127279:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127286:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127298:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144429.127303:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127323:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127335:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144429.127338:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144429.127342:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127350:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a42304999b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783144429.127360:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002de02290 reply state 000000003c02943f transno 120259084350 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127368:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127384:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9c2ac6738200) 00010000:00010000:3.0:1783144429.127387:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144429.127389:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144429.127413:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049994 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f04 expref: 134 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127426:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a4230499a9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f04 expref: 133 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.127447:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2ac6738d00) 00010000:00010000:3.0:1783144429.127449:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144429.127452:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f200, rc 0) 00000100:00100000:3.0:1783144429.127490:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+134:73384:x1869759481745920:12345-192.168.203.4@tcp:101:touch.0 Request processed in 784us (879us total) trans 120259084350 rc 0/0 00000100:00100000:3.0:1783144429.127497:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1377 00000100:00100000:1.0:1783144429.129011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.129064:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481746176 00000100:00100000:2.0:1783144429.129070:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481746176 00000100:00100000:2.0:1783144429.129123:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1378 00000100:00100000:2.0:1783144429.129134:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+134:73384:x1869759481746176:12345-192.168.203.4@tcp:36:touch.0 00010000:00010000:2.0:1783144429.129170:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144429.129185:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a4230499a9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f04 expref: 134 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.129197:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2ac6738d00) 00010000:00010000:2.0:1783144429.129203:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144429.129229:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.129243:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.129248:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144429.129301:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000032ba286 reply state 0000000004c125bf transno 120259084351 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.129312:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144429.129318:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:2.0:1783144429.129321:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144429.129323:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144429.129371:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+135:73384:x1869759481746176:12345-192.168.203.4@tcp:36:touch.0 Request processed in 240us (363us total) trans 120259084351 rc 0/0 00000100:00100000:2.0:1783144429.129389:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1378 00000100:00100000:1.0:1783144429.130418:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144429.130463:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481746304 00000100:00100000:3.0:1783144429.130469:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481746304 00000100:00100000:3.0:1783144429.130503:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1379 00000100:00100000:3.0:1783144429.130525:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+135:73384:x1869759481746304:12345-192.168.203.4@tcp:101:touch.0 00010000:00010000:3.0:1783144429.130540:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144429.130550:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a4230499be lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f0b expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.130587:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a4230499be lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f0b expref: 136 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.130598:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e800/0xad8e53a4230499be lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f0b expref: 136 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144429.130613:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:3.0:1783144429.130615:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783144429.130617:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e800, rc 0) 00000100:00100000:3.0:1783144429.130653:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+136:73384:x1869759481746304:12345-192.168.203.4@tcp:101:touch.0 Request processed in 133us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144429.130671:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1379 00000100:00100000:1.0:1783144429.132093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144429.132159:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481746432 00000100:00100000:2.0:1783144429.132165:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481746432 00000100:00100000:2.0:1783144429.132198:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5010 00000100:00100000:2.0:1783144429.132205:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+24:2403:x1869759481746432:12345-192.168.203.4@tcp:2:touch.0 00000100:00100000:2.0:1783144429.132388:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2403:x1869759481746432:12345-192.168.203.4@tcp:2:touch.0 Request processed in 173us (291us total) trans 4294968851 rc 0/0 00000100:00100000:2.0:1783144429.132394:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5010 00000100:00100000:1.0:1783144429.133244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144429.133887:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481746688 00000100:00100000:0.0:1783144429.133907:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481746688 00000100:00100000:0.0:1783144429.133950:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 260 00000100:00100000:0.0:1783144429.133971:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3677c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+136:73384:x1869759481746688:12345-192.168.203.4@tcp:35:touch.0 00000100:00100000:0.0:1783144429.134194:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3677c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+137:73384:x1869759481746688:12345-192.168.203.4@tcp:35:touch.0 Request processed in 225us (949us total) trans 120259084352 rc 0/0 00000100:00100000:0.0:1783144429.134201:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 260 00010000:00010000:1.0:1783144429.517944:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144430.458363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144430.458517:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481746816 00000100:00100000:2.0:1783144430.458525:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481746816 00000100:00100000:2.0:1783144430.458605:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1380 00000100:00100000:2.0:1783144430.458626:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+137:73411:x1869759481746816:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:2.0:1783144430.458663:0:66113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1783144430.458762:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+137:73411:x1869759481746816:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 137us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.458770:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1380 00000100:00080000:1.0:1783144430.458848:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144430.459759:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144430.459818:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481746944 00000100:00100000:0.0:1783144430.459824:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481746944 00000100:00100000:0.0:1783144430.459865:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1381 00000100:00100000:0.0:1783144430.459872:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:73411:x1869759481746944:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:0.0:1783144430.459886:0:66112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1783144430.459924:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:73411:x1869759481746944:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 48us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144430.459931:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1381 00000100:00080000:1.0:1783144430.460750:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783144430.461181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144430.461235:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481747072 00000100:00100000:1.0:1783144430.461241:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481747072 00000100:00080000:3.0:1783144430.461281:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783144430.461287:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1682 00000100:00100000:1.0:1783144430.461297:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:73411:x1869759481747072:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1783144430.461313:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144430.461357:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:73411:x1869759481747072:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144430.461364:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1682 00000100:00100000:3.0:1783144430.462147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144430.462193:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481747200 00000100:00100000:2.0:1783144430.462198:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481747200 00000100:00100000:2.0:1783144430.462233:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1683 00000100:00080000:3.0:1783144430.462240:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144430.462243:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:73411:x1869759481747200:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:2.0:1783144430.462262:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144430.462306:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:73411:x1869759481747200:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.462315:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1683 00010000:00010000:3.0:1783144430.541877:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144430.605932:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501421184:0@lo:400:kworker.0 00000100:00100000:3.0:1783144430.605944:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501421056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144430.606041:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144430.606042:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501421440:0@lo:400:kworker.0 00000100:00100000:3.0:1783144430.606054:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144430.606096:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501421312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144430.606114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144430.606127:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501421696:0@lo:400:kworker.0 00000100:00100000:3.0:1783144430.606144:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501421568:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.606144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144430.606147:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501421952:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.606183:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501421824:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.606188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144430.606203:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421184 00000100:00100000:2.0:1783144430.606208:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144430.606213:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421184 00000100:00100000:1.0:1783144430.606225:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501422336:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.606240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144430.606251:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501422592:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.606260:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144430.606277:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aee583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501422464:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.606296:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501422208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783144430.606311:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783144430.606312:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144430.606318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144430.606326:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501421184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.606352:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501422976:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.606361:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144430.606401:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421440 00000100:00100000:2.0:1783144430.606407:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421440 00000100:00100000:2.0:1783144430.606443:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421696 00000100:00100000:2.0:1783144430.606447:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421696 00000100:00100000:2.0:1783144430.606466:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421824 00000100:00100000:2.0:1783144430.606469:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421824 00000100:00100000:2.0:1783144430.606482:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422464 00000100:00100000:2.0:1783144430.606497:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422464 00000100:00100000:2.0:1783144430.606514:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1783144430.606520:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869759501421440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.606641:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501422848:0@lo:400:kworker.0 00000100:00100000:3.0:1783144430.606642:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501421184:12345-0@lo:400:kworker.0 Request processed in 320us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144430.606642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144430.606662:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783144430.606670:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869759501421440:12345-0@lo:400:kworker.0 Request processed in 147us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.606678:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1783144430.606692:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144430.606704:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1783144430.606708:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421056 00000100:00100000:3.0:1783144430.606715:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421056 00000100:00100000:1.0:1783144430.606786:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501421184:0@lo:400:kworker.0 00000100:00100000:3.0:1783144430.606788:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:0.0:1783144430.606788:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421312 00000100:00100000:0.0:1783144430.606798:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421312 00000100:00100000:3.0:1783144430.606806:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501421056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144430.606812:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501421696:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1783144430.606828:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144430.606835:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421952 00000100:00100000:0.0:1783144430.606839:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421952 00000100:00100000:1.0:1783144430.606848:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422592 00000100:00100000:1.0:1783144430.606854:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422592 00000100:00100000:0.0:1783144430.606862:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422208 00000100:00100000:0.0:1783144430.606875:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422208 00000100:00100000:2.0:1783144430.606881:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501421696:12345-0@lo:400:kworker.0 Request processed in 166us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144430.606883:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501421056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144430.606890:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:1.0:1783144430.606912:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501421312:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144430.606913:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1783144430.606918:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1783144430.606932:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3649:x1869759501421952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144430.606940:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422976 00000100:00100000:2.0:1783144430.606950:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422976 00000004:00000024:1.0:1783144430.606950:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783144430.606984:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1783144430.606996:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3649:x1869759501421952:12345-0@lo:400:kworker.0 Request processed in 67us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144430.607000:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:2.0:1783144430.607001:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501421824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607010:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501421312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144430.607011:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:1.0:1783144430.607031:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1783144430.607036:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1783144430.607047:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:1.0:1783144430.607057:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1783144430.607063:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501422464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.607063:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501422592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607073:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501422208:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144430.607084:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501421824:12345-0@lo:400:kworker.0 Request processed in 84us (837us total) trans 0 rc 0/0 00000004:00000024:1.0:1783144430.607093:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:2.0:1783144430.607100:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1783144430.607115:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869759501422464:12345-0@lo:400:kworker.0 Request processed in 58us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144430.607116:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501422592:12345-0@lo:400:kworker.0 Request processed in 62us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144430.607129:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:1.0:1783144430.607183:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501422208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144430.607187:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1783144430.607192:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1783144430.607229:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422336 00000100:00100000:1.0:1783144430.607232:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422336 00000100:00100000:1.0:1783144430.607259:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422848 00000100:00100000:1.0:1783144430.607261:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422848 00000100:00100000:1.0:1783144430.607273:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1783144430.607277:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501422336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607298:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501422336:12345-0@lo:400:kworker.0 Request processed in 21us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144430.607302:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1783144430.607310:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1783144430.607316:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501422848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607339:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501422848:12345-0@lo:400:kworker.0 Request processed in 24us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144430.607345:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1783144430.607442:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501421312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144430.607478:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501421824:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607586:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aee583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869759501422464:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607604:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144430.607612:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501423104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144430.607639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144430.607667:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501423104 00000100:00100000:1.0:1783144430.607670:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501423104 00000100:00100000:1.0:1783144430.607693:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1783144430.607700:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501423104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783144430.607713:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783144430.607768:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869759501423104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144430.607776:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1783144430.607808:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501423104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144430.607825:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501421696:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607831:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501422336:0@lo:400:kworker.0 00000100:00100000:1.0:1783144430.607839:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501422208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144430.607846:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeeda6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501422848:0@lo:400:kworker.0 00000100:00100000:2.0:1783144430.607986:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1783144430.607999:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501422976:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783144430.608027:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144430.608033:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783144430.608037:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144430.608048:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501422976:12345-0@lo:400:kworker.0 Request processed in 52us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.608056:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1783144430.608063:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144430.608072:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501421568 00000100:00100000:2.0:1783144430.608077:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501421568 00000100:00100000:0.0:1783144430.608091:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501422080:0@lo:400:kworker.0 00000100:00100000:2.0:1783144430.608111:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1783144430.608119:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501421568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.608126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144430.608151:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501422720:0@lo:400:kworker.0 00000100:00100000:2.0:1783144430.608229:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869759501421568:12345-0@lo:400:kworker.0 Request processed in 111us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.608238:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1783144430.608242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144430.608276:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1869759501421440:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.608283:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501421056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144430.608289:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501421952:0@lo:400:kworker.0 00000100:00100000:2.0:1783144430.608297:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501422592:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.608316:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1869759501421568:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.608340:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422080 00000100:00100000:0.0:1783144430.608344:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422080 00000100:00100000:0.0:1783144430.608383:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501422720 00000100:00100000:0.0:1783144430.608386:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501422720 00000100:00100000:0.0:1783144430.608408:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1783144430.608418:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:0.0:1783144430.608419:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501422080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144430.608431:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501422720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.608478:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501422080:12345-0@lo:400:kworker.0 Request processed in 62us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.608481:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3650:x1869759501422720:12345-0@lo:400:kworker.0 Request processed in 54us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.608488:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:0.0:1783144430.608547:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00080000:0.0:1783144430.608567:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144430.608570:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783144430.608585:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501422080:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.608594:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501422720:0@lo:400:kworker.0 00000100:00100000:0.0:1783144430.608624:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501422976:0@lo:400:kworker.0 00000001:00080000:2.0:1783144430.846159:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968851 is committed 00000001:00080000:2.0:1783144430.846173:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968847 is committed 00000001:00080000:1.0:1783144430.847074:0:94178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084352 is committed 00010000:00010000:3.0:1783144430.848904:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.848918:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849027:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849034:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.849038:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849046:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849065:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c29ca14f100) 00010000:00010000:3.0:1783144430.849069:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.849073:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849079:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a42304956c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849099:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849118:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849123:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849128:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.849130:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849136:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849143:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144430.849145:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.849148:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849153:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049573 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849166:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.849172:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850112:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850121:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850132:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850139:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850148:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144430.850150:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144430.850154:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850160:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a4230495ce lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850173:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850180:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850185:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850190:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850193:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850198:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850206:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9c2af565c600) 00010000:00010000:3.0:1783144430.850208:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850218:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850224:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a4230495ff lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850237:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850243:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850248:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850253:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850256:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850261:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850268:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:3.0:1783144430.850271:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850274:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850279:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049614 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850288:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850303:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850313:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850318:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850321:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850327:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850335:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9c2ac676cf00) 00010000:00010000:3.0:1783144430.850337:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850339:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850344:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34c00/0xad8e53a423049630 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850357:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850373:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850379:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850384:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850392:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850398:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850406:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:3.0:1783144430.850409:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850411:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850417:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9200/0xad8e53a423049645 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850428:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850434:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850450:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850454:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850457:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850463:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850470:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9c2af565cd00) 00010000:00010000:3.0:1783144430.850472:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850482:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850541:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049661 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850555:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850561:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850566:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850570:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850573:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850578:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850586:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:3.0:1783144430.850589:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850591:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850597:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049676 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850608:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850623:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850629:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850634:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850636:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850641:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850648:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9c29ca14fe00) 00010000:00010000:3.0:1783144430.850650:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850652:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850657:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049692 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850670:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850675:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850680:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850684:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850690:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850696:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850703:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:3.0:1783144430.850705:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850708:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850799:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a4230496a7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850811:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850817:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850822:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850826:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850828:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850833:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850840:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9c2af565c800) 00010000:00010000:3.0:1783144430.850842:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850851:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850857:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a4230496c3 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850872:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850878:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850883:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850888:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.850892:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850898:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850907:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:3.0:1783144430.850909:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.850911:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850972:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a4230496d8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.850984:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851000:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851006:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851010:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f35e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851013:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851019:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851028:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9c2ac676c700) 00010000:00010000:3.0:1783144430.851030:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851032:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851037:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f35e00/0xad8e53a4230496f4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851050:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851056:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851061:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851066:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851075:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851082:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851089:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:3.0:1783144430.851091:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851094:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851100:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049709 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851113:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851118:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851124:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851129:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043e400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851131:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851136:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851144:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9c2afa089600) 00010000:00010000:3.0:1783144430.851145:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851154:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851160:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e400/0xad8e53a423049725 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851173:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851179:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851185:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851190:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49d400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851193:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851198:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851205:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144430.851207:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851209:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851214:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a42304973a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851225:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851241:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851246:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851251:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851254:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851259:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851266:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9c2ac676cd00) 00010000:00010000:3.0:1783144430.851268:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851271:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851276:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34000/0xad8e53a423049756 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851290:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851296:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851301:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851305:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851314:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851319:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851326:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:3.0:1783144430.851328:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851331:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851337:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a42304976b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851346:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851352:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851357:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851361:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49ce00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851388:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851395:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851402:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9c2afa089400) 00010000:00010000:3.0:1783144430.851404:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851413:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851419:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049787 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851434:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851440:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851446:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851451:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851453:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851459:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851465:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:3.0:1783144430.851467:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851470:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851475:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a42304979c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851537:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851552:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851558:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851563:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851567:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851572:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851580:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9c29ca14f900) 00010000:00010000:3.0:1783144430.851582:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851585:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851591:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a4230497b8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851605:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851611:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851617:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851621:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851631:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851637:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851643:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:3.0:1783144430.851645:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851647:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851653:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a4230497cd lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851662:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851666:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851671:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851676:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851678:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851683:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851689:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9c2af565cf00) 00010000:00010000:3.0:1783144430.851691:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851697:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851704:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a4230497e9 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851790:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851797:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851801:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851806:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49ca00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851809:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851814:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851823:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:3.0:1783144430.851825:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851828:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851834:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a4230497fe lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851843:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851857:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851863:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851867:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2ac0031200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851871:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851876:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851883:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9c2ac676c800) 00010000:00010000:3.0:1783144430.851885:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851888:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851892:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2ac0031200/0xad8e53a42304981a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851907:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851913:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851924:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851928:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851935:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851941:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851949:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:3.0:1783144430.851954:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.851957:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851962:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a42304982f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851972:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851977:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851982:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851987:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49c200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.851989:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.851995:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852001:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9c2afa089800) 00010000:00010000:3.0:1783144430.852002:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852011:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852017:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a42304984b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852031:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852036:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852042:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852047:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49cc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852051:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852056:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852065:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:3.0:1783144430.852068:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852071:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852077:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049860 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852088:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852103:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852111:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852115:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af6f34a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852118:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852124:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852132:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9c2ac676c100) 00010000:00010000:3.0:1783144430.852135:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852137:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852143:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af6f34a00/0xad8e53a42304987c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852160:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852166:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852172:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852177:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852183:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852190:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852198:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:3.0:1783144430.852201:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852203:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852209:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049891 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852220:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852226:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852232:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852236:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49c000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852239:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852245:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852252:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9c2afa089d00) 00010000:00010000:3.0:1783144430.852254:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852261:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852266:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a4230498ad lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852279:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852284:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852290:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852295:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852298:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852302:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852310:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:3.0:1783144430.852312:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852314:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852319:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a4230498c2 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852327:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852340:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852346:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852351:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852354:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852359:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852379:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9c2ac6738000) 00010000:00010000:3.0:1783144430.852382:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852385:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852389:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a4230498de lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852403:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852409:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852415:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852420:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49c400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852428:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852434:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852441:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:3.0:1783144430.852443:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852445:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852450:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c400/0xad8e53a4230498f3 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852460:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852466:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852471:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852476:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49da00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852480:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852485:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852492:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9c2afa089000) 00010000:00010000:3.0:1783144430.852494:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852501:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852506:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49da00/0xad8e53a42304990f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852521:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852526:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852531:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852536:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852539:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852545:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852553:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:3.0:1783144430.852555:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852557:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852562:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049924 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852571:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852585:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852592:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852597:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ee00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852601:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852607:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852615:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9c2ac6738300) 00010000:00010000:3.0:1783144430.852617:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852620:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852626:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049940 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852640:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852646:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852652:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852657:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852664:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852669:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852676:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:3.0:1783144430.852678:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852681:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852686:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043f200/0xad8e53a423049955 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852696:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852701:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852706:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852709:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49d200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852742:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852748:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852754:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9c2afa089700) 00010000:00010000:3.0:1783144430.852757:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852765:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852771:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d200/0xad8e53a423049971 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852788:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852795:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852800:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852805:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852807:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852813:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852819:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:3.0:1783144430.852820:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852823:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852828:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00a00/0xad8e53a423049986 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852836:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852850:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852855:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852859:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852861:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852866:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852871:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9c2ac6738200) 00010000:00010000:3.0:1783144430.852873:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852876:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852881:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a4230499a2 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852892:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852897:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852901:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852905:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2acb287000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144430.852912:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852918:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852925:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:3.0:1783144430.852926:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144430.852929:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144430.852934:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a4230499b7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144430.906534:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144430.906775:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481747456 00000100:00100000:2.0:1783144430.906784:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481747456 00000100:00100000:2.0:1783144430.906840:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1382 00000100:00100000:2.0:1783144430.906850:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:73452:x1869759481747456:12345-192.168.203.4@tcp:36:mcreate.0 00010000:00010000:2.0:1783144430.906910:0:81077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144430.906934:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af043e000/0xad8e53a4230495ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41de5 expref: 31 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.906949:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:2.0:1783144430.906954:0:81077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144430.907004:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907025:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907035:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907048:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907055:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907061:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907381:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907389:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907395:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907401:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2acb287a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144430.907405:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907412:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907420:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:2.0:1783144430.907429:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144430.907433:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907439:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783144430.907449:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070365dbe reply state 000000006c8aea58 transno 120259084353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907460:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.907465:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2ac2a42e00) 00010000:00010000:2.0:1783144430.907468:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144430.907470:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144430.907547:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:73452:x1869759481747456:12345-192.168.203.4@tcp:36:mcreate.0 Request processed in 698us (1017us total) trans 120259084353 rc 0/0 00000100:00100000:2.0:1783144430.907554:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1382 00000100:00100000:3.0:1783144430.919511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144430.919594:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481747584 00000100:00100000:2.0:1783144430.919603:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481747584 00000100:00100000:2.0:1783144430.919667:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1383 00000100:00100000:2.0:1783144430.919679:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:73455:x1869759481747584:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1783144430.919701:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144430.919836:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a4230499d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f12 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.919903:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.919917:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.919936:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144430.919975:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144430.919979:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144430.919996:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.920021:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a4230499d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f12 expref: 34 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.920038:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f12 expref: 33 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144430.920047:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:2.0:1783144430.920050:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783144430.920054:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287a00, rc 0) 00000100:00100000:2.0:1783144430.920111:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:73455:x1869759481747584:12345-192.168.203.4@tcp:101:rm.0 Request processed in 434us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144430.920120:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1383 00000100:00100000:3.0:1783144430.921389:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144430.921442:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481747712 00000100:00100000:1.0:1783144430.921448:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481747712 00000100:00100000:1.0:1783144430.921497:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1384 00000100:00100000:1.0:1783144430.921508:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:73455:x1869759481747712:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1783144430.921540:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144430.921556:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a4230499e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f19 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921595:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921605:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921616:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921628:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921635:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921642:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921713:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a4230499f6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921745:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a4230499f6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921755:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a4230499f6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144430.921801:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1a:0x0]: returning size 0 00000004:00200000:1.0:1783144430.921810:0:66143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144430.921830:0:66143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a4230499f6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921842:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a4230499f6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921849:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921856:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921863:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921870:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144430.921874:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.921882:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922023:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144430.922027:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144430.922032:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922049:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a4230499e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922062:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922078:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922085:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922091:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144430.922094:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922102:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922113:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2ac2a42e00) 00010000:00010000:1.0:1783144430.922116:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144430.922119:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922124:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a4230499ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922149:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a4230499e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f19 expref: 35 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922163:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a4230499f6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f19 expref: 34 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.922171:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c29c476e000) 00010000:00010000:1.0:1783144430.922173:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144430.922182:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150800, rc 0) 00000100:00100000:1.0:1783144430.922575:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:73455:x1869759481747712:12345-192.168.203.4@tcp:101:rm.0 Request processed in 1068us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144430.922583:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1384 00000100:00100000:1.0:1783144430.925467:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144430.925511:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481747968 00000100:00100000:0.0:1783144430.925520:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481747968 00000100:00100000:0.0:1783144430.925565:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1385 00000100:00100000:0.0:1783144430.925575:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:73455:x1869759481747968:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1783144430.925618:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783144430.925698:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a4230499f6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f19 expref: 34 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925715:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c29c476e000) 00010000:00010000:0.0:1783144430.925761:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a4230499da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f12 expref: 33 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925774:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:0.0:1783144430.925778:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144430.925795:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925807:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925823:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925835:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925843:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925850:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925984:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.925994:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926002:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926178:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926188:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926196:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926204:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926222:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926229:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926246:0:66114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144430.926265:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926271:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926277:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926284:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144430.926288:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926296:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926305:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c2aee58ed00) 00010000:00010000:0.0:1783144430.926307:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783144430.926310:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926316:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049a0b lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926342:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926348:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926354:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926359:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926376:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144430.926380:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926387:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.926396:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144430.926397:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:0.0:1783144430.926403:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144430.926406:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926407:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.926425:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01000 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144430.926429:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926439:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a4230499fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.926440:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783144430.926462:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f28dd40b reply state 00000000bfef3f37 transno 120259084354 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.926463:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c2aee58ed00) 00010000:00010000:1.0:1783144430.926471:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783144430.926477:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926477:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144430.926485:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049a12 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144430.926492:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2ac2a42e00) 00010000:00010000:0.0:1783144430.926495:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144430.926497:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144430.926505:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144430.926509:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144430.926512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783144430.926550:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:73455:x1869759481747968:12345-192.168.203.4@tcp:36:rm.0 Request processed in 975us (1087us total) trans 120259084354 rc 0/0 00000100:00100000:0.0:1783144430.926559:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1385 00010000:00010000:2.0:1783144431.566114:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144431.714889:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144431.714926:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144431.714949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144431.714961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144431.715007:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748224 00000100:00100000:1.0:1783144431.715014:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748224 00000100:00100000:3.0:1783144431.715036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144431.715076:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748096 00000100:00100000:3.0:1783144431.715079:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748096 00000100:00100000:1.0:1783144431.715107:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748352 00000100:00100000:1.0:1783144431.715109:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748352 00000100:00100000:1.0:1783144431.715124:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 889 00000100:00100000:1.0:1783144431.715137:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2404:x1869759481748224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144431.715251:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:3.0:1783144431.715260:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481748096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144431.715313:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c354ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2404:x1869759481748224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 175us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144431.715325:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 889 00000100:00100000:1.0:1783144431.715347:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 890 00000100:00100000:1.0:1783144431.715355:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2404:x1869759481748352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144431.715394:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2404:x1869759481748352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144431.715400:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 890 00000100:00100000:3.0:1783144431.715496:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481748096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 236us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144431.715503:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:1.0:1783144431.715524:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748480 00000100:00100000:1.0:1783144431.715528:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748480 00000100:00100000:3.0:1783144431.715533:0:26143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748608 00000100:00100000:3.0:1783144431.715541:0:26143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748608 00000100:00100000:1.0:1783144431.715554:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2107 00000100:00100000:1.0:1783144431.715561:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481748480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144431.715562:0:26143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2108 00000100:00100000:3.0:1783144431.715568:0:26143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481748608:12345-192.168.203.4@tcp:400:kworker.0 00010000:00000080:1.0:1783144431.715574:0:16470:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5d04000 x1869759481748480/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:542/0 lens 224/224 e 0 to 0 dl 1783144442 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144431.715598:0:26143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481748608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144431.715602:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2404:x1869759481748480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144431.715606:0:26143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2108 00000100:00100000:1.0:1783144431.715611:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2107 00010000:00010000:0.0:1783144432.591553:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144433.166557:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144433.166651:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501423360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144433.166712:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144433.166798:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afa944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501423232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783144433.166822:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144433.166988:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501423360 00000100:00100000:2.0:1783144433.166995:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501423360 00000100:00100000:3.0:1783144433.167122:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501423232 00000100:00100000:3.0:1783144433.167127:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501423232 00000100:00080000:0.0:1783144433.167318:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783144433.167323:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144433.167367:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:2.0:1783144433.167377:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501423360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783144433.167404:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783144433.167461:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501423360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144433.167482:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:0.0:1783144433.167563:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501423360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783144433.167613:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:1.0:1783144433.167627:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501423232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783144433.167642:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646080 pending 0 free 3922481152 avail 3690958848 00010000:00000080:1.0:1783144433.167652:0:11960:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef604380 x1869759501423232/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:544/0 lens 224/368 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144433.167693:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501423232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.167699:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:0.0:1783144433.168042:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afa944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501423232:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783144433.614397:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783144433.791615:0:95712:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:0.0:1783144433.914654:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.914773:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748736 00000100:00100000:1.0:1783144433.914783:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748736 00000100:00080000:0.0:1783144433.914841:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144433.914892:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1386 00000100:00100000:3.0:1783144433.914904:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:73533:x1869759481748736:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.914920:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.914936:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f20 expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.914994:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049a20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.915007:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.915017:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144433.915071:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144433.915075:0:66114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144433.915103:0:66114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049a20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.915141:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f20 expref: 36 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.915157:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049a20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f20 expref: 35 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.915166:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:3.0:1783144433.915180:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144433.915185:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ee00, rc 0) 00000100:00100000:3.0:1783144433.915242:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:73533:x1869759481748736:12345-192.168.203.4@tcp:101:dd.0 Request processed in 340us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.915250:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1386 00000100:00100000:1.0:1783144433.918975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.919019:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748864 00000100:00100000:3.0:1783144433.919027:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748864 00000100:00100000:3.0:1783144433.919120:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1387 00000100:00100000:3.0:1783144433.919199:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:73534:x1869759481748864:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.919215:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.919244:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f27 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144433.919276:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1783144433.919294:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049a2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.919314:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.919402:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144433.919447:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783144433.919450:0:66947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783144433.919466:0:66947:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.919487:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f27 expref: 37 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.919503:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f800/0xad8e53a423049a2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f27 expref: 36 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.919511:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:3.0:1783144433.919514:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783144433.919517:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f800, rc 0) 00000100:00100000:3.0:1783144433.919584:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+36:73534:x1869759481748864:12345-192.168.203.4@tcp:101:dd.0 Request processed in 389us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.919591:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1387 00000100:00100000:1.0:1783144433.920180:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481748992 00000100:00100000:1.0:1783144433.920185:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481748992 00000100:00100000:2.0:1783144433.920749:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1388 00000100:00100000:2.0:1783144433.920760:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+36:73535:x1869759481748992:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.920771:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144433.920780:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286200/0xad8e53a423049a35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f2e expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.920812:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049a3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.920822:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.920832:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144433.920894:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.920927:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481749120 00000100:00100000:1.0:1783144433.920932:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481749120 00000004:00200000:2.0:1783144433.920938:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783144433.920943:0:66113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783144433.920959:0:66113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.920975:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286200/0xad8e53a423049a35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f2e expref: 39 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.920991:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049a3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f2e expref: 38 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.920995:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1389 00010000:00010000:2.0:1783144433.921005:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00000100:00100000:1.0:1783144433.921008:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:73536:x1869759481749120:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.921010:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144433.921019:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144433.921024:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287c00, rc 0) 00010000:00010000:1.0:1783144433.921031:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423049a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f35 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144433.921056:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:73535:x1869759481748992:12345-192.168.203.4@tcp:101:dd.0 Request processed in 299us (1780us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144433.921063:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049a4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144433.921064:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1388 00010000:00010000:1.0:1783144433.921076:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.921085:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144433.921121:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783144433.921124:0:81077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783144433.921136:0:81077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.921153:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423049a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f35 expref: 39 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.921167:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f35 expref: 38 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.921175:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144433.921177:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783144433.921180:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151800, rc 0) 00000100:00100000:1.0:1783144433.921202:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:73536:x1869759481749120:12345-192.168.203.4@tcp:101:dd.0 Request processed in 197us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.921269:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1389 00000100:00100000:2.0:1783144433.927094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.927206:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481749248 00000100:00100000:1.0:1783144433.927217:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481749248 00000100:00100000:1.0:1783144433.927276:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 721 00000100:00100000:1.0:1783144433.927287:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:2405:x1869759481749248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144433.927302:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144433.927323:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049a20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f20 expref: 38 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.927353:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144433.927371:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144433.927410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.927491:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:2405:x1869759481749248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 205us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.927498:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 721 00000100:00100000:2.0:1783144433.930971:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481749504 00000100:00100000:2.0:1783144433.930981:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481749504 00000100:00100000:0.0:1783144433.930983:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.931023:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1390 00000100:00100000:2.0:1783144433.931035:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:73534:x1869759481749504:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.931052:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144433.931069:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286600/0xad8e53a423049a51 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f3c expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.931119:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481749632 00000100:00100000:1.0:1783144433.931126:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481749632 00000100:00100000:1.0:1783144433.931158:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 722 00000100:00100000:1.0:1783144433.931167:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:2403:x1869759481749632:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144433.931185:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144433.931191:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.931202:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049a4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f35 expref: 39 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931206:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931225:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.931227:0:26153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:1.0:1783144433.931235:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144433.931245:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931254:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931261:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.931275:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:2403:x1869759481749632:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.931289:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 722 00010000:00010000:2.0:1783144433.931351:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049a66 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931360:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049a66 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931367:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049a66 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144433.931376:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783144433.931447:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931454:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931461:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931467:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931474:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2acb287e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144433.931478:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931487:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931497:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144433.931501:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144433.931512:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931518:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049a58 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931530:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931535:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931541:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931546:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2acb287200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144433.931549:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931554:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931562:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9c2ac2a42a00) 00010000:00010000:2.0:1783144433.931564:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144433.931567:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931572:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a5f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931607:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286600/0xad8e53a423049a51 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f3c expref: 39 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931632:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049a66 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f3c expref: 38 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.931640:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:2.0:1783144433.931642:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144433.931645:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb286800, rc 0) 00000100:00100000:2.0:1783144433.931814:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:73534:x1869759481749504:12345-192.168.203.4@tcp:101:dd.0 Request processed in 781us (4403us total) trans 120259084355 rc 0/0 00000100:00100000:2.0:1783144433.931821:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1390 00000100:00100000:0.0:1783144433.936133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.936226:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481749760 00000100:00100000:3.0:1783144433.936235:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481749760 00000100:00100000:3.0:1783144433.936298:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 723 00000100:00100000:3.0:1783144433.936308:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:2403:x1869759481749760:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783144433.936322:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144433.936353:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049a3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f2e expref: 38 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.936371:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c29cd29eb00) 00010000:00010000:3.0:1783144433.936388:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144433.936449:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:2403:x1869759481749760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 141us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.936457:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 723 00000100:00100000:1.0:1783144433.943590:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.943629:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.943754:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481749888 00000100:00100000:2.0:1783144433.943823:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481749888 00000100:00100000:3.0:1783144433.943842:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481750144 00000100:00100000:3.0:1783144433.943848:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481750144 00000100:00100000:2.0:1783144433.943886:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1391 00000100:00100000:2.0:1783144433.943898:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:73534:x1869759481749888:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.943920:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144433.943939:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286600/0xad8e53a423049a74 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f43 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.943970:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a7b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.943984:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.943996:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.944014:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1392 00000100:00100000:3.0:1783144433.944024:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:73537:x1869759481750144:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.944034:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.944045:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049a82 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f4a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.944109:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286600/0xad8e53a423049a74 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f43 expref: 41 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.944136:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287200/0xad8e53a423049a7b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f43 expref: 40 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944144:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.944145:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:2.0:1783144433.944151:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783144433.944156:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287200, rc 0) 00010000:00010000:3.0:1783144433.944165:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944176:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944192:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944200:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944207:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144433.944216:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeeda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:73534:x1869759481749888:12345-192.168.203.4@tcp:101:dd.0 Request processed in 320us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144433.944224:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1391 00010000:00010000:3.0:1783144433.944254:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049a97 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944269:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049a97 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944276:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049a97 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144433.944287:0:66114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xa:0x0]: returning size 0 00010000:00010000:3.0:1783144433.944369:0:66114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944378:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944384:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944391:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944398:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.944402:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944410:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944419:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144433.944422:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.944426:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944432:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049a89 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944449:0:66114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944456:0:66114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944462:0:66114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944467:0:66114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.944470:0:66114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944476:0:66114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944544:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9c2ac3bcc400) 00010000:00010000:3.0:1783144433.944548:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.944551:0:66114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944555:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049a90 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944581:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049a82 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f4a expref: 41 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944589:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049a97 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f4a expref: 40 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.944602:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:3.0:1783144433.944604:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144433.944606:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f400, rc 0) 00000100:00100000:3.0:1783144433.944637:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:73537:x1869759481750144:12345-192.168.203.4@tcp:101:dd.0 Request processed in 615us (1006us total) trans 120259084356 rc 0/0 00000100:00100000:3.0:1783144433.944642:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1392 00000100:00100000:0.0:1783144433.952275:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.952316:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.952359:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.952418:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481750272 00000100:00100000:3.0:1783144433.952430:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481750272 00000100:00100000:1.0:1783144433.952461:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481750528 00000100:00100000:1.0:1783144433.952466:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481750528 00000100:00100000:3.0:1783144433.952490:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481750784 00000100:00100000:3.0:1783144433.952495:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481750784 00000100:00100000:1.0:1783144433.952506:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1393 00000100:00100000:1.0:1783144433.952517:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+42:73537:x1869759481750272:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144433.952538:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.952565:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049aa5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f51 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.952607:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1394 00010000:00010000:1.0:1783144433.952619:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423049aac lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.952628:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+43:73533:x1869759481750528:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144433.952636:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423049aac lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952640:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.952650:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423049aac lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952653:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049ab3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f58 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.952775:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049aa5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f51 expref: 45 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952783:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952795:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952804:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952818:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952836:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952843:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952886:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049ac8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952894:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049ac8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.952900:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151200/0xad8e53a423049aac lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f51 expref: 44 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.952902:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049ac8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144433.952923:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x6:0x0]: returning size 0 00010000:00010000:1.0:1783144433.952923:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:1.0:1783144433.952929:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783144433.952932:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151200, rc 0) 00000100:00100000:1.0:1783144433.952982:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:73537:x1869759481750272:12345-192.168.203.4@tcp:101:dd.0 Request processed in 467us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.952991:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1393 00010000:00010000:3.0:1783144433.953003:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.953012:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1395 00010000:00010000:3.0:1783144433.953013:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.953021:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:73534:x1869759481750784:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:3.0:1783144433.953024:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953033:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953040:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.953044:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.953047:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144433.953063:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.953065:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049a66 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f3c expref: 44 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953080:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144433.953085:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.953090:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953100:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049aba lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.953101:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:3.0:1783144433.953117:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.953122:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144433.953124:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953132:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953137:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ee00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.953140:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953146:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953153:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9c2ac3bcc600) 00010000:00010000:3.0:1783144433.953156:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.953159:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953176:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ee00/0xad8e53a423049ac1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953212:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049ab3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f58 expref: 45 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953226:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049ac8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f58 expref: 44 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.953226:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953245:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:1.0:1783144433.953246:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.953251:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144433.953255:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98f200, rc 0) 00010000:00010000:1.0:1783144433.953259:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.953289:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:73533:x1869759481750528:12345-192.168.203.4@tcp:101:dd.0 Request processed in 674us (973us total) trans 120259084357 rc 0/0 00000100:00100000:3.0:1783144433.953296:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1394 00000001:00080000:0.0:1783144433.954056:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084358 00000004:00010000:0.0:1783144433.954082:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ae52672 reply state 000000004713baac transno 120259084359 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.954096:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.954102:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:0.0:1783144433.954111:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144433.954114:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144433.954177:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:73534:x1869759481750784:12345-192.168.203.4@tcp:36:dd.0 Request processed in 1158us (1817us total) trans 120259084359 rc 0/0 00000100:00100000:0.0:1783144433.954184:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1395 00000020:00080000:0.0:1783144433.954188:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783144433.956184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.956238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.956317:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481751040 00000100:00100000:0.0:1783144433.956325:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481751040 00000100:00100000:0.0:1783144433.956376:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481751168 00000100:00100000:0.0:1783144433.956380:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481751168 00000100:00100000:0.0:1783144433.956406:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1396 00000100:00100000:0.0:1783144433.956415:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+46:73537:x1869759481751040:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:1.0:1783144433.956440:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1397 00000100:00100000:1.0:1783144433.956450:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+46:73533:x1869759481751168:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144433.956456:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144433.956460:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.956475:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423049add lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f5f expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.956479:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049a97 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f4a expref: 46 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.956500:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:0.0:1783144433.956505:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144433.956506:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423049ae4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.956519:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423049ae4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.956528:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423049ae4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.956789:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423049add lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f5f expref: 48 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.956815:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151000/0xad8e53a423049ae4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f5f expref: 47 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.956822:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:1.0:1783144433.956825:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783144433.956828:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151000, rc 0) 00000100:00100000:1.0:1783144433.956866:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:73533:x1869759481751168:12345-192.168.203.4@tcp:101:dd.0 Request processed in 418us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.956875:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1397 00000100:00100000:2.0:1783144433.957091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.957152:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481751424 00000100:00100000:3.0:1783144433.957157:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481751424 00000100:00100000:3.0:1783144433.957189:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1398 00000100:00100000:3.0:1783144433.957197:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:73538:x1869759481751424:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.957206:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.957216:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049aeb lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f66 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957296:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957312:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957320:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957334:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957354:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957362:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957404:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a423049b00 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957413:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a423049b00 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957419:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a423049b00 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144433.957427:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783144433.957471:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957478:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957485:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957498:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957504:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98e000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.957508:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957515:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957524:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144433.957527:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.957542:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957549:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049af2 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957559:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957565:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957570:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957575:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.957578:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957594:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.957602:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9c2ac3bcc400) 00010000:00010000:3.0:1783144433.957604:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.957607:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.957717:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.957741:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.957749:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144433.958016:0:66112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084360 00000004:00010000:0.0:1783144433.958039:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6304acb reply state 00000000141a04d2 transno 120259084362 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.958062:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.958069:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:0.0:1783144433.958072:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144433.958074:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144433.958139:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:73537:x1869759481751040:12345-192.168.203.4@tcp:36:dd.0 Request processed in 1725us (1958us total) trans 120259084362 rc 0/0 00000100:00100000:0.0:1783144433.958146:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1396 00000020:00080000:0.0:1783144433.958150:0:66112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783144433.958870:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049af9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.958911:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049aeb lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f66 expref: 51 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.958923:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a423049b00 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f66 expref: 50 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.958931:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:3.0:1783144433.958933:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144433.958936:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e400, rc 0) 00000100:00100000:3.0:1783144433.959028:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+50:73538:x1869759481751424:12345-192.168.203.4@tcp:101:dd.0 Request processed in 1831us (1937us total) trans 120259084361 rc 0/0 00000100:00100000:3.0:1783144433.959035:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1398 00000100:00100000:0.0:1783144433.959095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.959187:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481751552 00000100:00100000:3.0:1783144433.959192:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481751552 00000100:00100000:3.0:1783144433.959248:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5011 00000100:00100000:3.0:1783144433.959256:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:73534:x1869759481751552:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.959274:0:26148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.959288:0:26148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab385e2e/0xad8e53a423049b15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f6d expref: -99 pid: 26148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144433.959307:0:26148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:3.0:1783144433.959319:0:26148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:3.0:1783144433.959324:0:26148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144433.959332:0:26148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab385e2e/0xad8e53a423049b15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f6d expref: 6 pid: 26148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.959356:0:26148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab385e2e/0xad8e53a423049b15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f6d expref: 6 pid: 26148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.959367:0:26148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fa00, rc 0) 00010000:00000080:3.0:1783144433.959373:0:26148:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab10700 x1869759481751552/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144433.959405:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:73534:x1869759481751552:12345-192.168.203.4@tcp:101:dd.0 Request processed in 150us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.959411:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5011 00000100:00080000:0.0:1783144433.959455:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783144433.959796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.959907:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481751808 00000100:00100000:3.0:1783144433.959911:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481751808 00000100:00100000:3.0:1783144433.959938:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1399 00000100:00100000:3.0:1783144433.959943:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+50:73533:x1869759481751808:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:3.0:1783144433.959966:0:81077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144433.959977:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049ac8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f58 expref: 50 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.960031:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:3.0:1783144433.960035:0:81077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144433.960227:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1783144433.960240:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.960251:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.960260:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.960266:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481751936 00000100:00100000:1.0:1783144433.960271:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481751936 00000100:00100000:1.0:1783144433.960306:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5012 00000001:00080000:3.0:1783144433.960308:0:81077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084363 00000100:00100000:1.0:1783144433.960317:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:73537:x1869759481751936:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144433.960326:0:26152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1783144433.960332:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025b8ee48 reply state 00000000db7b5c0d transno 120259084364 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.960339:0:26152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049b23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f74 expref: -99 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.960352:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.960370:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:3.0:1783144433.960373:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:1.0:1783144433.960376:0:26152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00000100:00100000:3.0:1783144433.960377:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783144433.960391:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:1.0:1783144433.960395:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144433.960402:0:26152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049b23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f74 expref: 7 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.960414:0:26152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049b23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f74 expref: 7 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.960436:0:26152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150000, rc 0) 00010000:00000080:1.0:1783144433.960442:0:26152:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c615b480 x1869759481751936/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144433.960450:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+52:73533:x1869759481751808:12345-192.168.203.4@tcp:36:dd.0 Request processed in 503us (650us total) trans 120259084364 rc 0/0 00000100:00100000:3.0:1783144433.960459:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1399 00000020:00080000:3.0:1783144433.960463:0:81077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783144433.960475:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:73537:x1869759481751936:12345-192.168.203.4@tcp:101:dd.0 Request processed in 161us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.960483:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5012 00000100:00100000:0.0:1783144433.962601:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.963396:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752064 00000100:00100000:3.0:1783144433.963404:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752064 00000100:00100000:3.0:1783144433.963442:0:26146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5013 00000100:00100000:3.0:1783144433.963451:0:26146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:73533:x1869759481752064:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.963476:0:26146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.963497:0:26146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7509ac9/0xad8e53a423049b2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f7b expref: -99 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144433.963518:0:26146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:3.0:1783144433.963534:0:26146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:3.0:1783144433.963538:0:26146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144433.963545:0:26146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7509ac9/0xad8e53a423049b2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f7b expref: 8 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.963557:0:26146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7509ac9/0xad8e53a423049b2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f7b expref: 8 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.963568:0:26146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ee00, rc 0) 00010000:00000080:3.0:1783144433.963574:0:26146:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affe1b800 x1869759481752064/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144433.963842:0:26146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:73533:x1869759481752064:12345-192.168.203.4@tcp:101:dd.0 Request processed in 390us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.963850:0:26146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5013 00000100:00100000:0.0:1783144433.965238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.965310:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752192 00000100:00100000:1.0:1783144433.965315:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752192 00002000:00010000:1.0:1783144433.965350:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00002000:00100000:1.0:1783144433.965355:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affe1b100 with x1869759481752192 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144433.965365:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affe1b100. 00000100:00100000:1.0:1783144433.965389:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 754 00000100:00100000:1.0:1783144433.965399:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2406:x1869759481752192:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:1.0:1783144433.965541:0:24830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144433.965544:0:24830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144433.965547:0:24830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144433.965549:0:24830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144433.965551:0:24830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144433.965558:0:24830:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affe1b100 x1869759481752192/t4294968852(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144433.965593:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2406:x1869759481752192:12345-192.168.203.4@tcp:10:dd.0 Request processed in 197us (358us total) trans 4294968852 rc 0/0 00000100:00100000:1.0:1783144433.965600:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 754 00002000:00010000:1.0:1783144433.965627:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00002000:00100000:1.0:1783144433.965630:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affe1b100 with x1869759481752192 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144433.965635:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affe1b100. 00000100:00100000:0.0:1783144433.966018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.966129:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752320 00000100:00100000:3.0:1783144433.966133:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752320 00000100:00100000:3.0:1783144433.966331:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1400 00000100:00100000:3.0:1783144433.966350:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+52:73538:x1869759481752320:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.966366:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.966380:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049b31 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f82 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.966416:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049b38 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.966428:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049b38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.966438:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049b38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.966523:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e000/0xad8e53a423049b31 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f82 expref: 54 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.966539:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e200/0xad8e53a423049b38 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f82 expref: 53 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.966548:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:3.0:1783144433.966551:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144433.966553:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e200, rc 0) 00000100:00100000:3.0:1783144433.966584:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+53:73538:x1869759481752320:12345-192.168.203.4@tcp:101:dd.0 Request processed in 246us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.966591:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1400 00000100:00100000:0.0:1783144433.966658:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.966691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.966694:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752448 00000100:00100000:2.0:1783144433.966700:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752448 00002000:00010000:2.0:1783144433.966716:0:24827:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.966810:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affe19f80 with x1869759481752448 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.966817:0:24827:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affe19f80. 00000100:00100000:2.0:1783144433.966836:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 755 00000100:00100000:2.0:1783144433.966844:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2405:x1869759481752448:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:2.0:1783144433.966934:0:24827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783144433.966937:0:24827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.966940:0:24827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:2.0:1783144433.966942:0:24827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.966945:0:24827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783144433.966958:0:24827:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affe19f80 x1869759481752448/t4294968853(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144433.966996:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2405:x1869759481752448:12345-192.168.203.4@tcp:10:dd.0 Request processed in 153us (338us total) trans 4294968853 rc 0/0 00000100:00100000:2.0:1783144433.967003:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 755 00002000:00010000:2.0:1783144433.967006:0:24827:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.967009:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affe19f80 with x1869759481752448 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.967013:0:24827:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affe19f80. 00000100:00100000:1.0:1783144433.967749:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752704 00000100:00100000:1.0:1783144433.967754:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752704 00000100:00100000:1.0:1783144433.967783:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1401 00000100:00100000:1.0:1783144433.967790:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+53:73552:x1869759481752704:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144433.967799:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.967810:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423049b3f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f89 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.967902:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.967912:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.967920:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.967933:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.967940:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.967946:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.967990:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049b54 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968005:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049b54 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968012:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049b54 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144433.968022:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x19:0x0]: returning size 0 00010000:00010000:1.0:1783144433.968077:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968084:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968091:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968097:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968103:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02151800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144433.968107:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968114:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968124:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144433.968127:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144433.968130:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968136:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02151800/0xad8e53a423049b46 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968156:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968162:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968168:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968173:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144433.968176:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968182:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968190:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9c29c476eb00) 00010000:00010000:1.0:1783144433.968192:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144433.968195:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968200:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150e00/0xad8e53a423049b4d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968231:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150a00/0xad8e53a423049b3f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f89 expref: 56 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968243:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049b54 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f89 expref: 55 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.968262:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:1.0:1783144433.968264:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144433.968266:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150c00, rc 0) 00000100:00100000:1.0:1783144433.968293:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+55:73552:x1869759481752704:12345-192.168.203.4@tcp:101:dd.0 Request processed in 504us (1602us total) trans 120259084365 rc 0/0 00000100:00100000:1.0:1783144433.968300:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1401 00000100:00100000:1.0:1783144433.969402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.969428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.969454:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.969509:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752832 00000100:00100000:2.0:1783144433.969514:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752832 00002000:00010000:2.0:1783144433.969531:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.969536:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aee583100 with x1869759481752832 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.969542:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aee583100. 00000100:00100000:2.0:1783144433.969567:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 756 00000100:00100000:2.0:1783144433.969575:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2405:x1869759481752832:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:2.0:1783144433.969780:0:24814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783144433.969783:0:24814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.969786:0:24814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:2.0:1783144433.969788:0:24814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.969790:0:24814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783144433.969797:0:24814:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aee583100 x1869759481752832/t4294968854(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144433.969832:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aee583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2405:x1869759481752832:12345-192.168.203.4@tcp:10:dd.0 Request processed in 258us (430us total) trans 4294968854 rc 0/0 00000100:00100000:2.0:1783144433.969839:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 756 00002000:00010000:2.0:1783144433.969842:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.969852:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aee583100 with x1869759481752832 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.969857:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aee583100. 00000100:00100000:2.0:1783144433.969936:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481753344 00000100:00100000:2.0:1783144433.969941:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481753344 00000100:00100000:2.0:1783144433.969965:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 261 00000100:00100000:2.0:1783144433.969972:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+55:73537:x1869759481753344:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:2.0:1783144433.970125:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+56:73537:x1869759481753344:12345-192.168.203.4@tcp:35:dd.0 Request processed in 152us (669us total) trans 120259084366 rc 0/0 00000100:00100000:2.0:1783144433.970132:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 261 00000100:00100000:0.0:1783144433.970333:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481753088 00000100:00100000:0.0:1783144433.970336:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481753088 00000100:00100000:0.0:1783144433.970383:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1402 00000100:00100000:0.0:1783144433.970391:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+56:73538:x1869759481753088:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1783144433.970425:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144433.970438:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98e400/0xad8e53a423049b00 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f66 expref: 56 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.970447:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:0.0:1783144433.970449:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144433.970514:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.970527:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.970540:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144433.970573:0:66112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084367 00000004:00010000:0.0:1783144433.970593:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb5573f6 reply state 000000006f9061bd transno 120259084368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.970605:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.970612:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:0.0:1783144433.970616:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144433.970618:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144433.970867:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+58:73538:x1869759481753088:12345-192.168.203.4@tcp:36:dd.0 Request processed in 476us (1437us total) trans 120259084368 rc 0/0 00000100:00100000:0.0:1783144433.970875:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1402 00000020:00080000:0.0:1783144433.970878:0:66112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783144433.971152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.971181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.971191:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481753600 00000100:00100000:0.0:1783144433.971197:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481753600 00000100:00100000:2.0:1783144433.971212:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.971232:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 262 00000100:00100000:2.0:1783144433.971240:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481753728 00000100:00100000:0.0:1783144433.971242:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+58:73534:x1869759481753600:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:2.0:1783144433.971246:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481753728 00000100:00100000:2.0:1783144433.971272:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481753984 00000100:00100000:2.0:1783144433.971275:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481753984 00000100:00100000:2.0:1783144433.971296:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1403 00000100:00100000:2.0:1783144433.971304:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+60:73552:x1869759481753728:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.971314:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144433.971327:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049b69 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f90 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.971364:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286200/0xad8e53a423049b70 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.971374:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286200/0xad8e53a423049b70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.971385:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1404 00010000:00010000:2.0:1783144433.971399:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286200/0xad8e53a423049b70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.971400:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+62:73539:x1869759481753984:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:0.0:1783144433.971412:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+62:73534:x1869759481753600:12345-192.168.203.4@tcp:35:dd.0 Request processed in 168us (256us total) trans 120259084369 rc 0/0 00010000:00010000:3.0:1783144433.971415:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783144433.971423:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 262 00010000:00010000:3.0:1783144433.971428:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049b77 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f97 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971518:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971528:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971537:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971549:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971556:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971562:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971598:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049b8c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971606:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049b8c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971612:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049b8c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144433.971620:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xc:0x0]: returning size 0 00010000:00010000:3.0:1783144433.971776:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971793:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971799:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971805:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ea00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.971810:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971817:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971826:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144433.971828:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.971831:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971837:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049b7e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971846:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971852:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971857:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971862:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98ec00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144433.971869:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971875:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971881:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9c2ac3bcc400) 00010000:00010000:3.0:1783144433.971884:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144433.971886:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971892:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049b85 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971919:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049b77 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f97 expref: 64 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971931:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049b8c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f97 expref: 63 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.971938:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144433.971940:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144433.971942:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98fc00, rc 0) 00000100:00100000:3.0:1783144433.971963:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+63:73539:x1869759481753984:12345-192.168.203.4@tcp:101:dd.0 Request processed in 568us (753us total) trans 120259084370 rc 0/0 00000100:00100000:3.0:1783144433.971969:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1404 00010000:00010000:2.0:1783144433.972081:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049b69 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f90 expref: 63 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.972095:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286200/0xad8e53a423049b70 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f90 expref: 62 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.972102:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:2.0:1783144433.972116:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783144433.972119:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb286200, rc 0) 00000100:00100000:2.0:1783144433.972159:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+62:73552:x1869759481753728:12345-192.168.203.4@tcp:101:dd.0 Request processed in 856us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144433.972165:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1403 00000100:00100000:0.0:1783144433.975887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.975931:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.975958:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481754112 00000100:00100000:3.0:1783144433.975966:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481754112 00000100:00100000:0.0:1783144433.975971:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.976034:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481754368 00000100:00100000:1.0:1783144433.976039:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481754368 00000100:00100000:3.0:1783144433.976057:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5014 00000100:00100000:3.0:1783144433.976070:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:73538:x1869759481754112:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:1.0:1783144433.976075:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 263 00000100:00100000:1.0:1783144433.976087:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+62:73533:x1869759481754368:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:3.0:1783144433.976093:0:26139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.976122:0:26139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d8f8f01/0xad8e53a423049b9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41f9e expref: -99 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144433.976145:0:26139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:3.0:1783144433.976160:0:26139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:3.0:1783144433.976165:0:26139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144433.976180:0:26139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8f8f01/0xad8e53a423049b9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f9e expref: 12 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.976195:0:26139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d8f8f01/0xad8e53a423049b9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f9e expref: 12 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.976214:0:26139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98e000, rc 0) 00010000:00000080:3.0:1783144433.976221:0:26139:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affe19c00 x1869759481754112/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144433.976262:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:73538:x1869759481754112:12345-192.168.203.4@tcp:101:dd.0 Request processed in 196us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.976270:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5014 00000100:00100000:3.0:1783144433.976293:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481754624 00000100:00100000:3.0:1783144433.976297:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481754624 00000100:00100000:1.0:1783144433.976304:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+63:73533:x1869759481754368:12345-192.168.203.4@tcp:35:dd.0 Request processed in 207us (359us total) trans 120259084371 rc 0/0 00000100:00100000:1.0:1783144433.976314:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 263 00000100:00100000:3.0:1783144433.976321:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1405 00000100:00100000:3.0:1783144433.976330:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+63:73552:x1869759481754624:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:3.0:1783144433.976370:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144433.976389:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049b54 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f89 expref: 63 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.976408:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:3.0:1783144433.976412:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144433.976486:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.976498:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.976506:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783144433.976538:0:66114:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084372 00000004:00010000:3.0:1783144433.976556:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003002791a reply state 000000008684c489 transno 120259084373 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.976566:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.976573:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:3.0:1783144433.976576:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144433.976579:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783144433.976621:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+65:73552:x1869759481754624:12345-192.168.203.4@tcp:36:dd.0 Request processed in 293us (652us total) trans 120259084373 rc 0/0 00000100:00100000:3.0:1783144433.976629:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1405 00000020:00080000:3.0:1783144433.976632:0:66114:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783144433.977080:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.977169:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481754752 00000100:00100000:0.0:1783144433.977174:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481754752 00000100:00100000:0.0:1783144433.977255:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1406 00000100:00100000:0.0:1783144433.977264:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+65:73539:x1869759481754752:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144433.977274:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144433.977285:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049ba8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fa5 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977305:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423049baf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977315:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423049baf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977322:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423049baf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977437:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049ba8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fa5 expref: 67 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977450:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01400/0xad8e53a423049baf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fa5 expref: 66 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977514:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:0.0:1783144433.977517:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783144433.977520:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed01400, rc 0) 00000100:00100000:0.0:1783144433.977575:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+66:73539:x1869759481754752:12345-192.168.203.4@tcp:101:dd.0 Request processed in 312us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.977586:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.977594:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1406 00000100:00100000:0.0:1783144433.977611:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481755008 00000100:00100000:0.0:1783144433.977615:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481755008 00000100:00100000:0.0:1783144433.977638:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1407 00000100:00100000:0.0:1783144433.977645:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+66:73536:x1869759481755008:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144433.977654:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144433.977662:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049bb6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fac expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977783:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977792:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977808:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977821:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977827:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977834:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977872:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049bcb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977889:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049bcb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977896:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049bcb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144433.977904:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x9:0x0]: returning size 0 00010000:00010000:0.0:1783144433.977945:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977952:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977958:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977963:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144433.977967:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977974:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977982:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144433.977984:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144433.977987:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.977993:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049bbd lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978001:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978011:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978016:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978021:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144433.978025:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978030:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978037:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9c2af9e77500) 00010000:00010000:0.0:1783144433.978039:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144433.978041:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978047:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049bc4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978072:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049bb6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fac expref: 69 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978081:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049bcb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fac expref: 68 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.978088:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:0.0:1783144433.978090:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144433.978097:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8600, rc 0) 00000100:00100000:0.0:1783144433.978131:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+68:73536:x1869759481755008:12345-192.168.203.4@tcp:101:dd.0 Request processed in 487us (549us total) trans 120259084374 rc 0/0 00000100:00100000:0.0:1783144433.978138:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1407 00000100:00100000:3.0:1783144433.979264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.979331:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481755136 00000100:00100000:2.0:1783144433.979337:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481755136 00002000:00010000:2.0:1783144433.979370:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.979805:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d05500 with x1869759481755136 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.979814:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d05500. 00000100:00100000:2.0:1783144433.979840:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 757 00000100:00100000:2.0:1783144433.979850:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:2403:x1869759481755136:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:2.0:1783144433.980222:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783144433.980227:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.980230:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:2.0:1783144433.980232:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.980243:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783144433.980253:0:8443:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5d05500 x1869759481755136/t4294968855(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144433.980302:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2403:x1869759481755136:12345-192.168.203.4@tcp:10:dd.0 Request processed in 454us (1040us total) trans 4294968855 rc 0/0 00000100:00100000:2.0:1783144433.980310:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 757 00002000:00010000:2.0:1783144433.980313:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.980316:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d05500 with x1869759481755136 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.980321:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d05500. 00000100:00100000:1.0:1783144433.981307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.981378:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481755264 00000100:00100000:0.0:1783144433.981383:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481755264 00000100:00100000:0.0:1783144433.981456:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5015 00000100:00100000:0.0:1783144433.981512:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:73552:x1869759481755264:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144433.981522:0:26150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144433.981535:0:26150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423049bd9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fb3 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144433.981552:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:0.0:1783144433.981565:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:0.0:1783144433.981570:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144433.981576:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423049bd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fb3 expref: 14 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.981590:0:26150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423049bd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fb3 expref: 14 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.981601:0:26150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9200, rc 0) 00010000:00000080:0.0:1783144433.981606:0:26150:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2addaad880 x1869759481755264/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144433.981646:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:73552:x1869759481755264:12345-192.168.203.4@tcp:101:dd.0 Request processed in 137us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144433.981663:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5015 00000100:00100000:3.0:1783144433.982301:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.982335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.982364:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481755520 00000100:00100000:0.0:1783144433.982370:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481755520 00000100:00100000:3.0:1783144433.982376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.982407:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481755904 00000100:00100000:0.0:1783144433.982409:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481755776 00000100:00100000:1.0:1783144433.982415:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481755904 00000100:00100000:0.0:1783144433.982415:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481755776 00000100:00100000:2.0:1783144433.982431:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1408 00000100:00100000:2.0:1783144433.982452:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+70:73536:x1869759481755520:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:0.0:1783144433.982466:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1409 00010000:00010000:2.0:1783144433.982468:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783144433.982478:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+70:73540:x1869759481755776:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.982484:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049be0 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fba expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.982488:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1410 00010000:00010000:0.0:1783144433.982489:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144433.982503:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a423049be7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fc1 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.982504:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+71:73539:x1869759481755904:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:2.0:1783144433.982518:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049bee lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.982530:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049bee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.982540:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049bee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.982554:0:66947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144433.982572:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98fc00/0xad8e53a423049b8c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f97 expref: 72 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.982586:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144433.982590:0:66947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144433.982602:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982613:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982621:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982634:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982640:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982645:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982680:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049c03 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982694:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049c03 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.982701:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049c03 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144433.982711:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xd:0x0]: returning size 0 00010000:00010000:3.0:1783144433.982928:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.982968:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.982976:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.983098:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287600/0xad8e53a423049be0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fba expref: 73 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.983113:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287c00/0xad8e53a423049bee lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fba expref: 72 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.983128:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:2.0:1783144433.983131:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783144433.983134:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287c00, rc 0) 00000100:00100000:2.0:1783144433.983169:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+72:73536:x1869759481755520:12345-192.168.203.4@tcp:101:dd.0 Request processed in 720us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144433.983178:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1408 00010000:00010000:0.0:1783144433.983232:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983238:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983241:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983245:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983249:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144433.983251:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983256:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983263:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144433.983265:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144433.983267:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983271:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049bf5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983287:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983292:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983298:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983303:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144433.983306:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983312:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983321:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9c2af9e77400) 00010000:00010000:0.0:1783144433.983323:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144433.983326:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983331:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049bfc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983376:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8e00/0xad8e53a423049be7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fc1 expref: 73 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983388:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049c03 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fc1 expref: 72 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.983405:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:0.0:1783144433.983407:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144433.983409:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8200, rc 0) 00000100:00100000:0.0:1783144433.983439:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+72:73540:x1869759481755776:12345-192.168.203.4@tcp:101:dd.0 Request processed in 966us (1065us total) trans 120259084376 rc 0/0 00000100:00100000:0.0:1783144433.983444:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1409 00000100:00100000:2.0:1783144433.983573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.983672:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481756160 00000100:00100000:1.0:1783144433.983678:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481756160 00000100:00100000:1.0:1783144433.983708:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 264 00000100:00100000:1.0:1783144433.983716:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+72:73538:x1869759481756160:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:2.0:1783144433.983897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000001:00080000:2.0:1783144433.984228:0:66947:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084375 00000004:00010000:2.0:1783144433.984255:0:66947:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3bc7eb3 reply state 00000000692234e2 transno 120259084377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.984268:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.984275:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:2.0:1783144433.984277:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144433.984280:0:66947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783144433.984335:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+74:73539:x1869759481755904:12345-192.168.203.4@tcp:36:dd.0 Request processed in 1835us (1998us total) trans 120259084377 rc 0/0 00000100:00100000:2.0:1783144433.984352:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1410 00000020:00080000:2.0:1783144433.984357:0:66947:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783144433.984611:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+74:73538:x1869759481756160:12345-192.168.203.4@tcp:35:dd.0 Request processed in 894us (1037us total) trans 120259084378 rc 0/0 00000100:00100000:1.0:1783144433.984630:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 264 00000100:00100000:1.0:1783144433.984657:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481756288 00000100:00100000:1.0:1783144433.984661:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481756288 00002000:00010000:1.0:1783144433.984679:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00002000:00100000:1.0:1783144433.984683:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c615a300 with x1869759481756288 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144433.984689:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c615a300. 00000100:00100000:1.0:1783144433.984709:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 758 00000100:00100000:1.0:1783144433.984717:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:2405:x1869759481756288:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:1.0:1783144433.984831:0:24810:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144433.984835:0:24810:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144433.984837:0:24810:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144433.984840:0:24810:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144433.984843:0:24810:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144433.984851:0:24810:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c615a300 x1869759481756288/t4294968856(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144433.984886:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:2405:x1869759481756288:12345-192.168.203.4@tcp:10:dd.0 Request processed in 169us (988us total) trans 4294968856 rc 0/0 00000100:00100000:1.0:1783144433.984894:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 758 00002000:00010000:1.0:1783144433.984898:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00002000:00100000:1.0:1783144433.984901:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c615a300 with x1869759481756288 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144433.984906:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c615a300. 00000100:00100000:0.0:1783144433.986431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.986465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.986488:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481756544 00000100:00100000:1.0:1783144433.986495:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481756544 00000100:00100000:0.0:1783144433.986500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.986531:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481756800 00000100:00100000:0.0:1783144433.986532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.986537:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481756800 00000100:00100000:0.0:1783144433.986557:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481757056 00000100:00100000:0.0:1783144433.986563:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481757056 00000100:00100000:1.0:1783144433.986580:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1411 00000100:00100000:1.0:1783144433.986590:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+76:73536:x1869759481756544:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:2.0:1783144433.986616:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481756672 00000100:00100000:2.0:1783144433.986621:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481756672 00010000:00010000:1.0:1783144433.986621:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144433.986640:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049bcb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fac expref: 76 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.986657:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:1.0:1783144433.986661:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783144433.986666:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5016 00000100:00100000:2.0:1783144433.986681:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:73539:x1869759481756672:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.986691:0:26140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.986783:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.986806:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.986817:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144433.986851:0:66114:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084379 00010000:00010000:2.0:1783144433.986860:0:26140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4210fec/0xad8e53a423049c1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fc8 expref: -99 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783144433.986873:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd21045b reply state 00000000225d6d5e transno 120259084380 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.986884:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.986895:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1412 00000100:00100000:0.0:1783144433.986906:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1413 00000100:00100000:3.0:1783144433.986912:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+77:73540:x1869759481756800:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:0.0:1783144433.986922:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+77:73535:x1869759481757056:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.986928:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144433.986932:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144433.986941:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049c26 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fcf expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.986945:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423049c2d lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fd6 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.986974:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049c34 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.986985:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049c34 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.987000:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049c34 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987026:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987046:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.987049:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:1.0:1783144433.987057:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144433.987060:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.987061:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144433.987071:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ec00/0xad8e53a423049c26 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fcf expref: 80 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.987099:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98ea00/0xad8e53a423049c34 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fcf expref: 80 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987101:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.987118:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:0.0:1783144433.987121:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.987123:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144433.987128:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afa98ea00, rc 0) 00010000:00010000:0.0:1783144433.987134:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.987142:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+80:73536:x1869759481756544:12345-192.168.203.4@tcp:36:dd.0 Request processed in 550us (710us total) trans 120259084380 rc 0/0 00000100:00100000:1.0:1783144433.987152:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1411 00000020:00080000:1.0:1783144433.987163:0:66114:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783144433.987165:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+80:73540:x1869759481756800:12345-192.168.203.4@tcp:101:dd.0 Request processed in 259us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.987174:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1412 00010000:00010000:0.0:1783144433.987179:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049c49 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987189:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049c49 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987211:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049c49 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144433.987221:0:66113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x8:0x0]: returning size 0 00010000:00010000:0.0:1783144433.987270:0:66113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987288:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987295:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987300:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987305:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3ce00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144433.987314:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987321:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987331:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144433.987334:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144433.987337:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987353:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049c3b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987364:0:66113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987371:0:66113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987376:0:66113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987381:0:66113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144433.987384:0:66113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987390:0:66113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987398:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9c2af9e77000) 00010000:00010000:0.0:1783144433.987400:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144433.987410:0:66113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987416:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049c42 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987447:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3de00/0xad8e53a423049c2d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fd6 expref: 80 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987459:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049c49 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fd6 expref: 79 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.987466:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:0.0:1783144433.987468:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144433.987470:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d600, rc 0) 00000100:00100000:0.0:1783144433.987501:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+79:73535:x1869759481757056:12345-192.168.203.4@tcp:101:dd.0 Request processed in 585us (969us total) trans 120259084381 rc 0/0 00000100:00100000:0.0:1783144433.987508:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1413 00002000:00010000:2.0:1783144433.987580:0:26140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:2.0:1783144433.987593:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:2.0:1783144433.987598:0:26140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144433.987605:0:26140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4210fec/0xad8e53a423049c1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fc8 expref: 16 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.987616:0:26140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4210fec/0xad8e53a423049c1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fc8 expref: 16 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.987636:0:26140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb286600, rc 0) 00010000:00000080:2.0:1783144433.987642:0:26140:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affe18a80 x1869759481756672/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144433.987672:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:73539:x1869759481756672:12345-192.168.203.4@tcp:101:dd.0 Request processed in 992us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144433.987679:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5016 00000100:00100000:1.0:1783144433.989559:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.989585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.989602:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481757184 00000100:00100000:2.0:1783144433.989609:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481757184 00000100:00100000:1.0:1783144433.989647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.989850:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5017 00000100:00100000:2.0:1783144433.989860:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:73536:x1869759481757184:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:3.0:1783144433.989865:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481757440 00000100:00100000:3.0:1783144433.989871:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481757440 00010000:00010000:2.0:1783144433.989872:0:26147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144433.989900:0:26147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068537a7b/0xad8e53a423049c57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fdd expref: -99 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.989927:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481757568 00000100:00100000:3.0:1783144433.989931:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481757568 00002000:00010000:2.0:1783144433.989933:0:26147:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:2.0:1783144433.989946:0:26147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:2.0:1783144433.989950:0:26147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144433.989962:0:26147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068537a7b/0xad8e53a423049c57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fdd expref: 17 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.989976:0:26147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068537a7b/0xad8e53a423049c57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fdd expref: 17 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.989985:0:26147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287600, rc 0) 00010000:00000080:2.0:1783144433.989991:0:26147:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2addaac700 x1869759481757184/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144433.990021:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1414 00000100:00100000:2.0:1783144433.990030:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:73536:x1869759481757184:12345-192.168.203.4@tcp:101:dd.0 Request processed in 170us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.990033:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+80:73540:x1869759481757440:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:2.0:1783144433.990042:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5017 00010000:00010000:1.0:1783144433.990066:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144433.990083:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049c03 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fc1 expref: 80 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.990099:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:1.0:1783144433.990102:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144433.990201:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.990212:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.990220:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144433.990250:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084382 00000004:00010000:1.0:1783144433.990266:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000593dc82b reply state 00000000009964df transno 120259084383 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.990276:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.990282:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:1.0:1783144433.990284:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144433.990291:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144433.990388:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1415 00000100:00100000:0.0:1783144433.990395:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+82:73535:x1869759481757568:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144433.990402:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144433.990408:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049c65 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41fe4 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.990421:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a423049c6c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.990427:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a423049c6c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.990440:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a423049c6c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.990446:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+83:73540:x1869759481757440:12345-192.168.203.4@tcp:36:dd.0 Request processed in 414us (856us total) trans 120259084383 rc 0/0 00000100:00100000:1.0:1783144433.990455:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1414 00000020:00080000:1.0:1783144433.990460:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783144433.990503:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049c65 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fe4 expref: 83 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.990513:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c600/0xad8e53a423049c6c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fe4 expref: 82 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144433.990518:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:0.0:1783144433.990519:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783144433.990521:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3c600, rc 0) 00000100:00100000:0.0:1783144433.990543:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+82:73535:x1869759481757568:12345-192.168.203.4@tcp:101:dd.0 Request processed in 150us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144433.990547:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1415 00000100:00100000:0.0:1783144433.991261:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.991293:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481757824 00000100:00100000:2.0:1783144433.991299:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481757824 00000100:00100000:2.0:1783144433.991331:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1416 00000100:00100000:2.0:1783144433.991339:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+82:73541:x1869759481757824:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144433.991356:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144433.991366:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a423049c73 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41feb expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144433.991390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.991437:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481757952 00010000:00010000:2.0:1783144433.991441:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.991442:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481757952 00000100:00100000:0.0:1783144433.991449:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00002000:00010000:1.0:1783144433.991460:0:24828:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00002000:00100000:1.0:1783144433.991468:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2ae4ea5f80 with x1869759481757952 ext(0->18446744073709551615) 00010000:00010000:2.0:1783144433.991473:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144433.991476:0:24828:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2ae4ea5f80. 00000100:00100000:3.0:1783144433.991482:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481758208 00010000:00010000:2.0:1783144433.991487:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.991489:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481758208 00000100:00100000:1.0:1783144433.991504:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 759 00010000:00010000:2.0:1783144433.991509:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.991517:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:2404:x1869759481757952:12345-192.168.203.4@tcp:10:dd.0 00010000:00010000:2.0:1783144433.991521:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991531:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.991533:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 265 00000100:00100000:3.0:1783144433.991561:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+84:73552:x1869759481758208:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:2.0:1783144433.991577:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049c88 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991586:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049c88 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991594:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049c88 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144433.991602:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xe:0x0]: returning size 0 00002000:00010000:1.0:1783144433.991603:0:24828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144433.991608:0:24828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144433.991610:0:24828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144433.991613:0:24828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144433.991616:0:24828:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144433.991623:0:24828:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4ea5f80 x1869759481757952/t4294968857(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144433.991658:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:2404:x1869759481757952:12345-192.168.203.4@tcp:10:dd.0 Request processed in 145us (268us total) trans 4294968857 rc 0/0 00010000:00010000:2.0:1783144433.991662:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.991678:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 759 00010000:00010000:2.0:1783144433.991680:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144433.991683:0:24828:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00002000:00100000:1.0:1783144433.991689:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2ae4ea5f80 with x1869759481757952 ext(0->18446744073709551615) 00010000:00010000:2.0:1783144433.991693:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144433.991695:0:24828:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2ae4ea5f80. 00010000:00010000:2.0:1783144433.991707:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991714:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2acb287a00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144433.991718:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991745:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991754:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144433.991757:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144433.991761:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991767:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287a00/0xad8e53a423049c7a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991779:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991785:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991791:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991797:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2acb286800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144433.991800:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991816:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991824:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9c2ac2a42200) 00010000:00010000:2.0:1783144433.991827:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144433.991831:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991836:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286800/0xad8e53a423049c81 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144433.991850:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+86:73552:x1869759481758208:12345-192.168.203.4@tcp:35:dd.0 Request processed in 304us (399us total) trans 120259084385 rc 0/0 00000100:00100000:3.0:1783144433.991859:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 265 00010000:00010000:2.0:1783144433.991867:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287000/0xad8e53a423049c73 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41feb expref: 87 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991891:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049c88 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41feb expref: 85 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.991898:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:2.0:1783144433.991901:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144433.991903:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2acb287e00, rc 0) 00000100:00100000:2.0:1783144433.991925:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+85:73541:x1869759481757824:12345-192.168.203.4@tcp:101:dd.0 Request processed in 587us (663us total) trans 120259084384 rc 0/0 00000100:00100000:2.0:1783144433.991932:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1416 00000100:00100000:0.0:1783144433.993791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.993827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.993935:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481758464 00000100:00100000:1.0:1783144433.993940:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481758464 00000100:00100000:2.0:1783144433.993954:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481758592 00000100:00100000:2.0:1783144433.993960:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481758592 00000100:00100000:1.0:1783144433.993985:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1417 00000100:00100000:1.0:1783144433.993992:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+85:73535:x1869759481758464:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:2.0:1783144433.994005:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5018 00000100:00100000:2.0:1783144433.994015:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:73540:x1869759481758592:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144433.994018:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144433.994035:0:26149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.994036:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049c49 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fd6 expref: 85 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.994049:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:2.0:1783144433.994052:0:26149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec20c606/0xad8e53a423049c96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ff2 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.994052:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1783144433.994071:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:2.0:1783144433.994084:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:2.0:1783144433.994089:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144433.994095:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec20c606/0xad8e53a423049c96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ff2 expref: 19 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.994109:0:26149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec20c606/0xad8e53a423049c96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ff2 expref: 19 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144433.994119:0:26149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49d200, rc 0) 00010000:00000080:2.0:1783144433.994125:0:26149:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c61fdf80 x1869759481758592/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783144433.994129:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.994142:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.994148:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144433.994172:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084386 00000100:00100000:2.0:1783144433.994178:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:73540:x1869759481758592:12345-192.168.203.4@tcp:101:dd.0 Request processed in 165us (350us total) trans 0 rc 0/0 00000004:00010000:1.0:1783144433.994185:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ffcb973 reply state 0000000047191067 transno 120259084387 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144433.994186:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5018 00010000:00010000:1.0:1783144433.994196:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.994201:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:1.0:1783144433.994203:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144433.994205:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144433.994246:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+87:73535:x1869759481758464:12345-192.168.203.4@tcp:36:dd.0 Request processed in 255us (459us total) trans 120259084387 rc 0/0 00000100:00100000:1.0:1783144433.994251:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1417 00000020:00080000:1.0:1783144433.994258:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783144433.994456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144433.994533:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481758720 00000100:00100000:2.0:1783144433.994538:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481758720 00002000:00010000:2.0:1783144433.994554:0:24812:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.994558:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d05c00 with x1869759481758720 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.994564:0:24812:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d05c00. 00000100:00100000:2.0:1783144433.994588:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 760 00000100:00100000:2.0:1783144433.994595:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:2403:x1869759481758720:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:2.0:1783144433.994689:0:24812:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783144433.994693:0:24812:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.994695:0:24812:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:2.0:1783144433.994707:0:24812:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144433.994709:0:24812:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783144433.994715:0:24812:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5d05c00 x1869759481758720/t4294968858(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144433.994761:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:2403:x1869759481758720:12345-192.168.203.4@tcp:10:dd.0 Request processed in 167us (306us total) trans 4294968858 rc 0/0 00000100:00100000:2.0:1783144433.994768:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 760 00002000:00010000:2.0:1783144433.994771:0:24812:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:2.0:1783144433.994774:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d05c00 with x1869759481758720 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144433.994778:0:24812:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d05c00. 00000100:00100000:3.0:1783144433.996073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.996105:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481758976 00000100:00100000:1.0:1783144433.996110:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481758976 00000100:00100000:1.0:1783144433.996138:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:1.0:1783144433.996143:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3676050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+87:73539:x1869759481758976:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:1.0:1783144433.996352:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3676050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+88:73539:x1869759481758976:12345-192.168.203.4@tcp:35:dd.0 Request processed in 197us (272us total) trans 120259084388 rc 0/0 00000100:00100000:1.0:1783144433.996359:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 266 00000100:00100000:0.0:1783144433.996717:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144433.996764:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144433.996814:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481759232 00000100:00100000:1.0:1783144433.996817:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481759232 00000100:00100000:1.0:1783144433.996845:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5019 00000100:00100000:1.0:1783144433.996852:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:73535:x1869759481759232:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144433.996861:0:16470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.996874:0:16470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c22b72ba/0xad8e53a423049ca4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c41ff9 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144433.996891:0:16470:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:1.0:1783144433.996903:0:16470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:1.0:1783144433.996907:0:16470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144433.996914:0:16470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22b72ba/0xad8e53a423049ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ff9 expref: 21 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.996928:0:16470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c22b72ba/0xad8e53a423049ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ff9 expref: 21 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.996939:0:16470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1a00, rc 0) 00000100:00100000:3.0:1783144433.996944:0:24826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481759104 00000100:00100000:3.0:1783144433.996950:0:24826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481759104 00010000:00000080:1.0:1783144433.996955:0:16470:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e89500 x1869759481759232/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 328/400 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:3.0:1783144433.996967:0:24826:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00002000:00100000:3.0:1783144433.996971:0:24826:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e89f80 with x1869759481759104 ext(0->18446744073709551615) 00002000:00010000:3.0:1783144433.996978:0:24826:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e89f80. 00000100:00100000:3.0:1783144433.996999:0:24826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 761 00000100:00100000:3.0:1783144433.997006:0:24826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2406:x1869759481759104:12345-192.168.203.4@tcp:10:dd.0 00000100:00100000:1.0:1783144433.997018:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:73535:x1869759481759232:12345-192.168.203.4@tcp:101:dd.0 Request processed in 165us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144433.997023:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5019 00000100:00100000:2.0:1783144433.997081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00002000:00010000:3.0:1783144433.997091:0:24826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783144433.997095:0:24826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144433.997098:0:24826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:3.0:1783144433.997101:0:24826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144433.997103:0:24826:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783144433.997112:0:24826:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e89f80 x1869759481759104/t4294968859(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:544/0 lens 440/432 e 0 to 0 dl 1783144444 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144433.997123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144433.997148:0:24826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2406:x1869759481759104:12345-192.168.203.4@tcp:10:dd.0 Request processed in 141us (382us total) trans 4294968859 rc 0/0 00000100:00100000:3.0:1783144433.997156:0:24826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 761 00002000:00010000:3.0:1783144433.997160:0:24826:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00000100:00100000:1.0:1783144433.997160:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481759360 00002000:00100000:3.0:1783144433.997165:0:24826:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e89f80 with x1869759481759104 ext(0->18446744073709551615) 00000100:00100000:1.0:1783144433.997166:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481759360 00002000:00010000:3.0:1783144433.997174:0:24826:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e89f80. 00000100:00100000:1.0:1783144433.997194:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481759616 00000100:00100000:1.0:1783144433.997197:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481759616 00000100:00100000:3.0:1783144433.997209:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1418 00000100:00100000:3.0:1783144433.997220:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+89:73541:x1869759481759360:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:1.0:1783144433.997229:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1419 00010000:00010000:3.0:1783144433.997233:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783144433.997240:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+89:73542:x1869759481759616:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144433.997245:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049cab lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42000 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997248:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144433.997260:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0000/0xad8e53a423049cb2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42007 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997352:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997364:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997372:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997389:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997397:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997415:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997445:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049cc7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997450:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049cc7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997464:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049cc7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144433.997470:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xf:0x0]: returning size 0 00010000:00010000:1.0:1783144433.997501:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997506:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997510:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997514:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144433.997517:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997521:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997527:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144433.997529:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144433.997536:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997540:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049cb9 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997555:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997559:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997563:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997565:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144433.997567:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997570:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997574:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9c29c476e800) 00010000:00010000:1.0:1783144433.997576:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144433.997577:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997580:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049cc0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997601:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0000/0xad8e53a423049cb2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42007 expref: 93 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997616:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049cc7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42007 expref: 92 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144433.997620:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:1.0:1783144433.997622:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144433.997623:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1e00, rc 0) 00000100:00100000:1.0:1783144433.997646:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c6158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+92:73542:x1869759481759616:12345-192.168.203.4@tcp:101:dd.0 Request processed in 409us (524us total) trans 120259084389 rc 0/0 00000100:00100000:1.0:1783144433.997652:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1419 00000100:00100000:2.0:1783144433.998632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1783144433.998657:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049cd5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.998664:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481759872 00000100:00100000:1.0:1783144433.998669:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481759872 00010000:00010000:3.0:1783144433.998670:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049cd5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.998681:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049cd5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144433.998697:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00100000:1.0:1783144433.998706:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+92:73536:x1869759481759872:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:3.0:1783144433.998772:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049cab lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42000 expref: 93 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.998787:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8600/0xad8e53a423049cd5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42000 expref: 92 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144433.998794:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:3.0:1783144433.998797:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144433.998800:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8600, rc 0) 00000100:00100000:3.0:1783144433.998842:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+93:73541:x1869759481759360:12345-192.168.203.4@tcp:101:dd.0 Request processed in 1624us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144433.998849:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1418 00000100:00100000:1.0:1783144433.998882:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+92:73536:x1869759481759872:12345-192.168.203.4@tcp:35:dd.0 Request processed in 176us (253us total) trans 120259084390 rc 0/0 00000100:00100000:1.0:1783144433.998897:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 267 00000100:00100000:2.0:1783144434.000569:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.001038:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481760000 00000100:00100000:1.0:1783144434.001044:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481760000 00002000:00010000:1.0:1783144434.001065:0:24813:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.001069:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca2ba300 with x1869759481760000 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.001076:0:24813:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca2ba300. 00000100:00100000:1.0:1783144434.001103:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 762 00000100:00100000:1.0:1783144434.001110:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2403:x1869759481760000:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:1.0:1783144434.001208:0:24813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144434.001220:0:24813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.001222:0:24813:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144434.001224:0:24813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.001227:0:24813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144434.001235:0:24813:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca2ba300 x1869759481760000/t4294968860(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.001284:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:2403:x1869759481760000:12345-192.168.203.4@tcp:10:dd.0 Request processed in 173us (717us total) trans 4294968860 rc 0/0 00000100:00100000:1.0:1783144434.001292:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 762 00002000:00010000:1.0:1783144434.001296:0:24813:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.001300:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca2ba300 with x1869759481760000 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.001304:0:24813:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca2ba300. 00000100:00100000:0.0:1783144434.001598:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.001649:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481760256 00000100:00100000:1.0:1783144434.001654:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481760256 00000100:00100000:1.0:1783144434.001690:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1420 00000100:00100000:1.0:1783144434.001707:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+92:73541:x1869759481760256:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:1.0:1783144434.001752:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.001780:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb287e00/0xad8e53a423049c88 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41feb expref: 92 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.001793:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:1.0:1783144434.001798:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144434.001907:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.001919:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.001943:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144434.001982:0:66143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084391 00000004:00010000:1.0:1783144434.002002:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6bfdd80 reply state 00000000465af483 transno 120259084392 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.002015:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.002022:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:1.0:1783144434.002024:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144434.002027:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144434.002078:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af563ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+94:73541:x1869759481760256:12345-192.168.203.4@tcp:36:dd.0 Request processed in 380us (480us total) trans 120259084392 rc 0/0 00000100:00100000:1.0:1783144434.002085:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1420 00000020:00080000:1.0:1783144434.002089:0:66143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783144434.003598:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.003644:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481760512 00000100:00100000:3.0:1783144434.003651:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481760512 00000100:00100000:0.0:1783144434.003687:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.003702:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 268 00000100:00100000:3.0:1783144434.003714:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+94:73540:x1869759481760512:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:0.0:1783144434.003742:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.003766:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481760640 00000100:00100000:1.0:1783144434.003775:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481760896 00000100:00100000:0.0:1783144434.003778:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481760640 00000100:00100000:1.0:1783144434.003782:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481760896 00000100:00100000:0.0:1783144434.003813:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1421 00000100:00100000:1.0:1783144434.003820:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1422 00000100:00100000:0.0:1783144434.003826:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+96:73542:x1869759481760640:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:1.0:1783144434.003834:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+96:73543:x1869759481760896:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.003952:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.003965:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049ce3 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4200e expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.003988:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a423049cea lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.003998:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a423049cea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.004006:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a423049cea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.004070:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049ce3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4200e expref: 99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.004085:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c400/0xad8e53a423049cea lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4200e expref: 98 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.004093:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:0.0:1783144434.004095:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783144434.004098:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3c400, rc 0) 00000100:00100000:0.0:1783144434.004148:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+98:73542:x1869759481760640:12345-192.168.203.4@tcp:101:dd.0 Request processed in 328us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.004157:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1421 00000100:00100000:3.0:1783144434.004202:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+97:73540:x1869759481760512:12345-192.168.203.4@tcp:35:dd.0 Request processed in 490us (605us total) trans 120259084393 rc 0/0 00000100:00100000:3.0:1783144434.004225:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 268 00000100:00100000:2.0:1783144434.004287:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.004633:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481761024 00000100:00100000:3.0:1783144434.004638:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481761024 00000100:00100000:2.0:1783144434.004710:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.005390:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5020 00000100:00100000:3.0:1783144434.005399:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:73541:x1869759481761024:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144434.005410:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144434.005424:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423049cf1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4201c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144434.005442:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:3.0:1783144434.005455:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=2968s v=(0 0) 00000100:00100000:0.0:1783144434.005458:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481761280 00010000:00010000:3.0:1783144434.005461:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144434.005469:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423049cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4201c expref: 24 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144434.005470:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481761280 00010000:00010000:3.0:1783144434.005486:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423049cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4201c expref: 24 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.005497:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8e00, rc 0) 00010000:00000080:3.0:1783144434.005503:0:8438:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca2ba680 x1869759481761024/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.005539:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+24:73541:x1869759481761024:12345-192.168.203.4@tcp:101:dd.0 Request processed in 141us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.005543:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 269 00000100:00100000:3.0:1783144434.005553:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5020 00000100:00100000:0.0:1783144434.005558:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+97:73535:x1869759481761280:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:0.0:1783144434.005783:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+98:73535:x1869759481761280:12345-192.168.203.4@tcp:35:dd.0 Request processed in 229us (1072us total) trans 120259084394 rc 0/0 00000100:00100000:0.0:1783144434.005790:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 269 00010000:00010000:1.0:1783144434.006391:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.006405:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049cf8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42015 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006509:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006522:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006535:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006549:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006556:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006562:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006607:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049d0d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006616:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049d0d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006624:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049d0d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144434.006633:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x10:0x0]: returning size 0 00010000:00010000:1.0:1783144434.006681:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006689:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006695:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006702:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006714:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144434.006718:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006741:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006753:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144434.006756:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144434.006760:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006766:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049cff lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006777:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006782:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006787:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006793:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144434.006796:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006802:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006820:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9c29c476ea00) 00010000:00010000:1.0:1783144434.006823:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144434.006826:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006833:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049d06 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006867:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1200/0xad8e53a423049cf8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42015 expref: 100 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006880:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049d0d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42015 expref: 99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.006887:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:1.0:1783144434.006890:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144434.006893:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0200, rc 0) 00000100:00100000:1.0:1783144434.006924:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c50e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+99:73543:x1869759481760896:12345-192.168.203.4@tcp:101:dd.0 Request processed in 3093us (3182us total) trans 120259084395 rc 0/0 00000100:00100000:1.0:1783144434.006933:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1422 00000100:00100000:2.0:1783144434.007062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.007677:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481761536 00000100:00100000:1.0:1783144434.007682:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481761536 00000100:00100000:1.0:1783144434.007713:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1423 00000100:00100000:1.0:1783144434.007718:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+99:73542:x1869759481761536:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:1.0:1783144434.007762:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.007774:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049cc7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42007 expref: 99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.007793:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:1.0:1783144434.007795:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144434.007907:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.007914:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.007919:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144434.007945:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084396 00000004:00010000:1.0:1783144434.007957:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000adb89078 reply state 000000005d970dcd transno 120259084397 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.007964:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.007968:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:1.0:1783144434.007970:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144434.007971:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144434.008015:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+101:73542:x1869759481761536:12345-192.168.203.4@tcp:36:dd.0 Request processed in 295us (953us total) trans 120259084397 rc 0/0 00000100:00100000:1.0:1783144434.008022:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1423 00000020:00080000:1.0:1783144434.008025:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783144434.008337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.008484:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481761664 00000100:00100000:1.0:1783144434.008489:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481761664 00002000:00010000:1.0:1783144434.008507:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.008511:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d05180 with x1869759481761664 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.008525:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d05180. 00000100:00100000:1.0:1783144434.008551:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 763 00000100:00100000:1.0:1783144434.008560:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+24:2404:x1869759481761664:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:1.0:1783144434.008645:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144434.008649:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.008652:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144434.008654:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.008657:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144434.008663:0:8443:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5d05180 x1869759481761664/t4294968861(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.009065:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2404:x1869759481761664:12345-192.168.203.4@tcp:10:dd.0 Request processed in 505us (734us total) trans 4294968861 rc 0/0 00000100:00100000:1.0:1783144434.009073:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 763 00002000:00010000:1.0:1783144434.009077:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.009148:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d05180 with x1869759481761664 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.009154:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d05180. 00000100:00100000:0.0:1783144434.009333:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.009423:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481761920 00000100:00100000:0.0:1783144434.009423:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.009427:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481761920 00000100:00100000:1.0:1783144434.009447:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481762048 00000100:00100000:1.0:1783144434.009450:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481762048 00000100:00100000:0.0:1783144434.009452:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1424 00000100:00100000:0.0:1783144434.009459:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+102:73544:x1869759481761920:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:1.0:1783144434.009468:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1425 00010000:00010000:0.0:1783144434.009471:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783144434.009473:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+102:73543:x1869759481762048:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.009479:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.009480:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049d22 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42023 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009486:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049d29 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4202a expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009514:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049d30 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009523:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049d30 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009531:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049d30 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009561:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144434.009562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1783144434.009574:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009583:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.009590:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481762176 00000100:00100000:1.0:1783144434.009594:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481762176 00010000:00010000:0.0:1783144434.009595:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009601:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009619:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.009623:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5021 00000100:00100000:1.0:1783144434.009629:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:73542:x1869759481762176:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.009635:0:26145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.009645:0:26145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423049d45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42031 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009656:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049d4c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144434.009658:0:26145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:0.0:1783144434.009664:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049d4c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009668:0:26145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:0.0:1783144434.009670:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049d4c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009672:0:26145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144434.009678:0:26145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423049d45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42031 expref: 26 pid: 26145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144434.009683:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x11:0x0]: returning size 0 00010000:00010000:1.0:1783144434.009689:0:26145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423049d45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42031 expref: 26 pid: 26145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009710:0:26145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00a00, rc 0) 00010000:00000080:1.0:1783144434.009716:0:26145:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aeea40380 x1869759481762176/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1783144434.009746:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009753:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009759:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009765:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3ca00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144434.009768:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009774:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009783:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144434.009786:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144434.009787:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:73542:x1869759481762176:12345-192.168.203.4@tcp:101:dd.0 Request processed in 158us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.009793:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5021 00010000:00010000:0.0:1783144434.009795:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009802:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049d37 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009813:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009820:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009825:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009830:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144434.009833:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009835:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049d29 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4202a expref: 106 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009840:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009846:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00800/0xad8e53a423049d30 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4202a expref: 105 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009847:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9c2af9e77000) 00010000:00010000:0.0:1783144434.009850:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144434.009852:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.009853:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:1.0:1783144434.009855:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783144434.009858:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00800, rc 0) 00010000:00010000:0.0:1783144434.009858:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049d3e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009884:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049d22 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42023 expref: 106 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.009885:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+106:73543:x1869759481762048:12345-192.168.203.4@tcp:101:dd.0 Request processed in 411us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.009891:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1425 00010000:00010000:0.0:1783144434.009906:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049d4c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42023 expref: 104 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.009913:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:0.0:1783144434.009915:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144434.009917:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d400, rc 0) 00000100:00100000:0.0:1783144434.009939:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+104:73544:x1869759481761920:12345-192.168.203.4@tcp:101:dd.0 Request processed in 480us (607us total) trans 120259084398 rc 0/0 00000100:00100000:0.0:1783144434.009945:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1424 00000100:00100000:3.0:1783144434.011638:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.011776:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481762304 00000100:00100000:1.0:1783144434.011782:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481762304 00002000:00010000:1.0:1783144434.011803:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.011806:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e8ce00 with x1869759481762304 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.011811:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e8ce00. 00000100:00100000:1.0:1783144434.011831:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 764 00000100:00100000:1.0:1783144434.011837:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2404:x1869759481762304:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:1.0:1783144434.011928:0:24810:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144434.011931:0:24810:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.011933:0:24810:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144434.011935:0:24810:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.011937:0:24810:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144434.011944:0:24810:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e8ce00 x1869759481762304/t4294968862(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.011985:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2404:x1869759481762304:12345-192.168.203.4@tcp:10:dd.0 Request processed in 146us (348us total) trans 4294968862 rc 0/0 00000100:00100000:1.0:1783144434.011993:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 764 00002000:00010000:1.0:1783144434.011997:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.012000:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e8ce00 with x1869759481762304 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.012005:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e8ce00. 00000100:00100000:2.0:1783144434.012666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.012764:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481762432 00000100:00100000:0.0:1783144434.012770:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481762432 00000100:00100000:0.0:1783144434.012802:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1426 00000100:00100000:0.0:1783144434.012810:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+104:73544:x1869759481762432:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.012824:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783144434.012830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1783144434.012838:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049d5a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42038 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.012860:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423049d61 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.012869:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423049d61 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.012876:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423049d61 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.012931:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049d5a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42038 expref: 106 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.012946:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d000/0xad8e53a423049d61 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42038 expref: 105 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144434.012948:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481762688 00000100:00100000:3.0:1783144434.012954:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481762688 00010000:00010000:0.0:1783144434.012955:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:0.0:1783144434.012959:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783144434.012961:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3d000, rc 0) 00000100:00100000:0.0:1783144434.012988:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+106:73544:x1869759481762432:12345-192.168.203.4@tcp:101:dd.0 Request processed in 179us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.012996:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1426 00000100:00100000:3.0:1783144434.013036:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1427 00000100:00100000:3.0:1783144434.013045:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+105:73545:x1869759481762688:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144434.013054:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144434.013064:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049d68 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4203f expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013181:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013192:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013200:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013213:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013221:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013227:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013269:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049d7d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013278:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049d7d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013617:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049d7d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144434.013627:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x12:0x0]: returning size 0 00010000:00010000:3.0:1783144434.013679:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013686:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013693:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013700:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013706:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144434.013709:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013716:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.013744:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144434.013747:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144434.014393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.014428:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481762944 00000100:00100000:1.0:1783144434.014434:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481762944 00000100:00100000:1.0:1783144434.014475:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 270 00000100:00100000:1.0:1783144434.014484:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+108:73541:x1869759481762944:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:2.0:1783144434.014519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1783144434.014592:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.014603:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049d6f lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144434.014614:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481763200 00000100:00100000:0.0:1783144434.014619:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481763200 00000100:00100000:0.0:1783144434.014652:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1428 00000100:00100000:1.0:1783144434.014655:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+110:73541:x1869759481762944:12345-192.168.203.4@tcp:35:dd.0 Request processed in 173us (264us total) trans 120259084400 rc 0/0 00000100:00100000:0.0:1783144434.014660:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+110:73543:x1869759481763200:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:1.0:1783144434.014662:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 270 00010000:00010000:0.0:1783144434.014683:0:66112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144434.014698:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049d0d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42015 expref: 109 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.014709:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:0.0:1783144434.014713:0:66112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144434.014807:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.014819:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.014827:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144434.014868:0:66112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084401 00000004:00010000:0.0:1783144434.014886:0:66112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045a4a01f reply state 0000000047b094b6 transno 120259084402 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.014894:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.014899:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:3.0:1783144434.014900:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.014901:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144434.014903:0:66112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783144434.014917:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.014925:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.014930:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144434.014934:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.014941:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.014956:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9c2ac676c800) 00010000:00010000:3.0:1783144434.014959:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144434.014962:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.014968:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049d76 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.015000:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9800/0xad8e53a423049d68 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4203f expref: 112 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.015013:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049d7d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4203f expref: 111 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.015020:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:3.0:1783144434.015022:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144434.015032:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9a00, rc 0) 00000100:00100000:0.0:1783144434.015257:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+111:73543:x1869759481763200:12345-192.168.203.4@tcp:36:dd.0 Request processed in 597us (737us total) trans 120259084402 rc 0/0 00000100:00100000:0.0:1783144434.015263:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1428 00000020:00080000:0.0:1783144434.015267:0:66112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783144434.015365:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+110:73545:x1869759481762688:12345-192.168.203.4@tcp:101:dd.0 Request processed in 2320us (2534us total) trans 120259084399 rc 0/0 00000100:00100000:3.0:1783144434.015377:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1427 00000100:00100000:2.0:1783144434.015540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.015582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.015620:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481763712 00000100:00100000:0.0:1783144434.015626:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481763712 00000100:00100000:1.0:1783144434.015627:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481763456 00000100:00100000:1.0:1783144434.015630:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481763456 00000100:00100000:1.0:1783144434.015653:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1429 00000100:00100000:0.0:1783144434.015654:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 271 00000100:00100000:1.0:1783144434.015663:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+111:73544:x1869759481763456:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:0.0:1783144434.015663:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+111:73542:x1869759481763712:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:1.0:1783144434.015682:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.015699:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049d4c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42023 expref: 111 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.015711:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:1.0:1783144434.015714:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144434.015798:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+111:73542:x1869759481763712:12345-192.168.203.4@tcp:35:dd.0 Request processed in 136us (215us total) trans 120259084403 rc 0/0 00000100:00100000:0.0:1783144434.015806:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 271 00010000:00010000:1.0:1783144434.015857:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.015867:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.015875:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144434.015904:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084404 00000004:00010000:1.0:1783144434.015926:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7ce9277 reply state 0000000033ac9f50 transno 120259084405 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.015937:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.015944:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:1.0:1783144434.015946:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144434.015948:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144434.015995:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c60b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+113:73544:x1869759481763456:12345-192.168.203.4@tcp:36:dd.0 Request processed in 334us (455us total) trans 120259084405 rc 0/0 00000100:00100000:1.0:1783144434.016002:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1429 00000020:00080000:1.0:1783144434.016007:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783144434.016842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.017049:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481763840 00000100:00100000:1.0:1783144434.017054:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481763840 00000100:00100000:1.0:1783144434.017085:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5022 00000100:00100000:1.0:1783144434.017094:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:73543:x1869759481763840:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.017110:0:26152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.017124:0:26152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce9a850/0xad8e53a423049d99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42046 expref: -99 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144434.017141:0:26152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:1.0:1783144434.017153:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:1.0:1783144434.017157:0:26152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144434.017164:0:26152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce9a850/0xad8e53a423049d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42046 expref: 28 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.017177:0:26152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ce9a850/0xad8e53a423049d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42046 expref: 28 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.017187:0:26152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0000, rc 0) 00010000:00000080:1.0:1783144434.017193:0:26152:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08dc00 x1869759481763840/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.017234:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:73543:x1869759481763840:12345-192.168.203.4@tcp:101:dd.0 Request processed in 140us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.017241:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5022 00000100:00100000:3.0:1783144434.017517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.017552:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.017603:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481763968 00000100:00100000:0.0:1783144434.017616:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481763968 00000100:00100000:0.0:1783144434.017644:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481764224 00000100:00100000:0.0:1783144434.017648:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481764224 00000100:00100000:0.0:1783144434.017668:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1430 00000100:00100000:0.0:1783144434.017675:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+114:73545:x1869759481763968:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.017696:0:66114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.017705:0:66114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049da0 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4204d expref: -99 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.017752:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049da7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.017765:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049da7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.017775:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049da7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.017793:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1431 00000100:00100000:1.0:1783144434.017803:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+115:73546:x1869759481764224:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.017812:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.017822:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049dae lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42054 expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.017851:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049da0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4204d expref: 117 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.017867:0:66114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ce00/0xad8e53a423049da7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4204d expref: 116 pid: 66114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.017875:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:0.0:1783144434.017878:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783144434.017881:0:66114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3ce00, rc 0) 00010000:00010000:1.0:1783144434.017908:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144434.017911:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+116:73545:x1869759481763968:12345-192.168.203.4@tcp:101:dd.0 Request processed in 235us (395us total) trans 0 rc 0/0 00010000:00010000:1.0:1783144434.017923:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144434.017930:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1430 00010000:00010000:1.0:1783144434.017939:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.017953:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.017961:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.017968:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018004:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049dc3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018012:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049dc3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018020:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049dc3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783144434.018028:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x13:0x0]: returning size 0 00010000:00010000:1.0:1783144434.018075:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018082:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018094:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018100:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018106:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144434.018110:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018117:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018126:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:1.0:1783144434.018129:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144434.018132:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018138:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049db5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018170:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018177:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018189:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018194:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:1.0:1783144434.018203:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018210:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018221:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9c29c476e700) 00010000:00010000:1.0:1783144434.018224:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783144434.018226:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018232:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049dbc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018264:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049dae lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42054 expref: 117 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144434.018285:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1783144434.018291:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049dc3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42054 expref: 116 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018299:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:1.0:1783144434.018302:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783144434.018304:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0e00, rc 0) 00000100:00100000:1.0:1783144434.018349:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+116:73546:x1869759481764224:12345-192.168.203.4@tcp:101:dd.0 Request processed in 539us (787us total) trans 120259084406 rc 0/0 00000100:00100000:1.0:1783144434.018357:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1431 00000100:00100000:3.0:1783144434.018419:0:26146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481764352 00000100:00100000:3.0:1783144434.018424:0:26146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481764352 00000100:00100000:1.0:1783144434.018554:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5023 00000100:00100000:1.0:1783144434.018566:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:73544:x1869759481764352:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.018575:0:26139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.018592:0:26139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ec78296/0xad8e53a423049dd1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4205b expref: -99 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144434.018600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00002000:00010000:1.0:1783144434.018615:0:26139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:1.0:1783144434.018627:0:26139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:1.0:1783144434.018631:0:26139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144434.018696:0:26139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ec78296/0xad8e53a423049dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4205b expref: 29 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018711:0:26139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ec78296/0xad8e53a423049dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4205b expref: 29 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.018747:0:26139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1200, rc 0) 00010000:00000080:1.0:1783144434.018754:0:26139:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08ca80 x1869759481764352/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.018784:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:73544:x1869759481764352:12345-192.168.203.4@tcp:101:dd.0 Request processed in 222us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.018792:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5023 00000100:00100000:3.0:1783144434.018824:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481764480 00000100:00100000:3.0:1783144434.018829:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481764480 00002000:00010000:3.0:1783144434.018847:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00002000:00100000:3.0:1783144434.018851:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08d180 with x1869759481764480 ext(0->18446744073709551615) 00002000:00010000:3.0:1783144434.018910:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08d180. 00000100:00100000:3.0:1783144434.019064:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 765 00000100:00100000:3.0:1783144434.019072:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2403:x1869759481764480:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:3.0:1783144434.019154:0:24830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783144434.019158:0:24830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144434.019160:0:24830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:3.0:1783144434.019163:0:24830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144434.019165:0:24830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783144434.019171:0:24830:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08d180 x1869759481764480/t4294968863(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.019202:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2403:x1869759481764480:12345-192.168.203.4@tcp:10:dd.0 Request processed in 131us (608us total) trans 4294968863 rc 0/0 00000100:00100000:3.0:1783144434.019209:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 765 00002000:00010000:3.0:1783144434.019212:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00002000:00100000:3.0:1783144434.019215:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08d180 with x1869759481764480 ext(0->18446744073709551615) 00002000:00010000:3.0:1783144434.019226:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08d180. 00000100:00100000:2.0:1783144434.019463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.019556:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481764736 00000100:00100000:0.0:1783144434.019560:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481764736 00000100:00100000:0.0:1783144434.019596:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1432 00000100:00100000:0.0:1783144434.019603:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+116:73545:x1869759481764736:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1783144434.019644:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144434.019658:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049d7d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4203f expref: 116 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.019670:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:0.0:1783144434.019673:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783144434.019783:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.019793:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.019801:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144434.019831:0:66143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084407 00000004:00010000:0.0:1783144434.019848:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009ee693f reply state 00000000d8ba1c1c transno 120259084408 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.019857:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.019863:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:0.0:1783144434.019865:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144434.019868:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144434.019908:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+118:73545:x1869759481764736:12345-192.168.203.4@tcp:36:dd.0 Request processed in 305us (445us total) trans 120259084408 rc 0/0 00000100:00100000:0.0:1783144434.019915:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1432 00000020:00080000:0.0:1783144434.019918:0:66143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783144434.021440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.021514:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481764864 00000100:00100000:2.0:1783144434.021520:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481764864 00002000:00010000:2.0:1783144434.021542:0:24812:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00002000:00100000:2.0:1783144434.021546:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2ae4b37480 with x1869759481764864 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144434.021553:0:24812:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2ae4b37480. 00000100:00100000:2.0:1783144434.021604:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 766 00000100:00100000:2.0:1783144434.021619:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2404:x1869759481764864:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:2.0:1783144434.021708:0:24812:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783144434.021712:0:24812:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144434.021714:0:24812:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:2.0:1783144434.021716:0:24812:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:2.0:1783144434.021718:0:24812:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783144434.021753:0:24812:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ae4b37480 x1869759481764864/t4294968864(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.021792:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2404:x1869759481764864:12345-192.168.203.4@tcp:10:dd.0 Request processed in 174us (355us total) trans 4294968864 rc 0/0 00000100:00100000:2.0:1783144434.021808:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 766 00002000:00010000:2.0:1783144434.021811:0:24812:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00002000:00100000:2.0:1783144434.021814:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2ae4b37480 with x1869759481764864 ext(0->18446744073709551615) 00002000:00010000:2.0:1783144434.021818:0:24812:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2ae4b37480. 00000100:00100000:0.0:1783144434.025573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.025671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.025709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.025849:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481765248 00000100:00100000:2.0:1783144434.025857:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481765248 00000100:00100000:2.0:1783144434.025907:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481765504 00000100:00100000:2.0:1783144434.025910:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481765504 00000100:00100000:2.0:1783144434.025941:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1433 00000100:00100000:2.0:1783144434.025951:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+119:73546:x1869759481765248:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144434.025968:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144434.025985:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a423049ddf lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42062 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026013:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049de6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026025:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049de6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026037:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049de6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026134:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a423049ddf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42062 expref: 121 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026154:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ce00/0xad8e53a423049de6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42062 expref: 120 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026163:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:2.0:1783144434.026166:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783144434.026170:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49ce00, rc 0) 00000100:00100000:2.0:1783144434.026214:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+120:73546:x1869759481765248:12345-192.168.203.4@tcp:101:dd.0 Request processed in 265us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.026222:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1433 00000100:00100000:2.0:1783144434.026252:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1434 00000100:00100000:2.0:1783144434.026259:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+119:73548:x1869759481765504:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144434.026268:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144434.026278:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a423049ded lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42069 expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.026282:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481765120 00000100:00100000:1.0:1783144434.026288:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481765120 00000100:00100000:1.0:1783144434.026325:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 272 00000100:00100000:1.0:1783144434.026333:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3676850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+121:73543:x1869759481765120:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:2.0:1783144434.026391:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026405:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026414:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026429:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026436:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026443:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026483:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049e02 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026490:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049e02 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026498:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049e02 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144434.026517:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x15:0x0]: returning size 0 00000100:00100000:0.0:1783144434.026525:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.026543:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3676850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+122:73543:x1869759481765120:12345-192.168.203.4@tcp:35:dd.0 Request processed in 210us (975us total) trans 120259084409 rc 0/0 00000100:00100000:1.0:1783144434.026563:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 272 00010000:00010000:2.0:1783144434.026566:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144434.026569:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481765632 00000100:00100000:3.0:1783144434.026575:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481765632 00010000:00010000:2.0:1783144434.026579:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026587:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144434.026597:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:2.0:1783144434.026598:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49c200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144434.026603:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026611:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.026612:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481765888 00000100:00100000:1.0:1783144434.026624:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481765888 00000100:00100000:3.0:1783144434.026628:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5024 00010000:00010000:2.0:1783144434.026632:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144434.026637:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144434.026643:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:73545:x1869759481765632:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144434.026643:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026656:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049df4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.026657:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144434.026671:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.026673:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423049e10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42070 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.026678:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 273 00010000:00010000:2.0:1783144434.026684:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.026695:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+123:73544:x1869759481765888:12345-192.168.203.4@tcp:35:dd.0 00002000:00010000:3.0:1783144434.026706:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:2.0:1783144434.026710:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026717:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49cc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144434.026746:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:2.0:1783144434.026748:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.026753:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144434.026760:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.026775:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423049e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42070 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026777:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9c2ac2a42200) 00010000:00010000:2.0:1783144434.026784:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144434.026789:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026797:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049dfb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.026804:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423049e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42070 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.026818:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9800, rc 0) 00010000:00000080:3.0:1783144434.026825:0:8437:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d6680 x1869759481765632/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1783144434.026835:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a423049ded lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42069 expref: 125 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026850:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049e02 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42069 expref: 124 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.026858:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:2.0:1783144434.026861:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144434.026863:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49c000, rc 0) 00000100:00100000:3.0:1783144434.026868:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:73545:x1869759481765632:12345-192.168.203.4@tcp:101:dd.0 Request processed in 229us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.026876:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5024 00000100:00100000:2.0:1783144434.026947:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+124:73548:x1869759481765504:12345-192.168.203.4@tcp:101:dd.0 Request processed in 688us (1236us total) trans 120259084410 rc 0/0 00000100:00100000:1.0:1783144434.026955:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+124:73544:x1869759481765888:12345-192.168.203.4@tcp:35:dd.0 Request processed in 259us (355us total) trans 120259084411 rc 0/0 00000100:00100000:1.0:1783144434.026972:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 273 00000100:00100000:2.0:1783144434.026973:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1434 00000100:00100000:0.0:1783144434.029244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.029283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.029324:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481766272 00000100:00100000:3.0:1783144434.029331:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481766272 00000100:00100000:1.0:1783144434.029349:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481766144 00000100:00100000:1.0:1783144434.029355:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481766144 00002000:00010000:3.0:1783144434.029374:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00002000:00100000:3.0:1783144434.029379:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d4e00 with x1869759481766272 ext(0->18446744073709551615) 00002000:00010000:3.0:1783144434.029388:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d4e00. 00000100:00100000:3.0:1783144434.029414:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 767 00000100:00100000:3.0:1783144434.029424:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:2406:x1869759481766272:12345-192.168.203.4@tcp:10:dd.0 00000100:00100000:1.0:1783144434.029431:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1435 00000100:00100000:1.0:1783144434.029442:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+123:73546:x1869759481766144:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:1.0:1783144434.029484:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.029505:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049dc3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42054 expref: 123 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.029521:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:1.0:1783144434.029526:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1783144434.029527:0:24814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783144434.029532:0:24814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144434.029535:0:24814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:3.0:1783144434.029537:0:24814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144434.029539:0:24814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783144434.029547:0:24814:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d4e00 x1869759481766272/t4294968865(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.029592:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:2406:x1869759481766272:12345-192.168.203.4@tcp:10:dd.0 Request processed in 170us (308us total) trans 4294968865 rc 0/0 00000100:00100000:3.0:1783144434.029600:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 767 00002000:00010000:3.0:1783144434.029603:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00002000:00100000:3.0:1783144434.029606:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d4e00 with x1869759481766272 ext(0->18446744073709551615) 00002000:00010000:3.0:1783144434.029611:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d4e00. 00010000:00010000:1.0:1783144434.029640:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.029653:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.029674:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144434.029711:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084412 00000004:00010000:1.0:1783144434.029792:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005425387b reply state 000000003e9068a3 transno 120259084413 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.029816:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.029824:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:1.0:1783144434.029826:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144434.029829:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144434.029892:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+125:73546:x1869759481766144:12345-192.168.203.4@tcp:36:dd.0 Request processed in 452us (652us total) trans 120259084413 rc 0/0 00000100:00100000:1.0:1783144434.029899:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1435 00000020:00080000:1.0:1783144434.029903:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783144434.029977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.030471:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481766400 00000100:00100000:1.0:1783144434.030477:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481766400 00000100:00100000:1.0:1783144434.030508:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1436 00000100:00100000:1.0:1783144434.030518:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+125:73548:x1869759481766400:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.030529:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.030539:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049e1e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42077 expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.030561:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049e25 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.030569:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049e25 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.030578:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049e25 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.030648:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049e1e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42077 expref: 127 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.030748:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1e00/0xad8e53a423049e25 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42077 expref: 126 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.030753:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:1.0:1783144434.030755:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783144434.030757:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe1e00, rc 0) 00000100:00100000:1.0:1783144434.030779:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+126:73548:x1869759481766400:12345-192.168.203.4@tcp:101:dd.0 Request processed in 264us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.030785:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1436 00000100:00100000:2.0:1783144434.030864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.030928:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481766656 00000100:00100000:3.0:1783144434.030932:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481766656 00000100:00100000:3.0:1783144434.030965:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1437 00000100:00100000:3.0:1783144434.030973:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+126:73547:x1869759481766656:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144434.030981:0:81077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144434.030991:0:81077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049e2c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4207e expref: -99 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031097:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031104:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031112:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031123:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031130:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031137:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031173:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049e41 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031225:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049e41 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031230:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049e41 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783144434.031236:0:81077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x14:0x0]: returning size 0 00010000:00010000:3.0:1783144434.031367:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031385:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031392:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031398:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144434.031402:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031410:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031419:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:3.0:1783144434.031421:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144434.031424:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031430:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8800/0xad8e53a423049e33 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031441:0:81077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031447:0:81077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031452:0:81077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031457:0:81077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe9c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144434.031467:0:81077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031473:0:81077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031481:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9c2ac676c700) 00010000:00010000:3.0:1783144434.031484:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144434.031487:0:81077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031492:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9c00/0xad8e53a423049e3a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031522:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049e2c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4207e expref: 129 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031534:0:81077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049e41 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4207e expref: 128 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.031541:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:3.0:1783144434.031543:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783144434.031545:0:81077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9a00, rc 0) 00000100:00100000:3.0:1783144434.031878:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+128:73547:x1869759481766656:12345-192.168.203.4@tcp:101:dd.0 Request processed in 904us (1014us total) trans 120259084414 rc 0/0 00000100:00100000:3.0:1783144434.031886:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1437 00000100:00100000:2.0:1783144434.032397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.032431:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.032483:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481766784 00000100:00100000:0.0:1783144434.032488:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481766784 00000100:00100000:0.0:1783144434.032524:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5025 00000100:00100000:1.0:1783144434.032531:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481767040 00000100:00100000:0.0:1783144434.032534:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:73546:x1869759481766784:12345-192.168.203.4@tcp:101:dd.0 00000100:00100000:1.0:1783144434.032538:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481767040 00010000:00010000:0.0:1783144434.032544:0:26150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.032558:0:26150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049436cee/0xad8e53a423049e4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42085 expref: -99 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144434.032575:0:26150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00000100:00100000:1.0:1783144434.032586:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 274 00010000:00010000:0.0:1783144434.032587:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:0.0:1783144434.032593:0:26150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1783144434.032598:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+128:73545:x1869759481767040:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:0.0:1783144434.032604:0:26150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049436cee/0xad8e53a423049e4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42085 expref: 34 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.032629:0:26150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049436cee/0xad8e53a423049e4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42085 expref: 34 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.032641:0:26150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3da00, rc 0) 00010000:00000080:0.0:1783144434.032646:0:26150:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08f100 x1869759481766784/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.032754:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+129:73545:x1869759481767040:12345-192.168.203.4@tcp:35:dd.0 Request processed in 159us (321us total) trans 120259084415 rc 0/0 00000100:00100000:1.0:1783144434.032772:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 274 00000100:00100000:0.0:1783144434.032969:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:73546:x1869759481766784:12345-192.168.203.4@tcp:101:dd.0 Request processed in 437us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.032975:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5025 00000100:00100000:2.0:1783144434.033380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.033409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.033433:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.033478:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481767296 00000100:00100000:0.0:1783144434.033482:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481767296 00000100:00100000:0.0:1783144434.033506:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481767424 00000100:00100000:0.0:1783144434.033509:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481767424 00000100:00100000:1.0:1783144434.033520:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481767680 00000100:00100000:1.0:1783144434.033526:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481767680 00000100:00100000:0.0:1783144434.033536:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1438 00000100:00100000:0.0:1783144434.033545:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+131:73548:x1869759481767296:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:1.0:1783144434.033557:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1439 00000100:00100000:1.0:1783144434.033566:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+131:73547:x1869759481767424:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.033568:0:66143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.033578:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.033587:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c000/0xad8e53a423049e02 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42069 expref: 131 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.033590:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049e56 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4208c expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.033608:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:0.0:1783144434.033613:0:66143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783144434.033619:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049e5d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.033636:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049e5d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.033646:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049e5d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.033704:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1600/0xad8e53a423049e56 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4208c expref: 132 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.033717:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00400/0xad8e53a423049e5d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4208c expref: 131 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.033744:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:1.0:1783144434.033748:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783144434.033751:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aeed00400, rc 0) 00000100:00100000:2.0:1783144434.033765:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1440 00000100:00100000:2.0:1783144434.033776:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+131:73549:x1869759481767680:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144434.033786:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1783144434.033794:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+131:73547:x1869759481767424:12345-192.168.203.4@tcp:101:dd.0 Request processed in 228us (382us total) trans 0 rc 0/0 00010000:00010000:2.0:1783144434.033797:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a423049e64 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c42093 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.033805:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1439 00010000:00010000:2.0:1783144434.033869:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033879:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033885:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033896:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033902:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033919:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033951:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a423049e79 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033960:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a423049e79 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.033966:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a423049e79 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783144434.033974:0:66947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x16:0x0]: returning size 0 00010000:00010000:0.0:1783144434.034178:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.034188:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.034196:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144434.034228:0:66143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084416 00010000:00010000:2.0:1783144434.034273:0:66947:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034280:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034287:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034293:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034298:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49cc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144434.034302:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034308:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034326:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:2.0:1783144434.034329:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144434.034333:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034351:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49cc00/0xad8e53a423049e6b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034369:0:66947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034375:0:66947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034380:0:66947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034385:0:66947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49c200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:2.0:1783144434.034388:0:66947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034394:0:66947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034401:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9c2ac2a42200) 00010000:00010000:2.0:1783144434.034403:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783144434.034406:0:66947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034411:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49c200/0xad8e53a423049e72 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034454:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49ca00/0xad8e53a423049e64 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42093 expref: 134 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034466:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a423049e79 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42093 expref: 133 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.034473:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:2.0:1783144434.034475:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783144434.034477:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49d400, rc 0) 00000100:00100000:2.0:1783144434.034505:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+133:73549:x1869759481767680:12345-192.168.203.4@tcp:101:dd.0 Request processed in 732us (1070us total) trans 120259084417 rc 0/0 00000100:00100000:2.0:1783144434.034511:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1440 00000004:00010000:0.0:1783144434.034657:0:66143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006dddd675 reply state 00000000f2294ac7 transno 120259084418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144434.034813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1783144434.034948:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.034961:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:0.0:1783144434.034963:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144434.034965:0:66143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144434.034983:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481767808 00000100:00100000:1.0:1783144434.034989:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481767808 00002000:00010000:1.0:1783144434.035010:0:24813:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.035014:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aeff05180 with x1869759481767808 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.035021:0:24813:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aeff05180. 00000100:00100000:0.0:1783144434.035027:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+134:73548:x1869759481767296:12345-192.168.203.4@tcp:36:dd.0 Request processed in 1481us (1644us total) trans 120259084418 rc 0/0 00000100:00100000:0.0:1783144434.035035:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1438 00000020:00080000:0.0:1783144434.035039:0:66143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783144434.035045:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 768 00000100:00100000:1.0:1783144434.035054:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2404:x1869759481767808:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:1.0:1783144434.035144:0:24813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144434.035147:0:24813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.035156:0:24813:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144434.035158:0:24813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.035161:0:24813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144434.035169:0:24813:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aeff05180 x1869759481767808/t4294968866(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.035814:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2404:x1869759481767808:12345-192.168.203.4@tcp:10:dd.0 Request processed in 760us (1000us total) trans 4294968866 rc 0/0 00000100:00100000:1.0:1783144434.035821:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 768 00002000:00010000:1.0:1783144434.035825:0:24813:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.035827:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aeff05180 with x1869759481767808 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.035832:0:24813:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aeff05180. 00000100:00100000:2.0:1783144434.036670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.036775:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481767936 00000100:00100000:1.0:1783144434.036780:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481767936 00000100:00100000:1.0:1783144434.036804:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1441 00000100:00100000:1.0:1783144434.036811:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+134:73549:x1869759481767936:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.036822:0:66113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.036832:0:66113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049e8e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c4209a expref: -99 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.036852:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049e95 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.036861:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049e95 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.036870:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049e95 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.036950:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0c00/0xad8e53a423049e8e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4209a expref: 136 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.036965:0:66113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0e00/0xad8e53a423049e95 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4209a expref: 135 pid: 66113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.036972:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:1.0:1783144434.036975:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783144434.036978:0:66113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2af5fe0e00, rc 0) 00000100:00100000:1.0:1783144434.037018:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+135:73549:x1869759481767936:12345-192.168.203.4@tcp:101:dd.0 Request processed in 207us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.037025:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1441 00000100:00100000:2.0:1783144434.037034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.037123:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.037210:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481768192 00000100:00100000:2.0:1783144434.037215:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481768192 00000100:00100000:2.0:1783144434.037244:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5026 00000100:00100000:2.0:1783144434.037252:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:73548:x1869759481768192:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144434.037259:0:26144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144434.037270:0:26144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b27b24b/0xad8e53a423049e9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420a1 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.037286:0:26144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:2.0:1783144434.037298:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:2.0:1783144434.037302:0:26144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144434.037330:0:26144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b27b24b/0xad8e53a423049e9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420a1 expref: 36 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.037353:0:26144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b27b24b/0xad8e53a423049e9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420a1 expref: 36 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.037363:0:26144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49da00, rc 0) 00010000:00000080:2.0:1783144434.037369:0:26144:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2b01633850 x1869759481768192/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.037405:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+36:73548:x1869759481768192:12345-192.168.203.4@tcp:101:dd.0 Request processed in 154us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.037412:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5026 00000100:00100000:3.0:1783144434.037505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.037707:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481768320 00000100:00100000:1.0:1783144434.037713:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481768320 00000100:00100000:1.0:1783144434.037765:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1442 00000100:00100000:1.0:1783144434.037775:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+135:73547:x1869759481768320:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:1.0:1783144434.037802:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.037816:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9a00/0xad8e53a423049e41 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4207e expref: 135 pid: 81077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.037827:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:1.0:1783144434.037831:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783144434.037897:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481768576 00000100:00100000:0.0:1783144434.037902:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481768576 00010000:00010000:1.0:1783144434.037932:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783144434.037933:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1443 00000100:00100000:0.0:1783144434.037942:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeff06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+136:73550:x1869759481768576:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.037946:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.037949:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.037958:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049eaa lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420a8 expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.037962:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783144434.038004:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084419 00000004:00010000:1.0:1783144434.038023:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096f7d472 reply state 000000000111960d transno 120259084420 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.038034:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.038040:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:1.0:1783144434.038042:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783144434.038044:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783144434.038091:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+139:73547:x1869759481768320:12345-192.168.203.4@tcp:36:dd.0 Request processed in 318us (1059us total) trans 120259084420 rc 0/0 00000100:00100000:1.0:1783144434.038098:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1442 00000020:00080000:1.0:1783144434.038102:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783144434.038192:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038201:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038207:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038214:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038219:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038231:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038257:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049ebf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038262:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049ebf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038266:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049ebf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144434.038271:0:66143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x17:0x0]: returning size 0 00010000:00010000:0.0:1783144434.038298:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038304:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038310:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038316:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144434.038320:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038326:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038335:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144434.038338:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783144434.038381:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.038411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.038442:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769088 00000100:00100000:2.0:1783144434.038447:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769088 00000100:00100000:2.0:1783144434.038480:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1444 00000100:00100000:2.0:1783144434.038486:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+140:73549:x1869759481769088:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:2.0:1783144434.038505:0:66114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783144434.038517:0:66114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d400/0xad8e53a423049e79 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42093 expref: 140 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.038530:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:2.0:1783144434.038533:0:66114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144434.038556:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481768832 00000100:00100000:1.0:1783144434.038561:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481768832 00000100:00100000:1.0:1783144434.038598:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 275 00000100:00100000:1.0:1783144434.038606:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+141:73546:x1869759481768832:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:2.0:1783144434.038669:0:66114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.038680:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.038699:0:66114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038709:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038717:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d600/0xad8e53a423049eb1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038754:0:66143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038762:0:66143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038769:0:66143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.038771:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+142:73546:x1869759481768832:12345-192.168.203.4@tcp:35:dd.0 Request processed in 164us (387us total) trans 120259084423 rc 0/0 00010000:00010000:0.0:1783144434.038784:0:66143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d400 already unused, calling callback (ffffffffc18154f0) 00000100:00100000:1.0:1783144434.038787:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 275 00010000:00010000:0.0:1783144434.038790:0:66143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038799:0:66143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038809:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9c2af9e77500) 00010000:00010000:0.0:1783144434.038811:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144434.038813:0:66143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038817:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d400/0xad8e53a423049eb8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038841:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3ca00/0xad8e53a423049eaa lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420a8 expref: 142 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038868:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049ebf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420a8 expref: 141 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.038876:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:0.0:1783144434.038879:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000001:00080000:2.0:1783144434.038882:0:66114:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084422 00010000:00010000:0.0:1783144434.038883:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3cc00, rc 0) 00000004:00010000:2.0:1783144434.038916:0:66114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003352ef67 reply state 00000000c185de23 transno 120259084424 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.038931:0:66114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.038938:0:66114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:2.0:1783144434.038941:0:66114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783144434.038943:0:66114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144434.039024:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeff06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+143:73550:x1869759481768576:12345-192.168.203.4@tcp:101:dd.0 Request processed in 1083us (1519us total) trans 120259084421 rc 0/0 00000100:00100000:0.0:1783144434.039029:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1443 00000100:00100000:2.0:1783144434.039121:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ceadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+142:73549:x1869759481769088:12345-192.168.203.4@tcp:36:dd.0 Request processed in 634us (707us total) trans 120259084424 rc 0/0 00000100:00100000:2.0:1783144434.039128:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1444 00000020:00080000:2.0:1783144434.039132:0:66114:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783144434.039991:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.040038:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.040072:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769216 00000100:00100000:0.0:1783144434.040076:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769216 00000100:00100000:0.0:1783144434.040128:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5027 00000100:00100000:0.0:1783144434.040134:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+36:73547:x1869759481769216:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.040142:0:8602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.040151:0:8602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4cee29a/0xad8e53a423049ed4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420af expref: -99 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783144434.040163:0:8602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:0.0:1783144434.040172:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:0.0:1783144434.040175:0:8602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783144434.040179:0:8602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4cee29a/0xad8e53a423049ed4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420af expref: 37 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.040187:0:8602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4cee29a/0xad8e53a423049ed4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420af expref: 37 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.040203:0:8602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29c9d3de00, rc 0) 00010000:00000080:0.0:1783144434.040208:0:8602:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca609500 x1869759481769216/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.040235:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:73547:x1869759481769216:12345-192.168.203.4@tcp:101:dd.0 Request processed in 102us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.040239:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5027 00000100:00100000:1.0:1783144434.040304:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769344 00000100:00100000:1.0:1783144434.040309:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769344 00002000:00010000:1.0:1783144434.040327:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.040331:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2afaba7480 with x1869759481769344 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.040354:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2afaba7480. 00000100:00100000:1.0:1783144434.040379:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 769 00000100:00100000:1.0:1783144434.040386:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:2404:x1869759481769344:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:1.0:1783144434.040508:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144434.040512:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.040514:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144434.040516:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.040518:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144434.040525:0:8441:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afaba7480 x1869759481769344/t4294968867(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.040560:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:2404:x1869759481769344:12345-192.168.203.4@tcp:10:dd.0 Request processed in 174us (520us total) trans 4294968867 rc 0/0 00000100:00100000:1.0:1783144434.040567:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 769 00002000:00010000:1.0:1783144434.040570:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.040574:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2afaba7480 with x1869759481769344 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.040578:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2afaba7480. 00000100:00100000:2.0:1783144434.041922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.041945:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.041958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.042007:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769600 00000100:00100000:1.0:1783144434.042014:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769600 00002000:00010000:1.0:1783144434.042027:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.042030:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08dc00 with x1869759481769600 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.042034:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08dc00. 00000100:00100000:1.0:1783144434.042050:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 770 00000100:00100000:1.0:1783144434.042056:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:2403:x1869759481769600:12345-192.168.203.4@tcp:10:dd.0 00000100:00100000:2.0:1783144434.042086:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.042099:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769984 00000100:00100000:2.0:1783144434.042101:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769984 00000100:00100000:2.0:1783144434.042137:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5028 00000100:00100000:2.0:1783144434.042141:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:73549:x1869759481769984:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1783144434.042199:0:26149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783144434.042208:0:26149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6885890/0xad8e53a423049edb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420c4 expref: -99 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.042228:0:26149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:2.0:1783144434.042238:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:2.0:1783144434.042241:0:26149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783144434.042245:0:26149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6885890/0xad8e53a423049edb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420c4 expref: 41 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.042253:0:26149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6885890/0xad8e53a423049edb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420c4 expref: 41 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.042262:0:26149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2aee49cc00, rc 0) 00010000:00000080:2.0:1783144434.042267:0:26149:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08fb80 x1869759481769984/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.042306:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+41:73549:x1869759481769984:12345-192.168.203.4@tcp:101:dd.0 Request processed in 163us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.042313:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5028 00002000:00010000:1.0:1783144434.042426:0:24810:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144434.042430:0:24810:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.042438:0:24810:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144434.042440:0:24810:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.042443:0:24810:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144434.042450:0:24810:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08dc00 x1869759481769600/t4294968868(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.042486:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:2403:x1869759481769600:12345-192.168.203.4@tcp:10:dd.0 Request processed in 429us (564us total) trans 4294968868 rc 0/0 00000100:00100000:1.0:1783144434.042493:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 770 00002000:00010000:1.0:1783144434.042496:0:24810:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.042499:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08dc00 with x1869759481769600 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.042503:0:24810:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08dc00. 00000100:00100000:0.0:1783144434.042543:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769472 00000100:00100000:0.0:1783144434.042548:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769472 00000100:00100000:0.0:1783144434.042580:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769856 00000100:00100000:0.0:1783144434.042584:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769856 00000100:00100000:3.0:1783144434.042597:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1445 00000100:00100000:0.0:1783144434.042621:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1446 00000100:00100000:0.0:1783144434.042630:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+143:73551:x1869759481769856:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.042642:0:66112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.042653:0:66112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049ee2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420bd expref: -99 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042768:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144434.042771:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:0.0:1783144434.042778:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042788:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042801:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042819:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144434.042825:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+144:73550:x1869759481769472:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.042827:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144434.042844:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481770240 00000100:00100000:3.0:1783144434.042849:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481770240 00010000:00010000:0.0:1783144434.042880:0:66112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a423049ef7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042890:0:66112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a423049ef7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042897:0:66112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a423049ef7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783144434.042905:0:66112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x18:0x0]: returning size 0 00010000:00010000:0.0:1783144434.042946:0:66112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042953:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042959:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042965:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042971:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3d200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144434.042975:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.042991:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043001:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c29ca14f600) 00010000:00010000:0.0:1783144434.043005:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144434.043008:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043015:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d200/0xad8e53a423049ee9 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043027:0:66112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043033:0:66112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043039:0:66112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043044:0:66112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:0.0:1783144434.043047:0:66112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043052:0:66112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043057:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9c2af9e77900) 00010000:00010000:0.0:1783144434.043059:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783144434.043061:0:66112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043074:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c800/0xad8e53a423049ef0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144434.043083:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 276 00000100:00100000:3.0:1783144434.043094:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+146:73548:x1869759481770240:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:0.0:1783144434.043112:0:66112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3d800/0xad8e53a423049ee2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420bd expref: 147 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043126:0:66112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a423049ef7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420bd expref: 146 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.043133:0:66112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:0.0:1783144434.043135:0:66112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783144434.043137:0:66112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f6c00, rc 0) 00000100:00100000:0.0:1783144434.043174:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+147:73551:x1869759481769856:12345-192.168.203.4@tcp:101:dd.0 Request processed in 545us (1213us total) trans 120259084425 rc 0/0 00000100:00100000:0.0:1783144434.043182:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1446 00000100:00100000:3.0:1783144434.043234:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+146:73548:x1869759481770240:12345-192.168.203.4@tcp:35:dd.0 Request processed in 142us (463us total) trans 120259084426 rc 0/0 00000100:00100000:3.0:1783144434.043242:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 276 00010000:00010000:3.0:1783144434.043268:0:66947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144434.043278:0:66947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049f05 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420b6 expref: -99 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.043296:0:66947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049f0c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.043305:0:66947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049f0c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.043933:0:66947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049f0c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144434.043947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.043993:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481770368 00010000:00010000:3.0:1783144434.044004:0:66947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe8200/0xad8e53a423049f05 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420b6 expref: 147 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.044007:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481770368 00010000:00010000:3.0:1783144434.044031:0:66947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afcbe9000/0xad8e53a423049f0c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420b6 expref: 146 pid: 66947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144434.044033:0:24827:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.044040:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08f480 with x1869759481770368 ext(0->18446744073709551615) 00010000:00010000:3.0:1783144434.044044:0:66947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00002000:00010000:1.0:1783144434.044048:0:24827:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08f480. 00010000:00010000:3.0:1783144434.044049:0:66947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783144434.044054:0:66947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9000, rc 0) 00000100:00100000:1.0:1783144434.044078:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 771 00000100:00100000:3.0:1783144434.044092:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+146:73550:x1869759481769472:12345-192.168.203.4@tcp:101:dd.0 Request processed in 1483us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.044093:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:2404:x1869759481770368:12345-192.168.203.4@tcp:10:dd.0 00000100:00100000:3.0:1783144434.044107:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1445 00002000:00010000:1.0:1783144434.044167:0:24827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783144434.044170:0:24827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.044172:0:24827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:1.0:1783144434.044175:0:24827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:1.0:1783144434.044177:0:24827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783144434.044184:0:24827:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08f480 x1869759481770368/t4294968869(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.044241:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+41:2404:x1869759481770368:12345-192.168.203.4@tcp:10:dd.0 Request processed in 155us (294us total) trans 4294968869 rc 0/0 00000100:00100000:1.0:1783144434.044249:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 771 00002000:00010000:1.0:1783144434.044252:0:24827:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:1.0:1783144434.044256:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08f480 with x1869759481770368 ext(0->18446744073709551615) 00002000:00010000:1.0:1783144434.044261:0:24827:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08f480. 00000100:00100000:2.0:1783144434.045324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.045452:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481770496 00000100:00100000:0.0:1783144434.045457:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481770496 00000100:00100000:0.0:1783144434.045492:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1447 00000100:00100000:0.0:1783144434.045501:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+146:73551:x1869759481770496:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1783144434.045512:0:66143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783144434.045522:0:66143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423049f13 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420cb expref: -99 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.045543:0:66143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423049f1a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.045554:0:66143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423049f1a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.045569:0:66143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423049f1a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.045630:0:66143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6200/0xad8e53a423049f13 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420cb expref: 148 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.045644:0:66143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7800/0xad8e53a423049f1a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420cb expref: 147 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.045651:0:66143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:0.0:1783144434.045654:0:66143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783144434.045656:0:66143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7800, rc 0) 00000100:00100000:0.0:1783144434.045696:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+147:73551:x1869759481770496:12345-192.168.203.4@tcp:101:dd.0 Request processed in 196us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.045703:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1447 00000100:00100000:3.0:1783144434.046922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.046958:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481770752 00000100:00100000:0.0:1783144434.046963:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481770752 00000100:00100000:3.0:1783144434.046970:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.046998:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1448 00000100:00100000:0.0:1783144434.047008:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+147:73550:x1869759481770752:12345-192.168.203.4@tcp:36:dd.0 00000100:00100000:1.0:1783144434.047035:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481771008 00010000:00010000:0.0:1783144434.047038:0:66113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783144434.047040:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481771008 00010000:00010000:0.0:1783144434.047057:0:66113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3cc00/0xad8e53a423049ebf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420a8 expref: 148 pid: 66143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.047070:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 277 00010000:00010000:0.0:1783144434.047071:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:0.0:1783144434.047076:0:66113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144434.047081:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+147:73549:x1869759481771008:12345-192.168.203.4@tcp:35:dd.0 00010000:00010000:0.0:1783144434.047181:0:66113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.047210:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.047219:0:66113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144434.047234:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+149:73549:x1869759481771008:12345-192.168.203.4@tcp:35:dd.0 Request processed in 154us (263us total) trans 120259084428 rc 0/0 00000100:00100000:1.0:1783144434.047241:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 277 00000001:00080000:0.0:1783144434.047262:0:66113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084427 00000004:00010000:0.0:1783144434.047301:0:66113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf9529fa reply state 00000000a30b6a9e transno 120259084429 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.047313:0:66113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.047320:0:66113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:0.0:1783144434.047322:0:66113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144434.047325:0:66113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144434.047614:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afaba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+150:73550:x1869759481770752:12345-192.168.203.4@tcp:36:dd.0 Request processed in 608us (693us total) trans 120259084429 rc 0/0 00000100:00100000:0.0:1783144434.047621:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1448 00000020:00080000:0.0:1783144434.047626:0:66113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783144434.047881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.047982:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.048005:0:80989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481771520 00000100:00100000:3.0:1783144434.048010:0:80989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481771520 00000100:00100000:0.0:1783144434.048033:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481771264 00000100:00100000:0.0:1783144434.048039:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481771264 00000100:00100000:3.0:1783144434.048114:0:80989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 278 00000100:00100000:0.0:1783144434.048117:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1449 00000100:00100000:3.0:1783144434.048126:0:80989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3676450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+151:73547:x1869759481771520:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:0.0:1783144434.048132:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+151:73551:x1869759481771264:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:0.0:1783144434.048156:0:81077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783144434.048168:0:81077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6c00/0xad8e53a423049ef7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420bd expref: 151 pid: 66112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.048179:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:0.0:1783144434.048202:0:81077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144434.048267:0:80989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3676450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+152:73547:x1869759481771520:12345-192.168.203.4@tcp:35:dd.0 Request processed in 143us (283us total) trans 120259084430 rc 0/0 00000100:00100000:3.0:1783144434.048275:0:80989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 278 00010000:00010000:0.0:1783144434.048280:0:81077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.048290:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.048299:0:81077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783144434.048327:0:81077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084431 00000004:00010000:0.0:1783144434.048363:0:81077:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071ea5e5e reply state 000000009c4cbac2 transno 120259084432 ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.048384:0:81077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.048391:0:81077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:0.0:1783144434.048393:0:81077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783144434.048396:0:81077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783144434.048450:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+153:73551:x1869759481771264:12345-192.168.203.4@tcp:36:dd.0 Request processed in 324us (570us total) trans 120259084432 rc 0/0 00000100:00100000:0.0:1783144434.048467:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1449 00000020:00080000:0.0:1783144434.048471:0:81077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783144434.049491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.049528:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481771648 00000100:00100000:1.0:1783144434.049532:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481771648 00000100:00100000:1.0:1783144434.049560:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5029 00000100:00100000:1.0:1783144434.049565:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+41:73550:x1869759481771648:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:1.0:1783144434.049572:0:16470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783144434.049582:0:16470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a423049f2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420d2 expref: -99 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783144434.049595:0:16470:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:1.0:1783144434.049605:0:16470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:1.0:1783144434.049608:0:16470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783144434.049612:0:16470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a423049f2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420d2 expref: 42 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.049673:0:16470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a423049f2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420d2 expref: 42 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.049681:0:16470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150a00, rc 0) 00010000:00000080:1.0:1783144434.049687:0:16470:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08d880 x1869759481771648/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.049714:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+42:73550:x1869759481771648:12345-192.168.203.4@tcp:101:dd.0 Request processed in 149us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.049719:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5029 00000100:00100000:1.0:1783144434.049915:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.050024:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481771776 00000100:00100000:3.0:1783144434.050029:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481771776 00000100:00100000:3.0:1783144434.050057:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5030 00000100:00100000:3.0:1783144434.050063:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+42:73551:x1869759481771776:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:3.0:1783144434.050071:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783144434.050081:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423049f36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420d9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783144434.050105:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x6a489fed, atime: 0x6a489fed, ctime: 0x6a489fed, blocks: 0x0 00010000:00010000:3.0:1783144434.050116:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=2968s v=(0 0) 00010000:00010000:3.0:1783144434.050119:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783144434.050125:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423049f36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420d9 expref: 43 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.050135:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423049f36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420d9 expref: 43 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.050145:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8200, rc 0) 00010000:00000080:3.0:1783144434.050150:0:8438:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2addaae680 x1869759481771776/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 328/400 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.050176:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+43:73551:x1869759481771776:12345-192.168.203.4@tcp:101:dd.0 Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.050180:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5030 00000100:00100000:2.0:1783144434.051287:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.051360:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772032 00000100:00100000:3.0:1783144434.051448:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772032 00002000:00010000:3.0:1783144434.051468:0:24812:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:3.0:1783144434.051472:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08d500 with x1869759481772032 ext(0->18446744073709551615) 00002000:00010000:3.0:1783144434.051480:0:24812:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08d500. 00000100:00100000:3.0:1783144434.051505:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 772 00000100:00100000:3.0:1783144434.051513:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+43:2404:x1869759481772032:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:3.0:1783144434.051648:0:24812:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783144434.051651:0:24812:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144434.051659:0:24812:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:3.0:1783144434.051661:0:24812:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:3.0:1783144434.051663:0:24812:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783144434.051671:0:24812:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca08d500 x1869759481772032/t4294968870(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.051711:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:2404:x1869759481772032:12345-192.168.203.4@tcp:10:dd.0 Request processed in 199us (426us total) trans 4294968870 rc 0/0 00000100:00100000:3.0:1783144434.051718:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 772 00002000:00010000:3.0:1783144434.051737:0:24812:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:3.0:1783144434.051741:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca08d500 with x1869759481772032 ext(0->18446744073709551615) 00002000:00010000:3.0:1783144434.051745:0:24812:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca08d500. 00000100:00100000:1.0:1783144434.051818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.051887:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481771904 00000100:00100000:0.0:1783144434.051893:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481771904 00002000:00010000:0.0:1783144434.051909:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:0.0:1783144434.051912:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2addaac380 with x1869759481771904 ext(0->18446744073709551615) 00002000:00010000:0.0:1783144434.051918:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2addaac380. 00000100:00100000:0.0:1783144434.051937:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 773 00000100:00100000:0.0:1783144434.051945:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:2405:x1869759481771904:12345-192.168.203.4@tcp:10:dd.0 00002000:00010000:0.0:1783144434.052019:0:24814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783144434.052022:0:24814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb mtime from disk: 1783144429 -> 1783144434 00002000:00010000:0.0:1783144434.052024:0:24814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb atime from disk: 1783144429 -> 1783144429 00002000:00010000:0.0:1783144434.052026:0:24814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb ctime from disk: 1783144429 -> 1783144434 00002000:00010000:0.0:1783144434.052028:0:24814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783144434.052035:0:24814:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2addaac380 x1869759481771904/t4294968871(0) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.052151:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:2405:x1869759481771904:12345-192.168.203.4@tcp:10:dd.0 Request processed in 207us (334us total) trans 4294968871 rc 0/0 00000100:00100000:0.0:1783144434.052160:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 773 00002000:00010000:0.0:1783144434.052163:0:24814:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:0.0:1783144434.052166:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2addaac380 with x1869759481771904 ext(0->18446744073709551615) 00002000:00010000:0.0:1783144434.052172:0:24814:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2addaac380. 00000100:00100000:2.0:1783144434.054643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.054800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.055010:0:66115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772288 00000100:00100000:1.0:1783144434.055010:0:66116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772544 00000100:00100000:3.0:1783144434.055018:0:66115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772288 00000100:00100000:1.0:1783144434.055019:0:66116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772544 00000100:00100000:1.0:1783144434.055072:0:66116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 279 00000100:00100000:3.0:1783144434.055081:0:66115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:1.0:1783144434.055082:0:66116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+154:73551:x1869759481772544:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:3.0:1783144434.055095:0:66115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+154:73550:x1869759481772288:12345-192.168.203.4@tcp:35:dd.0 00000100:00100000:1.0:1783144434.055293:0:66116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+156:73551:x1869759481772544:12345-192.168.203.4@tcp:35:dd.0 Request processed in 209us (490us total) trans 120259084433 rc 0/0 00000100:00100000:1.0:1783144434.055309:0:66116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 279 00000100:00100000:3.0:1783144434.055339:0:66115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+155:73550:x1869759481772288:12345-192.168.203.4@tcp:35:dd.0 Request processed in 246us (697us total) trans 120259084434 rc 0/0 00000100:00100000:3.0:1783144434.055359:0:66115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 280 00000100:00100000:3.0:1783144434.275669:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.275710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.275853:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772800 00000100:00100000:1.0:1783144434.275864:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772800 00000100:00100000:1.0:1783144434.275905:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5031 00000100:00100000:1.0:1783144434.275915:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:2404:x1869759481772800:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:1.0:1783144434.275968:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772672 00000100:00100000:1.0:1783144434.275977:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772672 00002000:00100000:1.0:1783144434.275998:0:24813:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff9c2af5510a80 x1869759481772672/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.276008:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5510a80 with x1869759481772672 ext(0->1023) 00002000:00010000:1.0:1783144434.276013:0:24813:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5510a80 00000100:00100000:1.0:1783144434.276041:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 774 00000100:00100000:1.0:1783144434.276047:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+46:2404:x1869759481772672:12345-192.168.203.4@tcp:4:dd.0 00000001:00080000:2.0:1783144434.276137:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968871 is committed 00010000:00000080:0.0:1783144434.276265:0:26145:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5510700 x1869759481772800/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.276326:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2404:x1869759481772800:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 413us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.276334:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5031 00010000:00000080:1.0:1783144434.276355:0:24813:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5510a80 x1869759481772672/t4294968872(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.276381:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2404:x1869759481772672:12345-192.168.203.4@tcp:4:dd.0 Request processed in 334us (670us total) trans 4294968872 rc 0/0 00000100:00100000:1.0:1783144434.276388:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 774 00002000:00100000:1.0:1783144434.276393:0:24813:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff9c2af5510a80 x1869759481772672/t4294968872(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.276400:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5510a80 with x1869759481772672 ext(0->1023) 00002000:00010000:1.0:1783144434.276403:0:24813:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5510a80 00000100:00100000:3.0:1783144434.279035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.279074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.279152:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772928 00000100:00100000:1.0:1783144434.279159:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772928 00002000:00100000:1.0:1783144434.279191:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff9c2affdb5c00 x1869759481772928/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.279202:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affdb5c00 with x1869759481772928 ext(0->1023) 00002000:00010000:1.0:1783144434.279207:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affdb5c00 00000100:00100000:1.0:1783144434.279238:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 775 00000100:00100000:1.0:1783144434.279247:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2405:x1869759481772928:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:1.0:1783144434.279508:0:24828:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb5c00 x1869759481772928/t4294968873(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.279565:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2405:x1869759481772928:12345-192.168.203.4@tcp:4:dd.0 Request processed in 319us (490us total) trans 4294968873 rc 0/0 00000100:00100000:1.0:1783144434.279572:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 775 00002000:00100000:1.0:1783144434.279577:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff9c2affdb5c00 x1869759481772928/t4294968873(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.279584:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affdb5c00 with x1869759481772928 ext(0->1023) 00002000:00010000:1.0:1783144434.279587:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affdb5c00 00000100:00100000:0.0:1783144434.279688:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773056 00000100:00100000:0.0:1783144434.279692:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773056 00000100:00100000:0.0:1783144434.279739:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5032 00000100:00100000:0.0:1783144434.279747:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2406:x1869759481773056:12345-192.168.203.4@tcp:16:kworker.0 00000001:00080000:2.0:1783144434.279921:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968873 is committed 00010000:00000080:0.0:1783144434.279978:0:26152:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29cead9c00 x1869759481773056/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.280031:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2406:x1869759481773056:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 285us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.280039:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5032 00000100:00100000:3.0:1783144434.284407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.284418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.284516:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773312 00000100:00100000:1.0:1783144434.284524:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773312 00000100:00100000:1.0:1783144434.284569:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5033 00000100:00100000:1.0:1783144434.284581:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2404:x1869759481773312:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:1.0:1783144434.284627:0:26139:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb4700 x1869759481773312/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.284679:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2404:x1869759481773312:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.284687:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5033 00000100:00100000:1.0:1783144434.284710:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773184 00000100:00100000:1.0:1783144434.284714:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773184 00002000:00100000:1.0:1783144434.284771:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff9c2afa946300 x1869759481773184/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.284781:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2afa946300 with x1869759481773184 ext(0->1023) 00002000:00010000:1.0:1783144434.284787:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2afa946300 00000100:00100000:1.0:1783144434.284816:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 776 00000100:00100000:1.0:1783144434.284825:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2403:x1869759481773184:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:1.0:1783144434.285107:0:24830:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afa946300 x1869759481773184/t4294968874(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.285134:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2403:x1869759481773184:12345-192.168.203.4@tcp:4:dd.0 Request processed in 311us (728us total) trans 4294968874 rc 0/0 00000100:00100000:1.0:1783144434.285141:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 776 00002000:00100000:1.0:1783144434.285147:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff9c2afa946300 x1869759481773184/t4294968874(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.285154:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2afa946300 with x1869759481773184 ext(0->1023) 00002000:00010000:1.0:1783144434.285158:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2afa946300 00000100:00100000:2.0:1783144434.288143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.288198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.288223:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773440 00000100:00100000:1.0:1783144434.288230:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773440 00002000:00100000:1.0:1783144434.288267:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff9c2aef487100 x1869759481773440/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.288285:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aef487100 with x1869759481773440 ext(0->1023) 00002000:00010000:1.0:1783144434.288290:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aef487100 00000100:00100000:1.0:1783144434.288331:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 777 00000100:00100000:1.0:1783144434.288352:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2405:x1869759481773440:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:1.0:1783144434.289820:0:24827:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef487100 x1869759481773440/t4294968875(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.289886:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2405:x1869759481773440:12345-192.168.203.4@tcp:4:dd.0 Request processed in 1548us (1747us total) trans 4294968875 rc 0/0 00000100:00100000:1.0:1783144434.289894:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 777 00002000:00100000:1.0:1783144434.289909:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff9c2aef487100 x1869759481773440/t4294968875(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.289917:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aef487100 with x1869759481773440 ext(0->1023) 00002000:00010000:1.0:1783144434.289921:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aef487100 00000100:00100000:1.0:1783144434.289950:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773568 00000100:00100000:1.0:1783144434.289954:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773568 00000100:00100000:1.0:1783144434.289988:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5034 00000100:00100000:1.0:1783144434.290003:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2405:x1869759481773568:12345-192.168.203.4@tcp:16:kworker.0 00000001:00080000:2.0:1783144434.290296:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968875 is committed 00010000:00000080:1.0:1783144434.290560:0:26151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef484380 x1869759481773568/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.290595:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2405:x1869759481773568:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 599us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.290602:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5034 00000100:00100000:2.0:1783144434.293210:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.293230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.293270:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773824 00000100:00100000:1.0:1783144434.293277:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773824 00000100:00100000:3.0:1783144434.293353:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773696 00000100:00100000:3.0:1783144434.293358:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773696 00002000:00100000:3.0:1783144434.293388:0:24812:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff9c2aef485180 x1869759481773696/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.293413:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5035 00002000:00100000:3.0:1783144434.293420:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aef485180 with x1869759481773696 ext(0->1023) 00000100:00100000:1.0:1783144434.293427:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2404:x1869759481773824:12345-192.168.203.4@tcp:16:kworker.0 00002000:00010000:3.0:1783144434.293434:0:24812:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aef485180 00010000:00000080:1.0:1783144434.293460:0:26150:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2addaad880 x1869759481773824/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.293463:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 778 00000100:00100000:3.0:1783144434.293477:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2403:x1869759481773696:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:1.0:1783144434.293509:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2404:x1869759481773824:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.293516:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5035 00010000:00000080:3.0:1783144434.294172:0:24812:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef485180 x1869759481773696/t4294968876(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.294224:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2403:x1869759481773696:12345-192.168.203.4@tcp:4:dd.0 Request processed in 750us (1018us total) trans 4294968876 rc 0/0 00000100:00100000:3.0:1783144434.294231:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 778 00002000:00100000:3.0:1783144434.294236:0:24812:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff9c2aef485180 x1869759481773696/t4294968876(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783144434.294243:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aef485180 with x1869759481773696 ext(0->1023) 00002000:00010000:3.0:1783144434.294247:0:24812:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aef485180 00000100:00100000:2.0:1783144434.295307:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.295789:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774080 00000100:00100000:3.0:1783144434.295804:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774080 00000100:00100000:3.0:1783144434.295842:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5036 00000100:00100000:3.0:1783144434.295853:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2406:x1869759481774080:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:3.0:1783144434.295886:0:26144:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c56a8000 x1869759481774080/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.295923:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2406:x1869759481774080:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 72us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.295931:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5036 00000100:00100000:3.0:1783144434.296814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.296854:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773952 00000100:00100000:0.0:1783144434.296861:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773952 00002000:00100000:0.0:1783144434.296891:0:24814:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff9c2affdb5180 x1869759481773952/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783144434.296901:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affdb5180 with x1869759481773952 ext(0->1023) 00002000:00010000:0.0:1783144434.296905:0:24814:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affdb5180 00000100:00100000:0.0:1783144434.296927:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 779 00000100:00100000:0.0:1783144434.296937:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2406:x1869759481773952:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:0.0:1783144434.297204:0:24814:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2affdb5180 x1869759481773952/t4294968877(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.297247:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2406:x1869759481773952:12345-192.168.203.4@tcp:4:dd.0 Request processed in 312us (433us total) trans 4294968877 rc 0/0 00000100:00100000:0.0:1783144434.297254:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 779 00002000:00100000:0.0:1783144434.297259:0:24814:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff9c2affdb5180 x1869759481773952/t4294968877(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783144434.297267:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2affdb5180 with x1869759481773952 ext(0->1023) 00002000:00010000:0.0:1783144434.297270:0:24814:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2affdb5180 00000100:00100000:0.0:1783144434.298963:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.298996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.299002:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774208 00000100:00100000:1.0:1783144434.299009:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774208 00000100:00100000:0.0:1783144434.299089:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774336 00000100:00100000:0.0:1783144434.299095:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774336 00002000:00100000:1.0:1783144434.299106:0:24813:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff9c29ca0d5f80 x1869759481774208/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.299135:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5037 00000100:00100000:0.0:1783144434.299151:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2405:x1869759481774336:12345-192.168.203.4@tcp:16:kworker.0 00002000:00100000:1.0:1783144434.299172:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d5f80 with x1869759481774208 ext(0->1023) 00002000:00010000:1.0:1783144434.299178:0:24813:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d5f80 00010000:00000080:0.0:1783144434.299182:0:8602:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c56a9180 x1869759481774336/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.299202:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 780 00000100:00100000:1.0:1783144434.299212:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2406:x1869759481774208:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:0.0:1783144434.299222:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2405:x1869759481774336:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.299230:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5037 00010000:00000080:1.0:1783144434.299549:0:24813:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d5f80 x1869759481774208/t4294968878(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.299578:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2406:x1869759481774208:12345-192.168.203.4@tcp:4:dd.0 Request processed in 368us (620us total) trans 4294968878 rc 0/0 00000100:00100000:1.0:1783144434.299586:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 780 00002000:00100000:1.0:1783144434.299592:0:24813:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff9c29ca0d5f80 x1869759481774208/t4294968878(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.299600:0:24813:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d5f80 with x1869759481774208 ext(0->1023) 00002000:00010000:1.0:1783144434.299604:0:24813:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d5f80 00000100:00100000:0.0:1783144434.307801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.307842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.307858:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774464 00000100:00100000:1.0:1783144434.307869:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774464 00002000:00100000:1.0:1783144434.307912:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff9c29ca0d7b80 x1869759481774464/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.307924:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d7b80 with x1869759481774464 ext(0->1023) 00002000:00010000:1.0:1783144434.307930:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d7b80 00000100:00100000:1.0:1783144434.307962:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 781 00000100:00100000:1.0:1783144434.307972:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2403:x1869759481774464:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:1.0:1783144434.308323:0:24828:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d7b80 x1869759481774464/t4294968879(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.308407:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:2403:x1869759481774464:12345-192.168.203.4@tcp:4:dd.0 Request processed in 436us (613us total) trans 4294968879 rc 0/0 00000100:00100000:1.0:1783144434.308420:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 781 00002000:00100000:1.0:1783144434.308429:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff9c29ca0d7b80 x1869759481774464/t4294968879(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.308435:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774592 00002000:00100000:1.0:1783144434.308438:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d7b80 with x1869759481774464 ext(0->1023) 00000100:00100000:3.0:1783144434.308442:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774592 00002000:00010000:1.0:1783144434.308445:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d7b80 00000100:00100000:3.0:1783144434.308498:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5038 00000100:00100000:3.0:1783144434.308508:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:2404:x1869759481774592:12345-192.168.203.4@tcp:16:kworker.0 00000001:00080000:0.0:1783144434.308759:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968879 is committed 00010000:00000080:3.0:1783144434.308823:0:8435:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d5500 x1869759481774592/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.308862:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2404:x1869759481774592:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 356us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.308870:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5038 00000100:00100000:0.0:1783144434.312395:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.312556:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.312591:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774720 00000100:00100000:1.0:1783144434.312597:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774720 00002000:00100000:1.0:1783144434.312631:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff9c29ca0d7480 x1869759481774720/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.312638:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d7480 with x1869759481774720 ext(0->1023) 00002000:00010000:1.0:1783144434.312643:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d7480 00000100:00100000:1.0:1783144434.312666:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 782 00000100:00100000:1.0:1783144434.312673:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2405:x1869759481774720:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:2.0:1783144434.312774:0:16470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774848 00000100:00100000:2.0:1783144434.312779:0:16470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774848 00000100:00100000:2.0:1783144434.312814:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5039 00000100:00100000:2.0:1783144434.312822:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2405:x1869759481774848:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:2.0:1783144434.312851:0:16470:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef605f80 x1869759481774848/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.312915:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2405:x1869759481774848:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.312923:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5039 00010000:00000080:1.0:1783144434.312969:0:24830:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d7480 x1869759481774720/t4294968880(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.312989:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2405:x1869759481774720:12345-192.168.203.4@tcp:4:dd.0 Request processed in 318us (603us total) trans 4294968880 rc 0/0 00000100:00100000:1.0:1783144434.312994:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 782 00002000:00100000:1.0:1783144434.312998:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff9c29ca0d7480 x1869759481774720/t4294968880(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.313003:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d7480 with x1869759481774720 ext(0->1023) 00002000:00010000:1.0:1783144434.313011:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d7480 00000100:00100000:0.0:1783144434.315010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.315592:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.315704:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775104 00000100:00100000:0.0:1783144434.315710:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775104 00000100:00100000:1.0:1783144434.315751:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774976 00000100:00100000:1.0:1783144434.315757:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774976 00000100:00100000:0.0:1783144434.315777:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5040 00002000:00100000:1.0:1783144434.315788:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff9c29ca0d6a00 x1869759481774976/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.315789:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2406:x1869759481775104:12345-192.168.203.4@tcp:16:kworker.0 00002000:00100000:1.0:1783144434.315804:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d6a00 with x1869759481774976 ext(0->1023) 00002000:00010000:1.0:1783144434.315809:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d6a00 00010000:00000080:0.0:1783144434.315829:0:8438:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef607480 x1869759481775104/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.315839:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 783 00000100:00100000:1.0:1783144434.315849:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2406:x1869759481774976:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:0.0:1783144434.315883:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2406:x1869759481775104:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.315891:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5040 00010000:00000080:1.0:1783144434.316104:0:24827:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d6a00 x1869759481774976/t4294968881(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.316143:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2406:x1869759481774976:12345-192.168.203.4@tcp:4:dd.0 Request processed in 296us (1136us total) trans 4294968881 rc 0/0 00000100:00100000:1.0:1783144434.316149:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 783 00002000:00100000:1.0:1783144434.316156:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff9c29ca0d6a00 x1869759481774976/t4294968881(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.316165:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d6a00 with x1869759481774976 ext(0->1023) 00002000:00010000:1.0:1783144434.316169:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d6a00 00000100:00100000:3.0:1783144434.318411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.318453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.318516:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775232 00000100:00100000:2.0:1783144434.318522:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775232 00002000:00100000:2.0:1783144434.318551:0:24812:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff9c2aef606680 x1869759481775232/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.318559:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aef606680 with x1869759481775232 ext(0->1023) 00002000:00010000:2.0:1783144434.318563:0:24812:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aef606680 00000100:00100000:2.0:1783144434.318611:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 784 00000100:00100000:1.0:1783144434.318616:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775360 00000100:00100000:2.0:1783144434.318622:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2403:x1869759481775232:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:1.0:1783144434.318623:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775360 00000100:00100000:1.0:1783144434.318668:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5041 00000100:00100000:1.0:1783144434.318678:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2404:x1869759481775360:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:1.0:1783144434.318709:0:26145:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef606a00 x1869759481775360/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.318805:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2404:x1869759481775360:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 128us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.318814:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5041 00010000:00000080:2.0:1783144434.318904:0:24812:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2aef606680 x1869759481775232/t4294968882(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.318931:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2403:x1869759481775232:12345-192.168.203.4@tcp:4:dd.0 Request processed in 313us (479us total) trans 4294968882 rc 0/0 00000100:00100000:2.0:1783144434.318938:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 784 00002000:00100000:2.0:1783144434.318944:0:24812:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff9c2aef606680 x1869759481775232/t4294968882(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.318950:0:24812:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2aef606680 with x1869759481775232 ext(0->1023) 00002000:00010000:2.0:1783144434.318953:0:24812:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2aef606680 00000100:00100000:1.0:1783144434.322870:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.322871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.322952:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775488 00000100:00100000:3.0:1783144434.322961:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775488 00000100:00100000:2.0:1783144434.323259:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775616 00000100:00100000:2.0:1783144434.323264:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775616 00000100:00100000:2.0:1783144434.323308:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5042 00000100:00100000:2.0:1783144434.323320:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:2403:x1869759481775616:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:2.0:1783144434.323376:0:26152:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2addaac700 x1869759481775616/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.323426:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:2403:x1869759481775616:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 110us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.323433:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5042 00002000:00100000:2.0:1783144434.323478:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff9c29ca0d6d80 x1869759481775488/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.323489:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d6d80 with x1869759481775488 ext(0->1023) 00002000:00010000:2.0:1783144434.323495:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d6d80 00000100:00100000:2.0:1783144434.323559:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 785 00000100:00100000:2.0:1783144434.323568:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2403:x1869759481775488:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:2.0:1783144434.323921:0:8441:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d6d80 x1869759481775488/t4294968883(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.323950:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:2403:x1869759481775488:12345-192.168.203.4@tcp:4:dd.0 Request processed in 384us (1097us total) trans 4294968883 rc 0/0 00000100:00100000:2.0:1783144434.323957:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 785 00002000:00100000:2.0:1783144434.323962:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff9c29ca0d6d80 x1869759481775488/t4294968883(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.323970:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d6d80 with x1869759481775488 ext(0->1023) 00002000:00010000:2.0:1783144434.323974:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d6d80 00000100:00100000:1.0:1783144434.327430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.327431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.327524:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775872 00000100:00100000:3.0:1783144434.327529:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775744 00000100:00100000:2.0:1783144434.327531:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775872 00000100:00100000:3.0:1783144434.327536:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775744 00002000:00100000:3.0:1783144434.327576:0:24810:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff9c29ca2ba680 x1869759481775744/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.327588:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5043 00002000:00100000:3.0:1783144434.327593:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca2ba680 with x1869759481775744 ext(0->1023) 00002000:00010000:3.0:1783144434.327600:0:24810:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca2ba680 00000100:00100000:2.0:1783144434.327603:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2404:x1869759481775872:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:2.0:1783144434.327644:0:26139:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d5c00 x1869759481775872/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.327668:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 786 00000100:00100000:3.0:1783144434.327678:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2403:x1869759481775744:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:2.0:1783144434.327805:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2404:x1869759481775872:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 204us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.327813:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5043 00010000:00000080:2.0:1783144434.328093:0:24810:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca2ba680 x1869759481775744/t4294968884(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.328119:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2403:x1869759481775744:12345-192.168.203.4@tcp:4:dd.0 Request processed in 443us (697us total) trans 4294968884 rc 0/0 00000100:00100000:2.0:1783144434.328126:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 786 00002000:00100000:2.0:1783144434.328132:0:24810:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff9c29ca2ba680 x1869759481775744/t4294968884(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.328147:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca2ba680 with x1869759481775744 ext(0->1023) 00002000:00010000:2.0:1783144434.328151:0:24810:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca2ba680 00000100:00100000:1.0:1783144434.333152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.333198:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.333304:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776128 00000100:00100000:2.0:1783144434.333312:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776128 00000100:00100000:2.0:1783144434.333369:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5044 00000100:00100000:2.0:1783144434.333379:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2406:x1869759481776128:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:2.0:1783144434.333432:0:26151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c3c25c00 x1869759481776128/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.333482:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2406:x1869759481776128:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 105us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.333490:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5044 00000100:00100000:3.0:1783144434.334115:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776000 00000100:00100000:3.0:1783144434.334120:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776000 00002000:00100000:3.0:1783144434.334147:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff9c29ca2b9180 x1869759481776000/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783144434.334176:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca2b9180 with x1869759481776000 ext(0->1023) 00002000:00010000:3.0:1783144434.334182:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca2b9180 00000100:00100000:3.0:1783144434.334207:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 787 00000100:00100000:3.0:1783144434.334216:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2406:x1869759481776000:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:3.0:1783144434.334557:0:24828:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca2b9180 x1869759481776000/t4294968885(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.334987:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:2406:x1869759481776000:12345-192.168.203.4@tcp:4:dd.0 Request processed in 772us (1841us total) trans 4294968885 rc 0/0 00000100:00100000:3.0:1783144434.334995:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 787 00002000:00100000:3.0:1783144434.335002:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff9c29ca2b9180 x1869759481776000/t4294968885(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783144434.335010:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca2b9180 with x1869759481776000 ext(0->1023) 00002000:00010000:3.0:1783144434.335015:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca2b9180 00000100:00100000:3.0:1783144434.336701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.336803:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776256 00000100:00100000:1.0:1783144434.336809:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776256 00002000:00100000:1.0:1783144434.336839:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff9c29c3c2b480 x1869759481776256/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.336847:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3c2b480 with x1869759481776256 ext(0->1023) 00002000:00010000:1.0:1783144434.336851:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c3c2b480 00000100:00100000:1.0:1783144434.336877:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 788 00000100:00100000:1.0:1783144434.336885:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c3c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:2405:x1869759481776256:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:1.0:1783144434.337108:0:24830:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c3c2b480 x1869759481776256/t4294968886(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.337164:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c3c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:2405:x1869759481776256:12345-192.168.203.4@tcp:4:dd.0 Request processed in 279us (465us total) trans 4294968886 rc 0/0 00000100:00100000:1.0:1783144434.337171:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 788 00002000:00100000:1.0:1783144434.337177:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff9c29c3c2b480 x1869759481776256/t4294968886(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.337185:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c3c2b480 with x1869759481776256 ext(0->1023) 00002000:00010000:1.0:1783144434.337188:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c3c2b480 00000100:00100000:2.0:1783144434.337516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.337599:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776384 00000100:00100000:1.0:1783144434.337604:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776384 00000100:00100000:1.0:1783144434.337635:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5045 00000100:00100000:1.0:1783144434.337643:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:2405:x1869759481776384:12345-192.168.203.4@tcp:16:kworker.0 00000001:00080000:0.0:1783144434.337952:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968886 is committed 00010000:00000080:1.0:1783144434.338084:0:26150:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c61fdf80 x1869759481776384/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.338151:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2405:x1869759481776384:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 509us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.338157:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5045 00000100:00100000:2.0:1783144434.339819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.339971:0:26144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776640 00000100:00100000:3.0:1783144434.339976:0:26144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776640 00000100:00100000:3.0:1783144434.340008:0:26144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5046 00000100:00100000:3.0:1783144434.340015:0:26144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2404:x1869759481776640:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:3.0:1783144434.340045:0:26144:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c615b480 x1869759481776640/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.340078:0:26144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c615b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2404:x1869759481776640:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 63us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.340085:0:26144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5046 00000100:00100000:2.0:1783144434.340118:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.340245:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776512 00000100:00100000:1.0:1783144434.340249:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776512 00002000:00100000:1.0:1783144434.340271:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff9c2afab10700 x1869759481776512/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.340280:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2afab10700 with x1869759481776512 ext(0->1023) 00002000:00010000:1.0:1783144434.340285:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2afab10700 00000100:00100000:1.0:1783144434.340349:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 789 00000100:00100000:1.0:1783144434.340357:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2404:x1869759481776512:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:1.0:1783144434.340539:0:24827:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2afab10700 x1869759481776512/t4294968887(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144434.340568:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2404:x1869759481776512:12345-192.168.203.4@tcp:4:dd.0 Request processed in 212us (450us total) trans 4294968887 rc 0/0 00000100:00100000:1.0:1783144434.340575:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 789 00002000:00100000:1.0:1783144434.340581:0:24827:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff9c2afab10700 x1869759481776512/t4294968887(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783144434.340602:0:24827:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2afab10700 with x1869759481776512 ext(0->1023) 00002000:00010000:1.0:1783144434.340606:0:24827:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2afab10700 00000100:00100000:2.0:1783144434.342225:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.342278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.342295:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776896 00000100:00100000:2.0:1783144434.342300:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776896 00000100:00100000:3.0:1783144434.342324:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776768 00000100:00100000:3.0:1783144434.342328:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776768 00000100:00100000:2.0:1783144434.342334:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5047 00000100:00100000:2.0:1783144434.342352:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2406:x1869759481776896:12345-192.168.203.4@tcp:16:kworker.0 00002000:00100000:3.0:1783144434.342356:0:24814:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff9c2af5d06d80 x1869759481776768/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783144434.342364:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d06d80 with x1869759481776768 ext(0->1023) 00002000:00010000:3.0:1783144434.342368:0:24814:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d06d80 00010000:00000080:2.0:1783144434.342377:0:26149:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5d04000 x1869759481776896/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144434.342385:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 790 00000100:00100000:3.0:1783144434.342391:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2406:x1869759481776768:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:2.0:1783144434.342407:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2406:x1869759481776896:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.342421:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5047 00010000:00000080:2.0:1783144434.342605:0:24814:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2af5d06d80 x1869759481776768/t4294968888(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.343235:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2406:x1869759481776768:12345-192.168.203.4@tcp:4:dd.0 Request processed in 843us (1011us total) trans 4294968888 rc 0/0 00000100:00100000:2.0:1783144434.343243:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 790 00002000:00100000:2.0:1783144434.343249:0:24814:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff9c2af5d06d80 x1869759481776768/t4294968888(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.343257:0:24814:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2af5d06d80 with x1869759481776768 ext(0->1023) 00002000:00010000:2.0:1783144434.343261:0:24814:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2af5d06d80 00000100:00100000:2.0:1783144434.345003:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144434.345003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.345199:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777152 00000100:00100000:3.0:1783144434.345205:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777152 00000100:00100000:3.0:1783144434.345245:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5048 00000100:00100000:3.0:1783144434.345254:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2403:x1869759481777152:12345-192.168.203.4@tcp:16:kworker.0 00000100:00100000:2.0:1783144434.345274:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777024 00000100:00100000:2.0:1783144434.345279:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777024 00010000:00000080:3.0:1783144434.345287:0:8435:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2ad05d3800 x1869759481777152/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.345296:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff9c29c9e89500 x1869759481777024/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.345304:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e89500 with x1869759481777024 ext(0->1023) 00002000:00010000:2.0:1783144434.345308:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e89500 00000100:00100000:2.0:1783144434.345322:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 791 00000100:00100000:2.0:1783144434.345329:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2403:x1869759481777024:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:3.0:1783144434.345330:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2403:x1869759481777152:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.345336:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5048 00010000:00000080:2.0:1783144434.345570:0:8441:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29c9e89500 x1869759481777024/t4294968889(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.345613:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c9e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2403:x1869759481777024:12345-192.168.203.4@tcp:4:dd.0 Request processed in 280us (609us total) trans 4294968889 rc 0/0 00000100:00100000:2.0:1783144434.345637:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 791 00002000:00100000:2.0:1783144434.345645:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff9c29c9e89500 x1869759481777024/t4294968889(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.345652:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29c9e89500 with x1869759481777024 ext(0->1023) 00002000:00010000:2.0:1783144434.345656:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29c9e89500 00000100:00100000:3.0:1783144434.352239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144434.352323:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144434.354956:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777280 00000100:00100000:2.0:1783144434.354965:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777280 00000100:00100000:2.0:1783144434.355069:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5049 00000100:00100000:2.0:1783144434.355081:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2403:x1869759481777280:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:2.0:1783144434.355131:0:26142:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29cab7a680 x1869759481777280/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.355199:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2403:x1869759481777280:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 120us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.355206:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5049 00000100:00100000:2.0:1783144434.355377:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777408 00000100:00100000:2.0:1783144434.355382:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777408 00002000:00100000:2.0:1783144434.355405:0:24810:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff9c29cab78700 x1869759481777408/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.355414:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29cab78700 with x1869759481777408 ext(0->1023) 00002000:00010000:2.0:1783144434.355418:0:24810:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29cab78700 00000100:00100000:2.0:1783144434.355478:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 792 00000100:00100000:2.0:1783144434.355486:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2404:x1869759481777408:12345-192.168.203.4@tcp:4:dd.0 00010000:00000080:2.0:1783144434.355807:0:24810:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29cab78700 x1869759481777408/t4294968890(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.355847:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:2404:x1869759481777408:12345-192.168.203.4@tcp:4:dd.0 Request processed in 361us (3523us total) trans 4294968890 rc 0/0 00000100:00100000:2.0:1783144434.355854:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 792 00002000:00100000:2.0:1783144434.355860:0:24810:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff9c29cab78700 x1869759481777408/t4294968890(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783144434.355868:0:24810:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29cab78700 with x1869759481777408 ext(0->1023) 00002000:00010000:2.0:1783144434.355871:0:24810:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29cab78700 00000100:00100000:3.0:1783144434.358433:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.358839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144434.358946:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777536 00000100:00100000:0.0:1783144434.358953:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777536 00002000:00100000:0.0:1783144434.358996:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff9c29ca0d4a80 x1869759481777536/t0(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/0 e 0 to 0 dl 1783144445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783144434.359006:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d4a80 with x1869759481777536 ext(0->1023) 00002000:00010000:0.0:1783144434.359011:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d4a80 00000100:00100000:2.0:1783144434.359013:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777664 00000100:00100000:2.0:1783144434.359017:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777664 00000100:00100000:0.0:1783144434.359036:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 793 00000100:00100000:2.0:1783144434.359040:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5050 00000100:00100000:0.0:1783144434.359044:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2406:x1869759481777536:12345-192.168.203.4@tcp:4:dd.0 00000100:00100000:2.0:1783144434.359046:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2406:x1869759481777664:12345-192.168.203.4@tcp:16:kworker.0 00010000:00000080:2.0:1783144434.359074:0:26141:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29cab78380 x1869759481777664/t0(0) o16->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 440/432 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144434.359266:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2406:x1869759481777664:12345-192.168.203.4@tcp:16:kworker.0 Request processed in 218us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144434.359273:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5050 00010000:00000080:0.0:1783144434.359297:0:24828:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c29ca0d4a80 x1869759481777536/t4294968891(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144434.359322:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2406:x1869759481777536:12345-192.168.203.4@tcp:4:dd.0 Request processed in 279us (484us total) trans 4294968891 rc 0/0 00000100:00100000:0.0:1783144434.359333:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 793 00002000:00100000:0.0:1783144434.359349:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff9c29ca0d4a80 x1869759481777536/t4294968891(0) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:545/0 lens 1512/448 e 0 to 0 dl 1783144445 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783144434.359357:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c29ca0d4a80 with x1869759481777536 ext(0->1023) 00002000:00010000:0.0:1783144434.359360:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c29ca0d4a80 00010000:00010000:1.0:1783144434.638345:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783144434.810984:0:95809:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783144434.811047:0:95809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.811061:0:95809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.811068:0:95809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.811075:0:95809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.811100:0:95809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783144434.811105:0:95809:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783144434.811147:0:95809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783144434.811151:0:95809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783144434.811156:0:95809:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783144434.811179:0:95809:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783144434.812182:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501423488:0@lo:39:umount.0 00000100:00100000:1.0:1783144434.812246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783144434.812309:0:9527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144434.812316:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.812324:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144434.812328:0:9527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.812346:0:9527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144434.812354:0:9527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144434.812360:0:9527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783144434.812363:0:9527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783144434.812365:0:9527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783144434.812387:0:9527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.812393:0:9527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144434.812410:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.812422:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043f800/0xad8e53a42304953b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423049542 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.812432:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144434.812433:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144434.812435:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144434.812445:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501423616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144434.812473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144434.812511:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501423616 00000100:00100000:1.0:1783144434.812516:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501423616 00000100:00100000:1.0:1783144434.812559:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1783144434.812568:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac42f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501423616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144434.812579:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.812593:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe9400/0xad8e53a423049542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a42304953b expref: 24 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.812605:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144434.812637:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac42f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3648:x1869759501423616:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144434.812644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1783144434.812703:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501423616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783144434.813190:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501423488 00000100:00100000:0.0:1783144434.813195:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501423488 00000100:00100000:0.0:1783144434.813245:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:0.0:1783144434.813253:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501423488:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783144434.813272:0:66114:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304916e 00000100:00080000:0.0:1783144434.813286:0:66114:0:(import.c:65:import_set_state_nolock()) ffff9c2af5ddc800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783144434.813351:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ad05d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3647:x1869759501423488:12345-0@lo:39:umount.0 Request processed in 99us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.813359:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000020:00000080:0.0:1783144434.813367:0:66114:0:(genops.c:906:class_export_put()) final put ffff9c2ac6d93000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:1.0:1783144434.813376:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af71e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783144434.813418:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144434.813447:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501423488:0@lo:39:umount.0 00000020:00000080:1.0:1783144434.813474:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac6d93000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1783144434.813478:0:95809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783144434.813483:0:95809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783144434.813487:0:95809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783144434.813513:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af5ddc800 for lustre-MDT0000 00010000:00010000:1.0:1783144434.813531:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783144434.816630:0:95809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144434.816635:0:95809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783144434.816640:0:95809:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783144434.816669:0:95809:0:(import.c:65:import_set_state_nolock()) ffff9c2afa9bb800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783144434.817040:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1869759501423744:0@lo:39:umount.0 00000100:00100000:1.0:1783144434.817086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144434.818155:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501423744 00000100:00100000:0.0:1783144434.818162:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501423744 00000100:00100000:0.0:1783144434.818254:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:0.0:1783144434.818263:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869759501423744:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783144434.818295:0:66113:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423042f2f 00000100:00080000:0.0:1783144434.818302:0:66113:0:(import.c:65:import_set_state_nolock()) ffff9c2ad13c7000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783144434.818362:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3647:x1869759501423744:12345-0@lo:39:umount.0 Request processed in 100us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144434.818370:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000020:00000080:0.0:1783144434.818378:0:66113:0:(genops.c:906:class_export_put()) final put ffff9c2ad13c2800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:2.0:1783144434.818437:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144434.818453:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ad13c2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1783144434.818498:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ad13c7000 for lustre-MDT0001 00000100:00080000:1.0:1783144434.818597:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2afa9bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783144434.818613:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1869759501423744:0@lo:39:umount.0 00000100:00080000:0.0:1783144434.818669:0:95809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783144434.818672:0:95809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783144434.818675:0:95809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783144434.819535:0:95809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819547:0:95809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819555:0:95809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819562:0:95809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819586:0:95809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783144434.819593:0:95809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819599:0:95809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819606:0:95809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819619:0:95809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144434.819639:0:95809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783144434.819643:0:95809:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783144434.819683:0:95809:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783144434.819687:0:95809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:0.0:1783144434.819692:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1783144434.819697:0:95809:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:1.0:1783144434.820123:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144434.820130:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820139:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af043f000 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144434.820142:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820151:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144434.820158:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144434.820163:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783144434.820166:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1783144434.820169:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1783144434.820320:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820328:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144434.820353:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820360:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2af043f000/0xad8e53a423049549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a423049550 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820377:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783144434.820381:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820387:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01c00 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:1.0:1783144434.820390:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820397:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144434.820404:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.820405:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783144434.820412:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783144434.820414:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783144434.820417:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783144434.820524:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820530:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783144434.820560:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820567:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01c00/0xad8e53a423049128 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad8e53a42304912f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820576:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144434.820586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144434.820592:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144434.820636:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501423872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783144434.820640:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501424000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144434.820754:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144434.820785:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144434.820812:0:26153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501423872 00000100:00100000:1.0:1783144434.820817:0:26153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501423872 00000100:00100000:2.0:1783144434.820825:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424000 00000100:00100000:2.0:1783144434.820831:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424000 00000100:00100000:1.0:1783144434.820867:0:26153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1783144434.820876:0:26153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3649:x1869759501423872:12345-0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783144434.820886:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783144434.820888:0:26153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783144434.820902:0:26153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af6f35400/0xad8e53a423049550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423049549 expref: 24 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144434.820914:0:26153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783144434.820950:0:26153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3649:x1869759501423872:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.820970:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501423872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783144434.821001:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1783144434.821010:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3650:x1869759501424000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144434.821021:0:26153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00010000:00010000:3.0:1783144434.821031:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783144434.821042:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516a00/0xad8e53a42304912f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad8e53a423049128 expref: 22 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144434.821052:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783144434.821086:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeea42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3650:x1869759501424000:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144434.821094:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1783144434.821118:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501424000:0@lo:103:ldlm_bl.0 00002000:00000080:0.0:1783144434.821846:0:95809:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1783144434.821870:0:95809:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:2.0:1783144434.822234:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968891 is committed 00000020:00000080:0.0:1783144434.822382:0:95809:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1783144434.822389:0:95809:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9c2ac5d54000 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 192.168.203.4@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294968891 stale:0 00000020:00080000:0.0:1783144434.822396:0:95809:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9c2afcbb8800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968847 stale:0 00000020:00080000:0.0:1783144434.822401:0:95809:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9c29c3efe800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968818 stale:0 00000020:00080000:0.0:1783144434.822405:0:95809:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff9c2af9f13380) has exports, disconnecting them 00000020:00080000:0.0:1783144434.822410:0:95809:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.4@tcp (ffff9c2ac5d54000), last request at 1783144434 00000020:00000080:0.0:1783144434.822416:0:95809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230491b4 00000020:00010000:0.0:1783144434.822422:0:95809:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2ac5d54000: total 0 00000100:00080000:0.0:1783144434.822426:0:95809:0:(import.c:65:import_set_state_nolock()) ffff9c2ac5d56800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144434.822448:0:95809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.4@tcp (ffff9c2ac5d54000): rc 0 00000020:00080000:0.0:1783144434.822452:0:95809:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9c2afcbb8800), last request at 1783144430 00000020:00000080:0.0:1783144434.822455:0:95809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42304902c 00000100:00080000:0.0:1783144434.822459:0:95809:0:(import.c:65:import_set_state_nolock()) ffff9c2afcbb9000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783144434.822512:0:95809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2afcbb8800): rc 0 00000020:00000080:0.0:1783144434.822515:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c2afcbb8800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1783144434.822533:0:95809:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9c29c3efe800), last request at 1783144433 00000020:00000080:0.0:1783144434.822544:0:95809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423042eaa 00000100:00080000:0.0:1783144434.822550:0:95809:0:(import.c:65:import_set_state_nolock()) ffff9c29c3efb000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783144434.822579:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afcbb8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783144434.822612:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2afcbb9000 for lustre-OST0000 00000020:00010000:2.0:1783144434.822676:0:9525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2ac5d54000: total 0 00010000:00010000:2.0:1783144434.822679:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144434.822712:0:9525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2ac5d54000, canceled 0 locks, left on hash table 20. 00002000:00010000:2.0:1783144434.822764:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822768:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822785:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d8f8f01/0xad8e53a423049b9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f9e expref: 21 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822808:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822811:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822818:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068537a7b/0xad8e53a423049c57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fdd expref: 20 pid: 26147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822834:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822837:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822844:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4cee29a/0xad8e53a423049ed4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420af expref: 19 pid: 8602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822860:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822863:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822870:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c22b72ba/0xad8e53a423049ca4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ff9 expref: 18 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822885:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822888:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822904:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015936c52/0xad8e53a423049cf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4201c expref: 17 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822920:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822923:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822929:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ec78296/0xad8e53a423049dd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c4205b expref: 16 pid: 26139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822943:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822946:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822953:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab385e2e/0xad8e53a423049b15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f6d expref: 15 pid: 26148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822967:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822970:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.822977:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca41f3dc/0xad8e53a423049f36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420d9 expref: 14 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.822991:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.822993:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823000:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7509ac9/0xad8e53a423049b2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f7b expref: 13 pid: 26146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823016:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823018:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823025:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4210fec/0xad8e53a423049c1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fc8 expref: 12 pid: 26140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823054:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823056:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823065:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce9a850/0xad8e53a423049d99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42046 expref: 11 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823080:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823083:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823090:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049436cee/0xad8e53a423049e4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42085 expref: 10 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823103:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823106:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823113:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6885890/0xad8e53a423049edb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420c4 expref: 9 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823127:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823129:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823136:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b27b24b/0xad8e53a423049e9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420a1 expref: 8 pid: 26144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823149:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823152:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823159:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a49cfcc8/0xad8e53a423049b23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41f74 expref: 7 pid: 26152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823187:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823190:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823198:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a581917/0xad8e53a423049bd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41fb3 expref: 6 pid: 26150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823212:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823215:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823222:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec20c606/0xad8e53a423049c96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41ff2 expref: 5 pid: 26149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823236:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823239:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823245:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83ac8c3/0xad8e53a423049d45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42031 expref: 4 pid: 26145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823259:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823262:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823269:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5eaf5f3/0xad8e53a423049e10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c42070 expref: 3 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783144434.823282:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1783144434.823284:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783144434.823290:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e20d2f/0xad8e53a423049f2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420d2 expref: 2 pid: 16470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144434.823314:0:9525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2ac5d54000, canceled 20 locks, left on hash table 0. 00000020:00000080:2.0:1783144434.824134:0:9525:0:(genops.c:906:class_export_put()) final put ffff9c2ac5d54000/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef 00010000:00010000:2.0:1783144434.824145:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144434.824147:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144434.824150:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783144434.824206:0:52153:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2ac5d54000/3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef for lustre-OST0000 00000020:00000080:3.0:1783144434.824248:0:52153:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2ac5d56800 for lustre-OST0000 00010000:00010000:2.0:1783144434.824280:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783144434.824311:0:95809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c3efe800): rc 0 00000020:00000080:0.0:1783144434.824314:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c29c3efe800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1783144434.824354:0:95809:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9c2af9f13380) has no exports 00000020:00000080:2.0:1783144434.824479:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c3efe800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00010000:00010000:1.0:1783144434.824569:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783144434.824619:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c29c3efb000 for lustre-OST0000 00000020:01000000:0.0:1783144434.827117:0:95809:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c29c3123960 - data ffff9c2acff0aaf8/ffff9c2affe0e800 00000020:01000000:0.0:1783144434.827226:0:95809:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2af9d36540 - data ffff9c2acfdad288/ffff9c2b01554c00 00100000:10000000:2.0:1783144434.842453:0:95809:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783144434.848450:0:95809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423003335 00000020:00000080:3.0:1783144434.848459:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c2afcbb8000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783144434.848513:0:95809:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2afaac8800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783144434.848518:0:95809:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2afaac8800 2 00000020:01000004:3.0:1783144434.848521:0:95809:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2afaac8800 from lustre-OST0000 00000020:00000080:3.0:1783144434.848575:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144434.848586:0:95809:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783144434.848589:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c2afcbbf000/lustre-OST0000_UUID 00000020:00000080:3.0:1783144434.848592:0:95809:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afcbbf000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783144434.848598:0:95809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783144434.848644:0:95809:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:3.0:1783144434.848648:0:95809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783144434.848661:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144434.848667:0:95809:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783144434.848674:0:95809:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c2af9e47800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144434.848679:0:95809:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9c29c23699c0) has exports, disconnecting them 00000020:00080000:3.0:1783144434.848683:0:95809:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c2af9e47800), last request at 1783141720 00000020:00000080:3.0:1783144434.848744:0:95809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a42300335f 00000020:00080000:3.0:1783144434.848752:0:95809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2af9e47800): rc 0 00000020:00000080:3.0:1783144434.848762:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c2af9e47800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783144434.848807:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afcbb8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783144434.849805:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af9e47800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1783144434.854713:0:95809:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783144434.854803:0:95809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783144434.854808:0:95809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783144434.854815:0:95809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783144434.855027:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144434.855036:0:95809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1783144434.855051:0:95809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783144434.855054:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783144434.855059:0:95809:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783144434.855068:0:95809:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c29c235b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783144434.855075:0:95809:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9c29c236b380) has exports, disconnecting them 00000020:00080000:3.0:1783144434.855080:0:95809:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c29c235b800), last request at 1783141720 00000020:00000080:3.0:1783144434.855085:0:95809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a423003374 00000020:00080000:3.0:1783144434.855096:0:95809:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c29c235b800): rc 0 00000020:00000080:3.0:1783144434.855101:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c29c235b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1783144434.855267:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2af71e4000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783144434.855274:0:35504:0:(genops.c:906:class_export_put()) final put ffff9c2afa9bf000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783144434.855277:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afa9bf000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783144434.855282:0:35504:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783144434.856327:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c29c235b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1783144434.857957:0:95809:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783144434.857962:0:95809:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783144434.857965:0:95809:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783144434.857969:0:95809:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783144434.858246:0:35504:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2afa9bb800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1783144434.858400:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783144434.858409:0:95809:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1783144434.858412:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c2af9e44000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1783144434.858416:0:95809:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2af9e44000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1783144434.858423:0:95809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1783144434.858578:0:95809:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c2afaac8800 1 00000020:00000080:2.0:1783144434.858821:0:95809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xad8e53a4230032fd 00000020:00000080:2.0:1783144434.858827:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c2afa9ba000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783144434.858832:0:95809:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783144434.858836:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783144434.858845:0:95809:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783144434.858848:0:95809:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9c2af5d58000) has no exports 00000020:00000080:0.0:1783144434.858913:0:35504:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afa9ba000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783144434.878576:0:95809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783144434.878600:0:95809:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783144434.878605:0:95809:0:(genops.c:906:class_export_put()) final put ffff9c2afaac9000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783144434.878609:0:95809:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2afaac9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783144434.878618:0:95809:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783144434.878994:0:95809:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9c2afaac9800 00000020:02000400:3.0:1783144434.879047:0:95809:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783144435.661860:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144435.728535:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501424128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144435.728593:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144435.728621:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783144435.728626:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501424512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144435.728646:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144435.728668:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501424256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144435.728685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144435.728697:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783144435.728701:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeed25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501424384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783144435.728717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144435.728761:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424128 00000100:00100000:1.0:1783144435.728767:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424128 00000100:00100000:1.0:1783144435.728811:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424384 00000100:00100000:1.0:1783144435.728815:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424384 00000100:00100000:1.0:1783144435.728834:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1783144435.728842:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afa944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501424128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783144435.728870:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144435.728910:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afa944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501424128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144435.728917:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1783144435.728934:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1783144435.728939:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3648:x1869759501424384:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1783144435.728945:0:11960:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783144435.728972:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ae4ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3648:x1869759501424384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (253us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783144435.728978:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1783144435.728996:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424512 00000100:00100000:1.0:1783144435.728999:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424512 00000100:00100000:1.0:1783144435.729021:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424256 00000100:00100000:1.0:1783144435.729024:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424256 00000100:00100000:1.0:1783144435.729042:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:1.0:1783144435.729048:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501424512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783144435.729069:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:1.0:1783144435.729098:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501424512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144435.729104:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:1.0:1783144435.729115:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:1.0:1783144435.729121:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501424256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783144435.729143:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1783144435.729169:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501424256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144435.729175:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00080000:1.0:1783144435.729197:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:02020000:1.0:1783144435.729228:0:3648:0:(client.c:1491:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1783144435.729232:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783144435.729236:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783144435.729239:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1783144435.729248:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1783144435.729251:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783144435.729255:0:3648:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2944 00000100:00080000:1.0:1783144435.729260:0:3648:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c29c5a45800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1783144435.729292:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2b0158b100 x1869759501424640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144435.729321:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501424256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783144435.729356:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b0158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501424640:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1783144435.729380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144435.729407:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424640 00000100:00100000:1.0:1783144435.729410:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424640 00000100:00100000:1.0:1783144435.729428:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5051 00000100:00100000:1.0:1783144435.729432:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3647:x1869759501424640:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:1.0:1783144435.729448:0:26145:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144435.729473:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3647:x1869759501424640:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 39us (92us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144435.729483:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5051 00000100:00080000:1.0:1783144435.729509:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783144435.729514:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783144435.729516:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b0158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501424640:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1783144435.729535:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeed26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501424512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783144435.729547:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affe18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501424128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783144435.729980:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501425024:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144435.730057:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869759501425536:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730084:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144435.730102:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783144435.730108:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501424896:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144435.730145:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501425408:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730168:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144435.730197:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425024 00000100:00100000:2.0:1783144435.730201:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425024 00000100:00100000:2.0:1783144435.730234:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425536 00000100:00100000:2.0:1783144435.730238:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425536 00000100:00100000:2.0:1783144435.730256:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424896 00000100:00100000:2.0:1783144435.730259:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424896 00000100:00100000:2.0:1783144435.730271:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425408 00000100:00100000:2.0:1783144435.730273:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425408 00000100:00100000:2.0:1783144435.730285:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1783144435.730291:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501425024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730340:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501425024:12345-0@lo:400:kworker.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144435.730347:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1783144435.730361:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1783144435.730367:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869759501425536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730393:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869759501425536:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144435.730399:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1783144435.730410:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1783144435.730416:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501424896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730461:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501424896:12345-0@lo:400:kworker.0 Request processed in 45us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144435.730469:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1783144435.730489:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1783144435.730497:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501425408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730535:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501425408:12345-0@lo:400:kworker.0 Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144435.730541:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1783144435.730574:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501425152:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730611:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144435.730633:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783144435.730640:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501424768:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783144435.730692:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783144435.730697:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501425280:0@lo:400:kworker.0 00000100:00080000:0.0:1783144435.730697:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144435.730740:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144435.730763:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425152 00000100:00100000:2.0:1783144435.730766:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425152 00000100:00100000:2.0:1783144435.730784:0:26152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425280 00000100:00100000:2.0:1783144435.730787:0:26152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425280 00000100:00100000:2.0:1783144435.730809:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1783144435.730815:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501425280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730848:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501425280:12345-0@lo:400:kworker.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144435.730854:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1783144435.730865:0:26152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5052 00000100:00100000:2.0:1783144435.730869:0:26152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3650:x1869759501425152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783144435.730880:0:26152:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783144435.730904:0:26152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3650:x1869759501425152:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783144435.730910:0:26152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5052 00000100:00100000:2.0:1783144435.730927:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501424768 00000100:00100000:2.0:1783144435.730930:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501424768 00000100:00100000:2.0:1783144435.730955:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783144435.730962:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3650:x1869759501424768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.730987:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3650:x1869759501424768:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144435.730992:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1783144435.731021:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783144435.731035:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3650:1869759501424768:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.731044:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501425280:0@lo:400:kworker.0 00000100:00080000:2.0:1783144435.731051:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783144435.731054:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783144435.731057:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1783144435.731065:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1783144435.731067:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144435.731070:0:3650:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2363 00000100:00080000:2.0:1783144435.731074:0:3650:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2af9da2800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1783144435.731088:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afabc4e00 x1869759501425664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144435.731103:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501425152:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.731132:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501425664:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:2.0:1783144435.731151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144435.731389:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501424896:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.731413:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501425408:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.731428:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501425024:0@lo:400:kworker.0 00000100:00100000:2.0:1783144435.731450:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869759501425536:0@lo:400:kworker.0 00000100:00100000:1.0:1783144435.731537:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425664 00000100:00100000:1.0:1783144435.731541:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425664 00000100:00100000:1.0:1783144435.731599:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5053 00000100:00100000:1.0:1783144435.731605:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1869759501425664:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:1.0:1783144435.731619:0:26147:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783144435.731654:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1869759501425664:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 48us (501us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783144435.731662:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5053 00000100:00080000:2.0:1783144435.731706:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144435.731710:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783144435.731713:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501425664:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:2.0:1783144436.685907:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783144436.751799:0:94178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084434 is committed 00010000:00010000:3.0:1783144436.751840:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751853:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751872:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751880:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2acb286e00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.751884:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751892:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751909:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2ac2a42e00) 00010000:00010000:3.0:1783144436.751913:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.751917:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751924:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2acb286e00/0xad8e53a4230499cc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751943:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751949:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751956:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751961:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.751964:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751980:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751987:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe8fe2fe (ffff9c2ac2a42e00) 00010000:00010000:3.0:1783144436.751989:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.751992:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.751998:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01200/0xad8e53a423049a04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe8fe2fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752014:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752020:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752026:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752031:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752033:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752039:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752046:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c29ca14f500) 00010000:00010000:3.0:1783144436.752048:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752050:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752061:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150800/0xad8e53a423049ad6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752072:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752078:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752084:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752089:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed00600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752092:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752098:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752104:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2af565c100) 00010000:00010000:3.0:1783144436.752106:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752109:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752114:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed00600/0xad8e53a423049b0e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752123:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752129:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752139:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752144:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752147:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752153:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752159:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c2af565c500) 00010000:00010000:3.0:1783144436.752161:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752164:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752169:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f000/0xad8e53a423049b1c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752179:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752184:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752190:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752194:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752197:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752210:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752217:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2af565c200) 00010000:00010000:3.0:1783144436.752219:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752221:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752227:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01000/0xad8e53a423049b62 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752235:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752241:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752247:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752251:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752254:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752270:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752284:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2afa089500) 00010000:00010000:3.0:1783144436.752286:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752289:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752305:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f400/0xad8e53a423049ba1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752316:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752333:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752339:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752344:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afa98f200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752347:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752354:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752369:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2afa089200) 00010000:00010000:3.0:1783144436.752371:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752374:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752380:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2afa98f200/0xad8e53a423049c0a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752390:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752396:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752407:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752412:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752423:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752430:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752437:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c29ca14f400) 00010000:00010000:3.0:1783144436.752440:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752443:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752448:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1c00/0xad8e53a423049c18 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752458:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752464:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752470:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752475:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0400 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752479:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752493:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752500:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c29ca14f800) 00010000:00010000:3.0:1783144436.752502:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752505:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752510:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0400/0xad8e53a423049c5e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752520:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752526:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752532:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752537:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe1000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752540:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752545:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752552:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c2af565c000) 00010000:00010000:3.0:1783144436.752554:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752556:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752570:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe1000/0xad8e53a423049c9d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752579:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752585:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752591:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752596:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0800 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752599:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752605:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752611:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2af565c700) 00010000:00010000:3.0:1783144436.752613:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752616:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752621:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0800/0xad8e53a423049cdc lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752629:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752635:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752646:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752651:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752654:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752660:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752666:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2af565ce00) 00010000:00010000:3.0:1783144436.752668:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752671:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752676:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aeed01600/0xad8e53a423049d1b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752686:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752691:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752698:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752703:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752706:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752754:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752763:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2afa089900) 00010000:00010000:3.0:1783144436.752766:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752769:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752775:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c200/0xad8e53a423049d8b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752786:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752792:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752799:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752804:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0600 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752807:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752813:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752821:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c29ca14fb00) 00010000:00010000:3.0:1783144436.752824:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752827:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752841:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0600/0xad8e53a423049d92 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752852:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752857:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752864:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752869:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3c000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752872:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752877:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752884:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2afa089a00) 00010000:00010000:3.0:1783144436.752886:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752888:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752894:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3c000/0xad8e53a423049dd8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752902:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752908:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752917:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752922:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2af5fe0200 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752925:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752931:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752938:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c29ca14fc00) 00010000:00010000:3.0:1783144436.752940:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752942:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752948:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2af5fe0200/0xad8e53a423049e17 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752956:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752962:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752968:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752972:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29c9d3dc00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.752975:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752987:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.752994:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2afa089300) 00010000:00010000:3.0:1783144436.752996:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.752999:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753004:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29c9d3dc00/0xad8e53a423049e87 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753013:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753019:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753024:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753029:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2b02150c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.753031:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753038:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753044:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c29ca14ff00) 00010000:00010000:3.0:1783144436.753046:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.753049:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753062:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2b02150c00/0xad8e53a423049ea3 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753072:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753078:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753084:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753089:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aee49d000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.753092:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753097:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753104:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c29ca14f200) 00010000:00010000:3.0:1783144436.753106:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.753108:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753114:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2aee49d000/0xad8e53a423049ecd lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753122:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753128:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753137:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753142:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f6000 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.753145:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753151:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753157:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2afa089b00) 00010000:00010000:3.0:1783144436.753159:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.753161:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753167:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f6000/0xad8e53a423049f21 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753176:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753182:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753187:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753192:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c29ca7f7c00 already unused, calling callback (ffffffffc18154f0) 00010000:00010000:3.0:1783144436.753194:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753207:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753214:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c29ca14fd00) 00010000:00010000:3.0:1783144436.753215:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783144436.753218:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144436.753224:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c29ca7f7c00/0xad8e53a423049f28 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 81077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144436.835080:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144436.835114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144436.835139:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144436.835165:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144436.835187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144436.835215:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777920 00000100:00100000:2.0:1783144436.835215:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778176 00000100:00100000:3.0:1783144436.835222:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777920 00000100:00100000:2.0:1783144436.835222:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778176 00000100:00100000:2.0:1783144436.835253:0:8602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778304 00000100:00100000:2.0:1783144436.835256:0:8602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778304 00000100:00100000:3.0:1783144436.835303:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778048 00000100:00100000:3.0:1783144436.835307:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778048 00000100:00100000:3.0:1783144436.835355:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 895 00000100:00100000:2.0:1783144436.835355:0:8602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2110 00000100:00100000:3.0:1783144436.835367:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2404:x1869759481777920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144436.835367:0:8602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481778304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144436.835378:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5054 00000100:00100000:1.0:1783144436.835394:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2404:x1869759481778176:12345-192.168.203.4@tcp:400:kworker.0 00000020:00080000:1.0:1783144436.835405:0:26150:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.4@tcp 00000100:00100000:3.0:1783144436.835441:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2404:x1869759481777920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144436.835441:0:8602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2404:x1869759481778304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144436.835451:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 895 00000100:00100000:2.0:1783144436.835451:0:8602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2110 00000100:00100000:1.0:1783144436.835477:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2404:x1869759481778176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (357us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783144436.835478:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 896 00000100:00100000:1.0:1783144436.835501:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5054 00000100:00100000:3.0:1783144436.835503:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2404:x1869759481778048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144436.835561:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2404:x1869759481778048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144436.835568:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 896 00000100:00080000:1.0:1783144436.835591:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783144436.835600:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783144436.835605:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144436.835648:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777792 00000100:00100000:1.0:1783144436.835656:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777792 00000100:00100000:1.0:1783144436.835712:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:1.0:1783144436.835761:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481777792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144436.835828:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481777792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 107us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144436.835937:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:3.0:1783144436.837632:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144436.837765:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778432 00000100:00100000:2.0:1783144436.837773:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778432 00000100:00100000:2.0:1783144436.837805:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5055 00000100:00100000:2.0:1783144436.837812:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2402:x1869759481778432:12345-192.168.203.4@tcp:8:ptlrpcd_00_01.0 00010000:00020000:2.0:1783144436.837833:0:26148:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783144436.837965:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2402:x1869759481778432:12345-192.168.203.4@tcp:8:ptlrpcd_00_01.0 Request processed in 151us (339us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144436.837973:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5055 00000001:02000400:2.0:1783144437.556823:0:96154:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:2.0:1783144437.709844:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783144438.285982:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501425792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783144438.286084:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144438.286131:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425792 00000100:00100000:1.0:1783144438.286142:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425792 00000100:00080000:2.0:1783144438.286497:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144438.286820:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1783144438.286835:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501425792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783144438.286871:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144438.286924:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869759501425792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144438.286933:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:3.0:1783144438.286970:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501425792:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783144438.734802:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144439.757824:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783144440.782124:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1783144440.845781:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) 4e9e4714-8000-4c64-bed6-3cadd5fdfc80->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144440.845795:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000100:00000040:2.0:1783144440.845819:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 4e9e4714-8000-4c64-bed6-3cadd5fdfc80->MGS req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144440.845834:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004979e921] to pc [ptlrpcd_00_03+3] req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.845860:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144440.845865:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c29c340b000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1783144440.845872:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144440.845882:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ef786ad] to pc [ptlrpcd_00_00+0] req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.845889:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.845899:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783144440.845904:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501425920:0@lo:400:kworker.0 00000020:00000040:2.0:1783144440.845906:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2af9ecb800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1783144440.845917:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144440.845938:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.845941:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004319a777] to pc [ptlrpcd_00_01+1] req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.845959:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.845962:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144440.845969:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2af7208000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783144440.845976:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144440.845985:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b13125bc] to pc [ptlrpcd_00_02+2] req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144440.845994:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1783144440.845996:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeede3c50 x1869759501425920 msgsize 224 00000100:00080000:2.0:1783144440.845999:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783144440.846005:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783144440.846005:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144440.846010:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00080000:2.0:1783144440.846013:0:41298:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2970 00000100:00080000:2.0:1783144440.846018:0:41298:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1783144440.846023:0:41298:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 50 to 0@lo 00000100:00000040:2.0:1783144440.846027:0:41298:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000020:00000040:2.0:1783144440.846030:0:41298:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042e9c 00000020:00000040:2.0:1783144440.846034:0:41298:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e41800 refcount=4 00000100:00000040:2.0:1783144440.846038:0:41298:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 50 to 0@lo 00000100:00000040:0.0:1783144440.846041:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846042:0:41298:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000020:00000040:2.0:1783144440.846047:0:41298:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e41800 : new refcount 3 00000100:00080000:2.0:1783144440.846054:0:41298:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2af9da2800 using connection 192.168.203.104@tcp/0@lo 00000020:00000040:2.0:1783144440.846064:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2af9da2800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1783144440.846075:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144440.846078:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1783144440.846088:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846092:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005470c109] to pc [ptlrpcd_rcv+-1] req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.846100:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501426304:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.846119:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1783144440.846119:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.846131:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2ac5d51000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783144440.846132:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.846142:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144440.846155:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002c9824d5] to pc [ptlrpcd_00_03+3] req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846163:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144440.846168:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2aefa7c800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783144440.846173:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144440.846181:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000de73fd12] to pc [ptlrpcd_00_00+0] req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846188:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144440.846192:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2ad13c7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1783144440.846197:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144440.846205:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f327e70d] to pc [ptlrpcd_00_01+1] req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144440.846211:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144440.846214:0:41298:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783144440.846215:0:41298:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783144440.846219:0:41298:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2970 00000100:00080000:2.0:1783144440.846221:0:41298:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1783144440.846228:0:41298:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 50 to 0@lo 00000100:00000040:2.0:1783144440.846230:0:41298:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000020:00000040:2.0:1783144440.846232:0:41298:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304901e 00000020:00000040:2.0:1783144440.846235:0:41298:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c4968000 refcount=4 00000100:00000040:2.0:1783144440.846237:0:41298:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 50 to 0@lo 00000100:00000040:2.0:1783144440.846239:0:41298:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000020:00000040:2.0:1783144440.846241:0:41298:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c4968000 : new refcount 3 00000100:00080000:2.0:1783144440.846244:0:41298:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c29c5a45800 using connection 192.168.203.104@tcp/0@lo 00000020:00000040:2.0:1783144440.846250:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c29c5a45800 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783144440.846254:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca0d6300 x1869759501426304 msgsize 224 00000100:00100000:2.0:1783144440.846261:0:41298:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144440.846262:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144440.846273:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ae19948d] to pc [ptlrpcd_rcv+-1] req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.846282:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846283:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144440.846303:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c29c5a41800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783144440.846308:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2804863 usecs (2805 jiffies) 00000100:00000040:2.0:1783144440.846315:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144440.846322:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846329:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8495596] to pc [ptlrpcd_00_02+2] req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.846339:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501426560:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.846343:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144440.846350:0:41298:0:(genops.c:1231:class_import_get()) import ffff9c2ad085c000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1783144440.846355:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846361:0:41298:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144440.846368:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.846378:0:41298:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000844e3fa5] to pc [ptlrpcd_00_03+3] req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.846386:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca0d4000 x1869759501426560 msgsize 224 00000100:00000040:2.0:1783144440.846389:0:41298:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (2980) 00000100:00100000:0.0:1783144440.846392:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144440.846408:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846412:0:3650:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.846424:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 2070 usecs (3 jiffies) 00000100:00100000:2.0:1783144440.846429:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501427072:0@lo:400:kworker.0 00000100:00000040:0.0:1783144440.846437:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846447:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846472:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783144440.846477:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aeea40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501427200:0@lo:400:kworker.0 00000100:00000040:0.0:1783144440.846494:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.846501:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.846503:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521180 x1869759501427072 msgsize 224 00000100:00100000:2.0:1783144440.846510:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144440.846518:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca0d7800 x1869759501427200 msgsize 224 00000100:00100000:0.0:1783144440.846525:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144440.846532:0:3650:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.846544:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846545:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 3580 usecs (4 jiffies) 00000100:00000040:0.0:1783144440.846559:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 1826 usecs (2 jiffies) 00000100:00000040:2.0:1783144440.846570:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.846580:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501426176:0@lo:400:kworker.0 00000100:00100000:0.0:1783144440.846584:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501425920 00000100:00100000:0.0:1783144440.846592:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501425920 00000100:00000040:2.0:1783144440.846594:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144440.846595:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:0.0:1783144440.846600:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=21 00000100:00000040:2.0:1783144440.846607:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.846623:0:94188:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:2.0:1783144440.846625:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01523800 x1869759501426176 msgsize 224 00000100:00100000:2.0:1783144440.846631:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144440.846649:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.846654:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00000040:0.0:1783144440.846663:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144440.846666:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 4243 usecs (5 jiffies) 00000100:00000040:0.0:1783144440.846670:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeede3c50 x1869759501425920/t0(0) o400->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846676:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.846693:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501426816:0@lo:400:kworker.0 00000100:00100000:0.0:1783144440.846694:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3651:x1869759501425920:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.846709:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1783144440.846713:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501425920 00000100:00000040:0.0:1783144440.846761:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.846768:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.846778:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.846791:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846797:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01520000 x1869759501426816 msgsize 224 00000100:00100000:2.0:1783144440.846803:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144440.846814:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144440.846820:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeede3c50 x1869759501425920/t0(0) o400->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846823:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846843:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1613 usecs (2 jiffies) 00000100:00100000:2.0:1783144440.846853:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783144440.846855:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:3651:x1869759501425920:12345-0@lo:400:kworker.0 Request processed in 165us (857us total) trans 0 rc 0/0 00000100:00000040:2.0:1783144440.846861:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.846867:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00000040:0.0:1783144440.846874:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000100:00100000:2.0:1783144440.846878:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501426048:0@lo:400:kworker.0 00000020:00000040:0.0:1783144440.846886:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 20 00000100:00000040:2.0:1783144440.846893:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.846901:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783144440.846915:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426304 00000100:00000040:2.0:1783144440.846916:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01522300 x1869759501426048 msgsize 224 00000100:00100000:0.0:1783144440.846921:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426304 00000100:00100000:2.0:1783144440.846925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:0.0:1783144440.846926:0:23926:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048fd1 00000020:00000040:0.0:1783144440.846930:0:23926:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefa7e800 refcount=7 00000100:00000040:2.0:1783144440.846943:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.846943:0:23926:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:2.0:1783144440.846955:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 4602 usecs (5 jiffies) 00000100:00000040:2.0:1783144440.846962:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.846963:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426816 00000100:00100000:0.0:1783144440.846968:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426816 00000020:00000040:0.0:1783144440.846971:0:23926:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049017 00000020:00000040:0.0:1783144440.846975:0:23926:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af71e2000 refcount=5 00000100:00100000:2.0:1783144440.846976:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501426688:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.846993:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.847003:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783144440.847005:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00000040:0.0:1783144440.847009:0:23926:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefa7e800 : new rpc_count 1 00000100:00000040:2.0:1783144440.847015:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01523100 x1869759501426688 msgsize 224 00000100:00000040:0.0:1783144440.847016:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca0d6300 x1869759501426304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.847025:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144440.847038:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501426304:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.847044:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1783144440.847051:0:23926:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 115964117002, transno 0, xid 1869759501426304 00000100:00000040:0.0:1783144440.847060:0:23926:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:2.0:1783144440.847065:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 48750 usecs (49 jiffies) 00000100:00000040:0.0:1783144440.847076:0:23926:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.847086:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.847096:0:23926:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.847097:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501426432:0@lo:8:kworker.0 00000100:00000040:2.0:1783144440.847119:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144455 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.847120:0:23926:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144440.847129:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d6300 x1869759501426304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.847134:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.847150:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521880 x1869759501426432 msgsize 520 00000100:00100000:2.0:1783144440.847157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144440.847171:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144455 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.847180:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2408 usecs (3 jiffies) 00000100:00000040:2.0:1783144440.847185:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.847193:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501426944:0@lo:8:kworker.0 00000100:00000040:2.0:1783144440.847204:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144455 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847213:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501426304:12345-0@lo:400:kworker.0 Request processed in 175us (954us total) trans 0 rc 0/0 00000100:00000040:2.0:1783144440.847214:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783144440.847224:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00000040:2.0:1783144440.847227:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01522680 x1869759501426944 msgsize 520 00000100:00000040:0.0:1783144440.847228:0:23926:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefa7e800 : new rpc_count 0 00000100:00100000:2.0:1783144440.847235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:0.0:1783144440.847238:0:23926:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefa7e800 : new refcount 6 00000100:00000040:2.0:1783144440.847250:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144455 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847254:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00000040:0.0:1783144440.847259:0:23926:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af71e2000 : new rpc_count 1 00000100:00000040:2.0:1783144440.847266:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 3141 usecs (4 jiffies) 00000100:00000040:0.0:1783144440.847266:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01520000 x1869759501426816/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847282:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501426816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144440.847289:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426560 00010000:00000040:0.0:1783144440.847303:0:23926:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501426816 00000100:00100000:2.0:1783144440.847308:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426560 00000100:00000040:0.0:1783144440.847310:0:23926:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000020:00000040:2.0:1783144440.847312:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042ebf 00000020:00000040:2.0:1783144440.847317:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e40000 refcount=5 00000100:00000040:0.0:1783144440.847318:0:23926:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:2.0:1783144440.847336:0:8438:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c29c31e19c0) now 10 - evictor 00000100:00000040:0.0:1783144440.847337:0:23926:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.847354:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:0.0:1783144440.847359:0:23926:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144440.847365:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01520000 x1869759501426816/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847374:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501426816:12345-0@lo:400:kworker.0 Request processed in 95us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144440.847375:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427072 00000100:00100000:2.0:1783144440.847380:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427072 00000020:00000040:2.0:1783144440.847383:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049041 00000100:00100000:0.0:1783144440.847384:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000020:00000040:2.0:1783144440.847387:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac9d61800 refcount=5 00000100:00000040:0.0:1783144440.847389:0:23926:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af71e2000 : new rpc_count 0 00000020:00000040:0.0:1783144440.847398:0:23926:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af71e2000 : new refcount 4 00000100:00100000:2.0:1783144440.847418:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426432 00000100:00100000:0.0:1783144440.847419:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426944 00000100:00100000:2.0:1783144440.847423:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426432 00000100:00100000:0.0:1783144440.847425:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426944 00000020:00000040:2.0:1783144440.847426:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042eaa 00000020:00000040:0.0:1783144440.847429:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304902c 00000100:00100000:2.0:1783144440.847449:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00000040:2.0:1783144440.847454:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af9e40000 : new rpc_count 1 00000100:00100000:0.0:1783144440.847478:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00000040:0.0:1783144440.847482:0:8435:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac9d61800 : new rpc_count 1 00000100:00000040:0.0:1783144440.847487:0:8435:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521180 x1869759501427072/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847500:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501427072:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783144440.847511:0:8435:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968832, transno 0, xid 1869759501427072 00000100:00000040:0.0:1783144440.847517:0:8435:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.847522:0:8435:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.847539:0:8435:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144440.847562:0:94199:0:(genops.c:1231:class_import_get()) import ffff9c29c5a41800 refcount=4 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783144440.847581:0:8435:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:1.0:1783144440.847585:0:94199:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008440122b] to pc [ptlrpcd_00_00+0] req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.847590:0:8435:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521180 x1869759501427072/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847608:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1869759501427072:12345-0@lo:400:kworker.0 Request processed in 111us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144440.847614:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000020:00000040:1.0:1783144440.847617:0:94195:0:(genops.c:1231:class_import_get()) import ffff9c2ad13c7800 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1783144440.847617:0:8435:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac9d61800 : new rpc_count 0 00000020:00000040:0.0:1783144440.847628:0:8435:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac9d61800 : new refcount 4 00000100:00000040:1.0:1783144440.847633:0:94195:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c735e21b] to pc [ptlrpcd_00_01+1] req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847643:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5056 00000100:00000040:0.0:1783144440.847649:0:8435:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521880 x1869759501426432/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144440.847652:0:75524:0:(genops.c:1231:class_import_get()) import ffff9c2af7208000 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1783144440.847661:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1869759501426432:12345-0@lo:8:kworker.0 00000100:00000040:1.0:1783144440.847669:0:75524:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000019139207] to pc [ptlrpcd_00_02+2] req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00020000:0.0:1783144440.847679:0:8435:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1783144440.847690:0:8435:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.847694:0:8435:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.847699:0:8435:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.847741:0:8435:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144455 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.847759:0:8435:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144440.847763:0:8435:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521880 x1869759501426432/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783144460 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847771:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1869759501426432:12345-0@lo:8:kworker.0 Request processed in 110us (619us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144440.847778:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5056 00000100:00100000:0.0:1783144440.847793:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5057 00000100:00000040:0.0:1783144440.847796:0:8435:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01522680 x1869759501426944/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847805:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1869759501426944:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783144440.847816:0:8435:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1783144440.847824:0:8435:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.847827:0:8435:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.847831:0:8435:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.847846:0:8435:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144455 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.847860:0:8435:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144440.847864:0:8435:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01522680 x1869759501426944/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783144460 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847875:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1869759501426944:12345-0@lo:8:kworker.0 Request processed in 71us (647us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783144440.847881:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5057 00000100:00100000:0.0:1783144440.847899:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427200 00000100:00100000:0.0:1783144440.847903:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427200 00000020:00000040:0.0:1783144440.847905:0:66114:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049183 00000020:00000040:0.0:1783144440.847908:0:66114:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af5ddc000 refcount=5 00000100:00000040:2.0:1783144440.847919:0:8438:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca0d4000 x1869759501426560/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.847926:0:66114:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1783144440.847935:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501426560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144440.847947:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426176 00010000:00000040:2.0:1783144440.847948:0:8438:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968829, transno 0, xid 1869759501426560 00000100:00100000:0.0:1783144440.847952:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426176 00000020:00000040:0.0:1783144440.847955:0:66114:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042f36 00000100:00000040:2.0:1783144440.847956:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000020:00000040:0.0:1783144440.847959:0:66114:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac9d63800 refcount=5 00000100:00000040:2.0:1783144440.847964:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1783144440.847971:0:66114:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c2ac6ddb380) now 10 - evictor 00000100:00000040:2.0:1783144440.847985:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.847992:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426048 00000100:00100000:0.0:1783144440.847997:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426048 00000020:00000040:0.0:1783144440.848000:0:66114:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049175 00000020:00000040:0.0:1783144440.848002:0:66114:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2afcbbf800 refcount=5 00000100:00000040:2.0:1783144440.848004:0:8438:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000020:00000040:0.0:1783144440.848010:0:66114:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2aee5919c0) now 14 - evictor 00000100:00000040:2.0:1783144440.848011:0:8438:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4000 x1869759501426560/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.848023:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501426688 00000100:00100000:2.0:1783144440.848024:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501426560:12345-0@lo:400:kworker.0 Request processed in 93us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144440.848028:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501426688 00000020:00000040:0.0:1783144440.848032:0:66114:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304917c 00000100:00100000:2.0:1783144440.848036:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000020:00000040:0.0:1783144440.848037:0:66114:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2afcbba000 refcount=5 00000100:00000040:2.0:1783144440.848043:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af9e40000 : new rpc_count 0 00000020:00000040:2.0:1783144440.848051:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e40000 : new refcount 4 00000100:00100000:0.0:1783144440.848059:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00000040:0.0:1783144440.848063:0:66114:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af5ddc000 : new rpc_count 1 00000100:00000040:0.0:1783144440.848067:0:66114:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca0d7800 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.848078:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1783144440.848081:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501427200:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.848083:0:66947:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac9d63800 : new rpc_count 1 00010000:00000040:0.0:1783144440.848094:0:66114:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501427200 00000100:00000040:2.0:1783144440.848097:0:66947:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01523800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848103:0:66114:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.848111:0:66114:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783144440.848117:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501426176:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783144440.848130:0:66947:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501426176 00000100:00000040:0.0:1783144440.848133:0:66114:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848139:0:66947:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 53 to 0@lo 00000100:00000040:2.0:1783144440.848147:0:66947:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144440.848169:0:66947:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848169:0:66114:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.848178:0:66114:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d7800 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848190:0:66947:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00100000:0.0:1783144440.848191:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501427200:12345-0@lo:400:kworker.0 Request processed in 111us (1669us total) trans 0 rc 0/0 00000100:00000040:2.0:1783144440.848199:0:66947:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01523800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.848219:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1783144440.848220:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869759501426176:12345-0@lo:400:kworker.0 Request processed in 104us (1589us total) trans 0 rc 0/0 00000100:00000040:0.0:1783144440.848223:0:66114:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af5ddc000 : new rpc_count 0 00000100:00100000:2.0:1783144440.848230:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000020:00000040:0.0:1783144440.848233:0:66114:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af5ddc000 : new refcount 4 00000100:00000040:2.0:1783144440.848234:0:66947:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac9d63800 : new rpc_count 0 00000020:00000040:2.0:1783144440.848246:0:66947:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac9d63800 : new refcount 4 00000100:00100000:0.0:1783144440.848251:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00000040:0.0:1783144440.848255:0:66114:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2afcbbf800 : new rpc_count 1 00000100:00000040:0.0:1783144440.848261:0:66114:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01522300 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.848263:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00000040:2.0:1783144440.848269:0:66947:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2afcbba000 : new rpc_count 1 00000100:00000040:2.0:1783144440.848277:0:66947:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01523100 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.848282:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501426048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144440.848310:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501426688:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783144440.848311:0:66114:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501426048 00000100:00000040:0.0:1783144440.848320:0:66114:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.848325:0:66114:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:2.0:1783144440.848327:0:66947:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501426688 00000100:00000040:2.0:1783144440.848334:0:66947:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 53 to 0@lo 00000100:00000040:2.0:1783144440.848339:0:66947:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.848346:0:66114:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848359:0:66947:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848362:0:66114:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.848370:0:66114:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01522300 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.848389:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869759501426048:12345-0@lo:400:kworker.0 Request processed in 110us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144440.848396:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00000040:0.0:1783144440.848399:0:66114:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2afcbbf800 : new rpc_count 0 00000100:00000040:2.0:1783144440.848402:0:66947:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000020:00000040:0.0:1783144440.848406:0:66114:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afcbbf800 : new refcount 4 00000100:00000040:2.0:1783144440.848410:0:66947:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01523100 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:551/0 lens 224/224 e 0 to 0 dl 1783144451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.848420:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869759501426688:12345-0@lo:400:kworker.0 Request processed in 115us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144440.848426:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00000040:2.0:1783144440.848429:0:66947:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2afcbba000 : new rpc_count 0 00000020:00000040:2.0:1783144440.848437:0:66947:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afcbba000 : new refcount 4 00000100:00080000:2.0:1783144440.848467:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000040:0.0:1783144440.848469:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000020:00000040:2.0:1783144440.848471:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2aee5919c0) now 14 - evictor 00000100:00080000:2.0:1783144440.848476:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000040:0.0:1783144440.848477:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.848479:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c2ac6ddb380) now 10 - evictor 00000100:00080000:2.0:1783144440.848486:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1783144440.848489:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c29c31e19c0) now 10 - evictor 00000100:00000040:0.0:1783144440.848494:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848515:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.848515:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aeea40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501427200:0@lo:400:kworker.0 00000100:00100000:2.0:1783144440.848532:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b0158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501427328:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783144440.848534:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968829 00000100:00000040:0.0:1783144440.848541:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848548:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144456 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848554:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848563:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783144440.848570:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501426560:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.848581:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01520700 x1869759501427328 msgsize 224 00000100:00000040:0.0:1783144440.848582:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 115964117002 00000100:00000040:0.0:1783144440.848588:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.848593:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144440.848603:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.848611:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501426304:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.848613:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848623:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848625:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 3580 usecs (4 jiffies) 00000100:00000040:0.0:1783144440.848635:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.848637:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783144440.848645:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501425920:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.848648:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848654:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2aeea40380 x1869759501427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144440.848684:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2ad085c000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00100000:2.0:1783144440.848686:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b0158a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501427456:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1783144440.848701:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc5f80 x1869759501426560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848702:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848714:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1783144440.848746:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2ac5d51000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1783144440.848752:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01520380 x1869759501427456 msgsize 224 00000100:00100000:2.0:1783144440.848760:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144440.848761:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc6d80 x1869759501426304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144440.848771:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2af7208000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783144440.848778:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848781:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc4000 x1869759501425920/t0(0) o400->MGC192.168.203.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144440.848799:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000100:00000040:2.0:1783144440.848800:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1613 usecs (2 jiffies) 00000100:00100000:0.0:1783144440.848810:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1783144440.848817:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.848822:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427328 00000100:00100000:2.0:1783144440.848827:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427328 00000100:00100000:0.0:1783144440.848827:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501427584:0@lo:41:osp-pre-0-1.0 00000020:00000040:2.0:1783144440.848830:0:26788:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049041 00000020:00000040:2.0:1783144440.848834:0:26788:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac9d61800 refcount=5 00000100:00000040:0.0:1783144440.848845:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.848849:0:26788:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00000040:0.0:1783144440.848856:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.848873:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca0d5180 x1869759501427584 msgsize 224 00000100:00100000:2.0:1783144440.848874:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00000040:2.0:1783144440.848879:0:26788:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac9d61800 : new rpc_count 1 00000100:00100000:0.0:1783144440.848882:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144440.848888:0:26788:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01520700 x1869759501427328/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.848899:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.848902:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501427328:12345-0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783144440.848917:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2791953 usecs (2792 jiffies) 00002000:00000024:2.0:1783144440.848928:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144440.848932:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427456 00010000:00000040:2.0:1783144440.848938:0:26788:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968832, transno 0, xid 1869759501427328 00000100:00100000:0.0:1783144440.848938:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427456 00000020:00000040:0.0:1783144440.848941:0:23926:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049017 00000020:00000040:0.0:1783144440.848945:0:23926:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af71e2000 refcount=5 00000100:00000040:2.0:1783144440.848946:0:26788:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:2.0:1783144440.848952:0:26788:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144440.848958:0:23926:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:2.0:1783144440.848971:0:26788:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.848973:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427584 00000100:00100000:0.0:1783144440.848978:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427584 00000020:00000040:0.0:1783144440.848982:0:23926:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048fd1 00000020:00000040:0.0:1783144440.848987:0:23926:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefa7e800 refcount=7 00000100:00000040:2.0:1783144440.848998:0:26788:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144440.849004:0:26788:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01520700 x1869759501427328/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/368 e 0 to 0 dl 1783144451 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.849017:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1783144440.849023:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501427328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (438us total) trans 0 rc 0/0 00000100:00000040:0.0:1783144440.849023:0:23926:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af71e2000 : new rpc_count 1 00000100:00000040:0.0:1783144440.849032:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01520380 x1869759501427456/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849037:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00000040:2.0:1783144440.849042:0:26788:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac9d61800 : new rpc_count 0 00000020:00000040:2.0:1783144440.849053:0:26788:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac9d61800 : new refcount 4 00000100:00100000:0.0:1783144440.849054:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501427456:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783144440.849075:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000004:00000024:0.0:1783144440.849077:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00000040:2.0:1783144440.849079:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefa7e800 : new rpc_count 1 00010000:00000040:0.0:1783144440.849086:0:23926:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501427456 00000100:00000040:2.0:1783144440.849087:0:8446:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca0d5180 x1869759501427584/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1783144451 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.849095:0:23926:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.849101:0:23926:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783144440.849105:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501427584:12345-0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1783144440.849119:0:23926:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000024:2.0:1783144440.849126:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00010000:00000040:2.0:1783144440.849134:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 115964117002, transno 0, xid 1869759501427584 00000100:00000040:0.0:1783144440.849135:0:23926:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144440.849142:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144440.849143:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01520380 x1869759501427456/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/368 e 0 to 0 dl 1783144451 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.849150:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783144440.849159:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501427456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144440.849166:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00000040:0.0:1783144440.849169:0:23926:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af71e2000 : new rpc_count 0 00000100:00000040:2.0:1783144440.849172:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144440.849177:0:23926:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af71e2000 : new refcount 4 00000100:00000040:2.0:1783144440.849194:0:8446:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144440.849200:0:8446:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d5180 x1869759501427584/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:551/0 lens 224/368 e 0 to 0 dl 1783144451 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144440.849207:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 115964117002 00000100:00100000:2.0:1783144440.849209:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1869759501427584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (334us total) trans 0 rc 0/0 00000100:00000040:0.0:1783144440.849216:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849221:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00000040:2.0:1783144440.849226:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefa7e800 : new rpc_count 0 00000004:00000040:0.0:1783144440.849233:0:3651:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352768 avail=317065 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023567 state=0: rc = 0 00000020:00000040:2.0:1783144440.849236:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefa7e800 : new refcount 6 00000100:00000040:0.0:1783144440.849245:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144440.849254:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501427584:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1783144440.849263:0:3650:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968832 00000100:00000040:0.0:1783144440.849268:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588700 x1869759501427584/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.849271:0:3650:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144440.849278:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2af7208000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783144440.849302:0:3650:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849310:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1869759501427072:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.849316:0:3650:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc6a00 x1869759501427072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849325:0:3650:0:(genops.c:1244:class_import_put()) import ffff9c29c5a41800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1783144440.849350:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144455 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144440.849359:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144440.849363:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1783144440.849367:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144455 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849374:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501426432:0@lo:8:kworker.0 00000100:00000040:2.0:1783144440.849384:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144455 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144440.849390:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144440.849393:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1783144440.849397:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144455 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849403:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501426944:0@lo:8:kworker.0 00000100:00000040:2.0:1783144440.849408:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc5180 x1869759501426432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144455 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849415:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c2af9da2800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783144440.849427:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc7480 x1869759501426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144455 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849434:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c29c5a45800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1783144440.849455:0:3648:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783144440.849460:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783144440.849467:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352843 avail=317140 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023679 state=0: rc = 0 00000100:00000040:2.0:1783144440.849475:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849481:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b0158a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501427456:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783144440.849492:0:3648:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968832 00000100:00000040:2.0:1783144440.849497:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783144440.849504:0:3648:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1783144440.849506:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1783144440.849516:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849523:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b0158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501427328:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1783144440.849528:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b0158a680 x1869759501427456/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849536:0:3648:0:(genops.c:1244:class_import_put()) import ffff9c2ad13c7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1783144440.849543:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b0158b100 x1869759501427328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144456 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849552:0:3648:0:(genops.c:1244:class_import_put()) import ffff9c29c5a41800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1783144440.849580:0:3649:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783144440.849586:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.849594:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849600:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1869759501426048:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.849608:0:3649:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783144440.849612:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.849620:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849626:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869759501426688:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.849635:0:3649:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783144440.849639:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.849646:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849654:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1869759501426176:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.849664:0:3649:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783144440.849667:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144440.849675:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144440.849682:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501426816:0@lo:400:kworker.0 00000100:00000040:2.0:1783144440.849694:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc5c00 x1869759501426048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849702:0:3649:0:(genops.c:1244:class_import_put()) import ffff9c29c340b000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1783144440.849709:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc7b80 x1869759501426688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849716:0:3649:0:(genops.c:1244:class_import_put()) import ffff9c2aefa7c800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783144440.849744:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc7800 x1869759501426176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849751:0:3649:0:(genops.c:1244:class_import_put()) import ffff9c2af9ecb800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1783144440.849758:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc5500 x1869759501426816/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144456 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144440.849765:0:3649:0:(genops.c:1244:class_import_put()) import ffff9c2ad13c7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:2.0:1783144441.806543:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1783144441.955318:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeede0450 x1869759481778560 msgsize 224 00000100:00100000:3.0:1783144441.955388:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00000040:3.0:1783144441.955391:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783144441.955436:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29cab7aa00 x1869759481778688 msgsize 224 00000100:00100000:3.0:1783144441.955445:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144441.955445:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778560 00000100:00100000:2.0:1783144441.955461:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778560 00000020:00000040:2.0:1783144441.955464:0:94189:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049087 00000020:00000040:2.0:1783144441.955470:0:94189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefdda000 refcount=10 00000100:00000040:2.0:1783144441.955501:0:94189:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144441.955534:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00000040:2.0:1783144441.955540:0:94189:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefdda000 : new rpc_count 1 00000100:00000040:2.0:1783144441.955550:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeede0450 x1869759481778560/t0(0) o400->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:552/0 lens 224/0 e 0 to 0 dl 1783144452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144441.955553:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29cab7ad80 x1869759481778816 msgsize 224 00000100:00100000:0.0:1783144441.955554:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778688 00000100:00100000:0.0:1783144441.955569:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778688 00000020:00000040:0.0:1783144441.955578:0:66114:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048fd8 00000100:00100000:3.0:1783144441.955580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00000040:0.0:1783144441.955586:0:66114:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefa79000 refcount=51 00000100:00100000:2.0:1783144441.955592:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481778560:12345-192.168.203.4@tcp:400:kworker.0 00000020:00000040:0.0:1783144441.955604:0:66114:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2aee5919c0) now 14 - evictor 00010000:00000040:2.0:1783144441.955613:0:94189:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759481778560 00000100:00000040:2.0:1783144441.955624:0:94189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144441.955637:0:94189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144441.955638:0:66114:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783144441.955662:0:66114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778816 00000100:00100000:0.0:1783144441.955667:0:66114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778816 00000020:00000040:0.0:1783144441.955669:0:66114:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a4230485f2 00000020:00000040:0.0:1783144441.955673:0:66114:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac7fb4000 refcount=11 00000100:00080000:3.0:1783144441.955679:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1783144441.955685:0:66114:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c2ac6ddb380) now 10 - evictor 00000020:00000040:3.0:1783144441.955695:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2aee5919c0) now 14 - evictor 00000100:00000040:2.0:1783144441.955701:0:94189:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 8 to 192.168.203.4@tcp 00000100:00080000:3.0:1783144441.955705:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1783144441.955708:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c2ac6ddb380) now 10 - evictor 00000100:00000040:2.0:1783144441.955754:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeede0450 x1869759481778560/t0(0) o400->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:552/0 lens 224/224 e 0 to 0 dl 1783144452 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144441.955767:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481778560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 183us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144441.955776:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:3.0:1783144441.955782:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 901 00000100:00000040:2.0:1783144441.955783:0:94189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefdda000 : new rpc_count 0 00000100:00000040:3.0:1783144441.955792:0:66113:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefa79000 : new rpc_count 1 00000020:00000040:2.0:1783144441.955803:0:94189:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefdda000 : new refcount 9 00000100:00000040:3.0:1783144441.955807:0:66113:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29cab7aa00 x1869759481778688/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:552/0 lens 224/0 e 0 to 0 dl 1783144452 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144441.955844:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2404:x1869759481778688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144441.955855:0:66114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 902 00000100:00000040:0.0:1783144441.955861:0:66114:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac7fb4000 : new rpc_count 1 00000100:00000040:0.0:1783144441.955868:0:66114:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29cab7ad80 x1869759481778816/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:552/0 lens 224/0 e 0 to 0 dl 1783144452 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783144441.955875:0:66113:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084434, transno 0, xid 1869759481778688 00000100:00100000:0.0:1783144441.955891:0:66114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2404:x1869759481778816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00000040:3.0:1783144441.955892:0:66113:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144441.955912:0:66113:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00010000:00000040:0.0:1783144441.955927:0:66114:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1869759481778816 00000100:00000040:0.0:1783144441.955940:0:66114:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144441.955946:0:66114:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144441.955964:0:66113:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144441.955976:0:66113:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab7aa00 x1869759481778688/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:552/0 lens 224/224 e 0 to 0 dl 1783144452 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144441.955980:0:66114:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 8 to 192.168.203.4@tcp 00000100:00100000:3.0:1783144441.956000:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2404:x1869759481778688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 164us (559us total) trans 0 rc 0/0 00000100:00000040:0.0:1783144441.956002:0:66114:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab7ad80 x1869759481778816/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:552/0 lens 224/224 e 0 to 0 dl 1783144452 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144441.956024:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 901 00000100:00100000:0.0:1783144441.956028:0:66114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2404:x1869759481778816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 143us (469us total) trans 0 rc 0/0 00000100:00000040:3.0:1783144441.956032:0:66113:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefa79000 : new rpc_count 0 00000020:00000040:3.0:1783144441.956056:0:66113:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefa79000 : new refcount 50 00000100:00100000:0.0:1783144441.956057:0:66114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 902 00000100:00000040:0.0:1783144441.956076:0:66114:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac7fb4000 : new rpc_count 0 00000020:00000040:0.0:1783144441.956090:0:66114:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac7fb4000 : new refcount 10 00000100:00000040:2.0:1783144441.956670:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01520e00 x1869759481778944 msgsize 520 00000100:00100000:2.0:1783144441.956678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00000040:2.0:1783144441.956754:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521f80 x1869759481779072 msgsize 224 00000100:00100000:2.0:1783144441.956760:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144441.956782:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481778944 00000100:00100000:2.0:1783144441.956786:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481778944 00000020:00000040:2.0:1783144441.956788:0:26139:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a4230491b4 00000100:00100000:2.0:1783144441.956807:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779072 00000100:00100000:2.0:1783144441.956810:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779072 00000020:00000040:2.0:1783144441.956812:0:26139:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048600 00000020:00000040:2.0:1783144441.956814:0:26139:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c443d000 refcount=7 00000020:00000040:2.0:1783144441.956822:0:26139:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c29c31e19c0) now 10 - evictor 00000100:00000040:2.0:1783144441.956836:0:26139:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1783144441.956850:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2113 00000100:00000040:2.0:1783144441.956852:0:26139:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c443d000 : new rpc_count 1 00000100:00000040:2.0:1783144441.956856:0:26139:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521f80 x1869759481779072/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:552/0 lens 224/0 e 0 to 0 dl 1783144452 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144441.956869:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481779072:12345-192.168.203.4@tcp:400:kworker.0 00010000:00000040:2.0:1783144441.956882:0:26139:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968831, transno 0, xid 1869759481779072 00000100:00000040:2.0:1783144441.956887:0:26139:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144441.956890:0:26139:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144441.956912:0:26139:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 8 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144441.956917:0:26139:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521f80 x1869759481779072/t0(0) o400->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:552/0 lens 224/224 e 0 to 0 dl 1783144452 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144441.956926:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2403:x1869759481779072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 59us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144441.956931:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2113 00000100:00000040:2.0:1783144441.956933:0:26139:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c443d000 : new rpc_count 0 00000020:00000040:2.0:1783144441.956941:0:26139:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c443d000 : new refcount 6 00000100:00100000:2.0:1783144441.956953:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5058 00000100:00000040:2.0:1783144441.956959:0:26139:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01520e00 x1869759481778944/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144441.956967:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2402:x1869759481778944:12345-192.168.203.4@tcp:8:kworker.0 00010000:00020000:2.0:1783144441.956986:0:26139:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783144441.957000:0:26139:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144441.957004:0:26139:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144441.957008:0:26139:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144441.957025:0:26139:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 8 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144441.957030:0:26139:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01520e00 x1869759481778944/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783144461 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144441.957039:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2402:x1869759481778944:12345-192.168.203.4@tcp:8:kworker.0 Request processed in 71us (368us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783144441.957046:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5058 00000100:00080000:2.0:1783144441.957103:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1783144441.957107:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c29c31e19c0) now 10 - evictor 00000020:01000004:3.0:1783144442.436369:0:96747:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783144442.436372:0:96747:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783144442.436374:0:96747:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783144442.436476:0:96747:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c29c496a800 00000020:01000004:3.0:1783144442.436489:0:96747:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783144442.436504:0:96747:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783144442.436515:0:96747:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c2af5d58000) 00000020:00000040:3.0:1783144442.436522:0:96747:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2afa976000 with handle 0xad8e53a423049f3d to hash 00000020:00000040:3.0:1783144442.436527:0:96747:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afa976000 : new refcount 1 00000020:00000040:3.0:1783144442.436536:0:96747:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c2af5d58000) now 2 - obd_device_list 00000020:00000080:3.0:1783144442.436540:0:96747:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000001:00000040:0.0:1783144442.683637:0:96747:0:(osd_compat.c:234:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:0.0:1783144442.686995:0:96747:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783144442.687169:0:96747:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783144442.687184:0:96747:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783144442.687198:0:96747:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783144442.687212:0:96747:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783144442.687225:0:96747:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783144442.687238:0:96747:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1783144442.688165:0:96747:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:0.0:1783144442.688363:0:96747:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c2af5d58000) now 3 - setup 00000020:00000080:0.0:1783144442.688367:0:96747:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783144442.688378:0:96747:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:0.0:1783144442.688384:0:96747:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2af9e44000 with handle 0xad8e53a423049f44 to hash 00000020:00000040:0.0:1783144442.688389:0:96747:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c2af5d58000) now 4 - export 00000020:00000040:0.0:1783144442.688392:0:96747:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e44000 : new refcount 1 00000020:00000080:0.0:1783144442.688395:0:96747:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad8e53a423049f44 00000020:00000040:0.0:1783144442.688397:0:96747:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f44 00000020:00000040:0.0:1783144442.688400:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e44000 refcount=2 00000020:01000004:0.0:1783144442.688404:0:96747:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783144442.688422:0:96747:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783144442.688425:0:96747:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783144442.688432:0:96747:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783144442.688459:0:96747:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783144442.688463:0:96747:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:0.0:1783144442.689082:0:96747:0:(genops.c:889:class_export_get()) GET export ffff9c2afa976000 refcount=2 00000040:00000040:0.0:1783144442.689087:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2ad3fe6480 : new refcount 2 00000040:00000040:0.0:1783144442.690131:0:96747:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c2ad3fe6480 : new refcount 1 00000040:01000000:0.0:1783144442.690141:0:96747:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 10000000:00000040:0.0:1783144442.690144:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2ad3fe6480 : new refcount 2 10000000:00000040:0.0:1783144442.690146:0:96747:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c2ad3fe6480 : new refcount 1 00000020:00000040:0.0:1783144442.690148:0:96747:0:(obd_config.c:994:class_incref()) incref MGC192.168.203.104@tcp (ffff9c2ac6dd99c0) now 6 - mgc_fs 00000020:01000004:0.0:1783144442.690175:0:96747:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1783144442.690178:0:96747:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783144442.690179:0:96747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783144442.690180:0:96747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144442.690181:0:96747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144442.690182:0:96747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144442.690183:0:96747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144442.690184:0:96747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783144442.690185:0:96747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144442.690186:0:96747:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783144442.690187:0:96747:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1783144442.690189:0:96747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783144442.690190:0:96747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783144442.690191:0:96747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144442.690191:0:96747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144442.690192:0:96747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144442.690192:0:96747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144442.690193:0:96747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783144442.690194:0:96747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144442.690194:0:96747:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:0.0:1783144442.690199:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 10000000:01000000:0.0:1783144442.690216:0:96747:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:0.0:1783144442.690230:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.690247:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501427712:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1783144442.690274:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.690294:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.690332:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeede2c50 x1869759501427712 msgsize 4848 00000100:00100000:0.0:1783144442.690335:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.690340:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.690359:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.690379:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fad80 going to sleep for 11 seconds 00000100:00100000:1.0:1783144442.690405:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427712 00000100:00100000:1.0:1783144442.690418:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427712 00000020:00000040:1.0:1783144442.690420:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:1.0:1783144442.690423:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=21 00000100:00000040:1.0:1783144442.690441:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783144442.690473:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00000040:1.0:1783144442.690477:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:1.0:1783144442.690483:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeede2c50 x1869759501427712/t0(0) o253->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 4848/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.690494:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:96747:x1869759501427712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783144442.690526:0:94185:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783144442.690528:0:94185:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783144442.690532:0:94185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1783144442.690763:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501427712 00000100:00000040:1.0:1783144442.690773:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:1.0:1783144442.690778:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.690807:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.690838:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:1.0:1783144442.690843:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeede2c50 x1869759501427712/t0(0) o253->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 4848/4768 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.690853:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:96747:x1869759501427712:12345-0@lo:253:mount.lustre.0 Request processed in 359us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144442.690860:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00000040:1.0:1783144442.690863:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:1.0:1783144442.690873:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 20 00000100:00000040:0.0:1783144442.690874:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.690887:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.690895:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501427712:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1783144442.690903:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783144442.690912:0:96747:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783144442.690914:0:96747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783144442.690915:0:96747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783144442.690917:0:96747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783144442.690918:0:96747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783144442.690919:0:96747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783144442.690920:0:96747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783144442.690921:0:96747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783144442.690922:0:96747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783144442.690923:0:96747:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:0.0:1783144442.690926:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501427712/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.690936:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000020:01000004:0.0:1783144442.690947:0:96747:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c29c496a800 from lustre-OST0000 10000000:01000000:0.0:1783144442.690961:0:96747:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783144442.690963:0:96747:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:0.0:1783144442.690969:0:96747:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff9c2aeed85e00) refs 5 10000000:01000000:0.0:1783144442.690971:0:96747:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c2ac6dd99c0 local copy 00000020:00000040:0.0:1783144442.690974:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2af043e600 refcount=2 00010000:00010000:0.0:1783144442.690980:0:96747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:0.0:1783144442.691002:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2acad0bd80 : new refcount 2 10000000:00000040:0.0:1783144442.691004:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2ad3fe6480 : new refcount 2 10000000:00000040:0.0:1783144442.691005:0:96747:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.104@tcp: copy local log lustre-sptlrpc 00000020:00000040:0.0:1783144442.691025:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.691027:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.691038:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.691044:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501427840:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783144442.691053:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.691057:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.691069:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeede3050 x1869759501427840 msgsize 512 00000100:00100000:0.0:1783144442.691073:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.691075:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.691092:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.691107:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1783144442.691129:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427840 00000100:00100000:2.0:1783144442.691135:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427840 00000020:00000040:2.0:1783144442.691137:0:94183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144442.691146:0:94183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=21 00000100:00000040:2.0:1783144442.691157:0:94183:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144442.691234:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00000040:2.0:1783144442.691237:0:94183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144442.691242:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeede3050 x1869759501427840/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 512/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.691254:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:96747:x1869759501427840:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783144442.691267:0:94183:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:2.0:1783144442.691270:0:94183:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:2.0:1783144442.691304:0:94183:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:2.0:1783144442.691308:0:94183:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501427840 00000100:00000040:2.0:1783144442.691313:0:94183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:2.0:1783144442.691317:0:94183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.691333:0:94183:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.691361:0:94183:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144442.691366:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeede3050 x1869759501427840/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 512/272 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.691375:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:96747:x1869759501427840:12345-0@lo:501:mount.lustre.0 Request processed in 123us (303us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783144442.691381:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00000040:2.0:1783144442.691384:0:94183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:2.0:1783144442.691390:0:94183:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 20 00000100:00000040:0.0:1783144442.691444:0:96747:0:(client.c:1496:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.691450:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.691455:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.691459:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501427840:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783144442.691463:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.691473:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.691476:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501427840/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.691480:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:01000000:0.0:1783144442.691484:0:96747:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783144442.691496:0:96747:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:0.0:1783144442.691499:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2af043e600 refcount=3 00010000:00010000:0.0:1783144442.691502:0:96747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.691509:0:96747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144442.691530:0:96747:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c29c496a800 10000000:01000000:0.0:1783144442.691535:0:96747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:0.0:1783144442.691539:0:96747:0:(genops.c:889:class_export_get()) GET export ffff9c2ac6d97000 refcount=18 10000000:00000040:0.0:1783144442.691542:0:96747:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff9c2af0730c00) refs 4 10000000:01000000:0.0:1783144442.691544:0:96747:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783144442.691546:0:96747:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1783144442.691548:0:96747:0:(genops.c:889:class_export_get()) GET export ffff9c2ac6d97000 refcount=19 10000000:01000000:0.0:1783144442.691552:0:96747:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783144442.691555:0:96747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:0.0:1783144442.691558:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00010000:00000040:0.0:1783144442.691569:0:96747:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2afa089c00 count: 8 00000020:00000040:0.0:1783144442.691575:0:96747:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c29ca7f6a00 with handle 0xad8e53a423049f4b to hash 00010000:00010000:0.0:1783144442.691580:0:96747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.691587:0:96747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.691601:0:96747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.691612:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.691622:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501427968:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783144442.691639:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.691645:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.691661:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeede1450 x1869759501427968 msgsize 328 00000100:00100000:0.0:1783144442.691665:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.691666:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.691692:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.691703:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1783144442.691759:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501427968 00000100:00100000:3.0:1783144442.691764:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501427968 00000020:00000040:3.0:1783144442.691766:0:94189:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.691768:0:94189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=21 00000100:00000040:3.0:1783144442.691780:0:94189:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783144442.691805:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00000040:3.0:1783144442.691808:0:94189:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.691813:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeede1450 x1869759501427968/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.691833:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+21:96747:x1869759501427968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144442.691840:0:94189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1783144442.691847:0:94189:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2ac676c000 count: 10 00000020:00000040:3.0:1783144442.691859:0:94189:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2afcbe8800 with handle 0xad8e53a423049f52 to hash 00010000:00010000:3.0:1783144442.691863:0:94189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423049f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049f4b expref: -99 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691871:0:94189:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c29c5721800 : new locks_count 16 00000020:00000040:3.0:1783144442.691873:0:94189:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=22 00010000:00000040:3.0:1783144442.691886:0:94189:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c2ac676c000) refcount = 10 00010000:00000040:3.0:1783144442.691898:0:94189:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783144442.691902:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f35800/0xad8e53a42304955e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049557 expref: 22 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691909:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2afcbe8c00/0xad8e53a423049534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304952d expref: 22 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691916:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a423049526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304951f expref: 22 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691922:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f35600/0xad8e53a423049518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049511 expref: 22 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691928:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af043fe00/0xad8e53a42304950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049503 expref: 22 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691934:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230494fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494f5 expref: 22 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691940:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f34200/0xad8e53a4230494ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494e7 expref: 22 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691949:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af043f600/0xad8e53a4230494e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dd0 expref: 9 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.691955:0:94189:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc9 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.691968:0:94189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423049f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049f4b expref: 22 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.691979:0:94189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423049f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049f4b expref: 22 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.691987:0:94189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe8800, rc 0) 00010000:00000040:3.0:1783144442.691989:0:94189:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501427968 00000100:00000040:3.0:1783144442.691994:0:94189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.691997:0:94189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.692014:0:94189:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.692038:0:94189:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.692043:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeede1450 x1869759501427968/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/344 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.692052:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501427968:12345-0@lo:101:mount.lustre.0 Request processed in 220us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.692059:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00000040:3.0:1783144442.692061:0:94189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000100:00000040:0.0:1783144442.692069:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783144442.692070:0:94189:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 21 00000100:00000040:0.0:1783144442.692083:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.692091:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501427968:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783144442.692098:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.692107:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f6a00 refcount=4 00010000:00000040:0.0:1783144442.692111:0:96747:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c29ca7f6a00, remote cookie: 0xad8e53a423049f52, flags: 0x0 00010000:00000040:0.0:1783144442.692116:0:96747:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c2afa089c00) refcount = 8 00010000:00000040:0.0:1783144442.692123:0:96747:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783144442.692126:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.692132:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049534 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.692138:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049526 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.692144:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049518 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.692150:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304950a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.692156:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.692161:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.692168:0:96747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f52 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.692176:0:96747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049f52 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.692186:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501427968/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.692194:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:00000040:0.0:1783144442.692199:0:96747:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff9c2b01424600) refs 2 00000020:00000040:0.0:1783144442.692207:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f6a00 refcount=3 10000000:00000040:0.0:1783144442.692223:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2acad0bd80 : new refcount 2 10000000:00000040:0.0:1783144442.692226:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2ad3fe6480 : new refcount 2 10000000:00000040:0.0:1783144442.692228:0:96747:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.104@tcp: copy local log lustre-OST0000 00000040:00080000:0.0:1783144442.692348:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783144442.692610:0:96747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783144442.694681:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783144442.694715:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783144442.694756:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783144442.694771:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783144442.694783:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783144442.694795:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783144442.694817:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783144442.694823:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:0.0:1783144442.694871:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.694876:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.694901:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.694913:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428096:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783144442.694933:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.694941:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.694969:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeede1050 x1869759501428096 msgsize 512 00000100:00100000:0.0:1783144442.694973:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.694975:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.695001:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.695025:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144442.695440:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428096 00000100:00100000:1.0:1783144442.695446:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428096 00000020:00000040:1.0:1783144442.695449:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:1.0:1783144442.695453:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=22 00000100:00000040:1.0:1783144442.695474:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783144442.695498:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00000040:1.0:1783144442.695502:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:1.0:1783144442.695507:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeede1050 x1869759501428096/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 512/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.695519:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428096:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1783144442.695536:0:94185:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:1.0:1783144442.695539:0:94185:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:1.0:1783144442.695581:0:94185:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00000020:00000040:1.0:1783144442.695589:0:94185:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=23 00000020:00000040:1.0:1783144442.695592:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00010000:00000040:1.0:1783144442.695595:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428096 00000100:00000040:1.0:1783144442.695602:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:1.0:1783144442.695606:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.695623:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.695707:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144442.695712:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.695715:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeede1050 x1869759501428096/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 512/272 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.695747:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428096:12345-0@lo:501:mount.lustre.0 Request processed in 227us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144442.695757:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00000040:1.0:1783144442.695762:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:1.0:1783144442.695772:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 21 00000100:00000040:0.0:1783144442.695773:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.695784:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428096:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783144442.695792:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.695803:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.695807:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428096/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.695815:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.695822:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.695826:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.695837:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.695844:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428224:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1783144442.695867:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.695874:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.695889:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca5f9050 x1869759501428224 msgsize 272 00000100:00100000:0.0:1783144442.695893:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.695895:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.695912:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.695931:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783144442.695943:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428224 00000100:00100000:3.0:1783144442.695948:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428224 00000020:00000040:3.0:1783144442.695950:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.695953:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=22 00000100:00000040:3.0:1783144442.695965:0:94188:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783144442.695989:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00000040:3.0:1783144442.695992:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.695997:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca5f9050 x1869759501428224/t0(0) o503->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.696015:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428224:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1783144442.696033:0:94188:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:3.0:1783144442.696065:0:94188:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:3.0:1783144442.696068:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428224 00000100:00000040:3.0:1783144442.696073:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.696078:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.696097:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.696122:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.696126:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca5f9050 x1869759501428224/t0(0) o503->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8416 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.696135:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428224:12345-0@lo:503:mount.lustre.0 Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.696141:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00000040:3.0:1783144442.696152:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:3.0:1783144442.696158:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 21 00000100:00000040:0.0:1783144442.696412:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.696432:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.696439:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428224:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1783144442.696444:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.696454:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428224/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.696469:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.696474:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:0.0:1783144442.696798:0:96747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1783144442.696839:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.696844:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.696857:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.696867:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428352:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783144442.696887:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.696895:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.696910:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca5fb050 x1869759501428352 msgsize 272 00000100:00100000:0.0:1783144442.696912:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.696914:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.696927:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.696939:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1783144442.696962:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428352 00000100:00100000:2.0:1783144442.696967:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428352 00000020:00000040:2.0:1783144442.696969:0:94183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144442.696972:0:94183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=22 00000100:00000040:2.0:1783144442.696984:0:94183:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144442.697013:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00000040:2.0:1783144442.697016:0:94183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144442.697021:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca5fb050 x1869759501428352/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.697032:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428352:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783144442.697051:0:94183:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:2.0:1783144442.697385:0:94183:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:2.0:1783144442.697389:0:94183:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428352 00000100:00000040:2.0:1783144442.697395:0:94183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:2.0:1783144442.697398:0:94183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.697417:0:94183:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.697438:0:94183:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144442.697442:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca5fb050 x1869759501428352/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8472 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.697451:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428352:12345-0@lo:502:mount.lustre.0 Request processed in 420us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.697458:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00000040:2.0:1783144442.697461:0:94183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000100:00000040:0.0:1783144442.697469:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.697470:0:94183:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 21 00000100:00000040:0.0:1783144442.697496:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.697504:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428352:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783144442.697510:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.697521:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428352/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.697536:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.697541:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:0.0:1783144442.697669:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783144442.697694:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783144442.697709:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783144442.697867:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783144442.697886:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783144442.697901:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783144442.697916:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783144442.697930:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783144442.697945:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1783144442.697959:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1783144442.697974:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1783144442.697988:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:0.0:1783144442.697996:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.698000:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.698014:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.698023:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428480:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783144442.698043:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.698055:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.698073:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca5f8050 x1869759501428480 msgsize 272 00000100:00100000:0.0:1783144442.698078:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.698079:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.698099:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.698120:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c26fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1783144442.698502:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428480 00000100:00100000:1.0:1783144442.698519:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428480 00000020:00000040:1.0:1783144442.698522:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:1.0:1783144442.698525:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=22 00000100:00000040:1.0:1783144442.698536:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783144442.698560:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00000040:1.0:1783144442.698563:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:1.0:1783144442.698567:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca5f8050 x1869759501428480/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.698580:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428480:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1783144442.698597:0:94185:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:1.0:1783144442.698625:0:94185:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:1.0:1783144442.698629:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428480 00000100:00000040:1.0:1783144442.698690:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:1.0:1783144442.698696:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.698713:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.698755:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:1.0:1783144442.698760:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca5f8050 x1869759501428480/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8472 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.698770:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428480:12345-0@lo:502:mount.lustre.0 Request processed in 191us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144442.698776:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00000040:1.0:1783144442.698779:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:1.0:1783144442.698785:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 21 00000100:00000040:0.0:1783144442.698811:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.698822:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.698830:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428480:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783144442.698837:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.698848:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428480/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.698863:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.698869:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:0.0:1783144442.698891:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1783144442.698899:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:0.0:1783144442.699087:0:96747:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c2acad0bd80 : new refcount 1 00000020:00000040:0.0:1783144442.699092:0:96747:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:0.0:1783144442.699408:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783144442.699415:0:96751:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783144442.699422:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783144442.699424:0:96751:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783144442.699429:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783144442.699447:0:96751:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c2ad08d99c0) 00000020:00000040:0.0:1783144442.699454:0:96751:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2af71e4000 with handle 0xad8e53a423049f59 to hash 00000020:00000040:0.0:1783144442.699459:0:96751:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af71e4000 : new refcount 1 00000020:00000040:0.0:1783144442.699473:0:96751:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 2 - obd_device_list 00000020:00000080:0.0:1783144442.699478:0:96751:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:0.0:1783144442.699484:0:96751:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:0.0:1783144442.699487:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783144442.699552:0:96751:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c496a800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783144442.699559:0:96751:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:0.0:1783144442.699563:0:96751:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2ac752d000 with handle 0xad8e53a423049f60 to hash 00000020:00000040:0.0:1783144442.699567:0:96751:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c2af5d58000) now 5 - export 00000020:00000040:0.0:1783144442.699569:0:96751:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac752d000 : new refcount 1 00000020:00000080:0.0:1783144442.699571:0:96751:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad8e53a423049f60 00000020:00000040:0.0:1783144442.699573:0:96751:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f60 00000020:00000040:0.0:1783144442.699574:0:96751:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac752d000 refcount=2 00010000:00010000:0.0:1783144442.702785:0:96751:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:0.0:1783144442.702795:0:96751:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 788, crc32c 5823, adler 498, t10ip512 3539, t10ip4k 2571, t10crc512 569, t10crc4k 815 00002000:00000040:0.0:1783144442.702828:0:96751:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:0.0:1783144442.702889:0:96751:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968829: rc = 0 00000001:00000040:0.0:1783144442.702894:0:96751:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:0.0:1783144442.702902:0:96751:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968818, last_xid = 1869759500973184, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1783144442.702907:0:96751:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968818 srv lr: 4294968829 lx: 1869759500973184 gen 0 00000020:00000040:0.0:1783144442.702913:0:96751:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2ad085f000 with handle 0xad8e53a423049f67 to hash 00000020:00000040:0.0:1783144442.702931:0:96751:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085f000 refcount=3 00000020:00000040:0.0:1783144442.702936:0:96751:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 3 - export 00000001:00000040:0.0:1783144442.702940:0:96751:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:0.0:1783144442.702943:0:96751:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad085f000 : new refcount 2 00000001:00000040:0.0:1783144442.702949:0:96751:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968847, last_xid = 1869759501420928, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1783144442.702958:0:96751:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968847 srv lr: 4294968829 lx: 1869759501420928 gen 0 00000020:00000040:0.0:1783144442.702963:0:96751:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2ad085b000 with handle 0xad8e53a423049f6e to hash 00000020:00000040:0.0:1783144442.702973:0:96751:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085b000 refcount=3 00000020:00000040:0.0:1783144442.702976:0:96751:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 4 - export 00000001:00000040:0.0:1783144442.702978:0:96751:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:0.0:1783144442.702980:0:96751:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad085b000 : new refcount 2 00000001:00000040:0.0:1783144442.702986:0:96751:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:0.0:1783144442.702989:0:96751:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 2 00000001:00000040:0.0:1783144442.702992:0:96751:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef, last_transno = 4294968851, last_xid = 1869759481746432, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1783144442.702996:0:96751:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef idx: 3 lr: 4294968851 srv lr: 4294968829 lx: 1869759481746432 gen 0 00000020:00000040:0.0:1783144442.703002:0:96751:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2ad3866000 with handle 0xad8e53a423049f75 to hash 00000020:00000040:0.0:1783144442.703012:0:96751:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=3 00000020:00000040:0.0:1783144442.703014:0:96751:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 5 - export 00000001:00000040:0.0:1783144442.703016:0:96751:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 3 with UUID '3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef' added, generation 0 00000020:00000040:0.0:1783144442.703018:0:96751:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 2 00000001:00000004:0.0:1783144442.703022:0:96751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968851 00000001:00000040:0.0:1783144442.703058:0:96751:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968851: rc = 0 00000001:00000040:0.0:1783144442.703070:0:96751:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968851: rc = 0 00002000:00000040:0.0:1783144442.703084:0:96751:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:0.0:1783144442.703121:0:96751:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:0.0:1783144442.703176:0:96751:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:0.0:1783144442.703183:0:96751:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:0.0:1783144442.703190:0:96751:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:0.0:1783144442.703303:0:96751:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:0.0:1783144442.703318:0:96751:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:0.0:1783144442.703357:0:96751:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:0.0:1783144442.703377:0:96751:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:0.0:1783144442.703417:0:96751:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:0.0:1783144442.703457:0:96751:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:0.0:1783144442.703479:0:96751:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:0.0:1783144442.703629:0:96751:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:0.0:1783144442.703826:0:96751:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:3.0:1783144442.705616:0:96751:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 6 - setup 00000020:00000080:3.0:1783144442.705621:0:96751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783144442.705629:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144442.705634:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.705636:0:96751:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783144442.705640:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783144442.705642:0:96751:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1783144442.705644:0:96751:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144442.705646:0:96751:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783144442.705647:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783144442.705649:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.705650:0:96751:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783144442.705658:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144442.705661:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.705663:0:96751:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783144442.705665:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783144442.705667:0:96751:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783144442.705669:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144442.705671:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.705673:0:96751:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783144442.705675:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144442.705677:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.705679:0:96751:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783144442.705682:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783144442.705701:0:96751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144442.705703:0:96751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.705705:0:96751:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783144442.705708:0:96751:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783144442.705793:0:96747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783144442.705829:0:96747:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:0.0:1783144442.705851:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f6a00 refcount=3 00010000:00010000:0.0:1783144442.705857:0:96747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f52 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.705865:0:96747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f52 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144442.705871:0:96747:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9c29c496a800 from 1 10000000:01000000:0.0:1783144442.705873:0:96747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:0.0:1783144442.705878:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00010000:00000040:0.0:1783144442.705904:0:96747:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2af71ea800 count: 4 00000020:00000040:0.0:1783144442.705910:0:96747:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c29ca7f7a00 with handle 0xad8e53a423049f7c to hash 00010000:00010000:0.0:1783144442.705915:0:96747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7a00/0xad8e53a423049f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.705921:0:96747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7a00/0xad8e53a423049f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.705928:0:96747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7a00/0xad8e53a423049f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.705950:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.705972:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428608:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783144442.706001:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.706010:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.706050:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca5fa850 x1869759501428608 msgsize 328 00000100:00100000:0.0:1783144442.706056:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.706058:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.706092:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.706095:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428608 00000100:00100000:3.0:1783144442.706103:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428608 00000020:00000040:3.0:1783144442.706107:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.706110:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=22 00000100:00100000:0.0:1783144442.706124:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ad3f5a6c0 going to sleep for 11 seconds 00000100:00000040:3.0:1783144442.706128:0:94188:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783144442.706289:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00000040:3.0:1783144442.706294:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.706300:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca5fa850 x1869759501428608/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.706314:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:96747:x1869759501428608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144442.706325:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1783144442.706332:0:94188:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c29c3de4c00 count: 5 00000020:00000040:3.0:1783144442.706338:0:94188:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2afcbe9800 with handle 0xad8e53a423049f83 to hash 00010000:00010000:3.0:1783144442.706342:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9800/0xad8e53a423049f83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049f7c expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.706360:0:94188:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c29c5721800 : new locks_count 17 00000020:00000040:3.0:1783144442.706362:0:94188:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=23 00010000:00000040:3.0:1783144442.706377:0:94188:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9c29c3de4c00) refcount = 5 00010000:00000040:3.0:1783144442.706379:0:94188:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783144442.706385:0:94188:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2ac7517e00/0xad8e53a423049160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d67 expref: 9 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.706392:0:94188:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2aeed01a00/0xad8e53a423049105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490fe expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.706399:0:94188:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2ac7516e00/0xad8e53a4230490db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490d4 expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.706405:0:94188:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af5fe1800/0xad8e53a42304905d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049056 expref: 23 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.706410:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9800/0xad8e53a423049f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049f7c expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.706419:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9800/0xad8e53a423049f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049f7c expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.706427:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9800, rc 0) 00010000:00000040:3.0:1783144442.706430:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428608 00000100:00000040:3.0:1783144442.706439:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.706443:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.706463:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.706491:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.706496:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca5fa850 x1869759501428608/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/344 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.706517:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501428608:12345-0@lo:101:mount.lustre.0 Request processed in 205us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.706524:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00000040:3.0:1783144442.706527:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:3.0:1783144442.706535:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00000100:00000040:0.0:1783144442.706595:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.706606:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.706613:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428608:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783144442.706621:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.706629:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f7a00 refcount=4 00010000:00000040:0.0:1783144442.706633:0:96747:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c29ca7f7a00, remote cookie: 0xad8e53a423049f83, flags: 0x0 00010000:00000040:0.0:1783144442.706638:0:96747:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9c2af71ea800) refcount = 4 00010000:00000040:0.0:1783144442.706641:0:96747:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783144442.706643:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6f000/0xad8e53a4230490fe lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049105 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.706650:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af9f6e200/0xad8e53a4230490d4 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230490db expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.706666:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2aeed00000/0xad8e53a423049056 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304905d expref: -99 pid: 94177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.706673:0:96747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7a00/0xad8e53a423049f7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f83 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.706682:0:96747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7a00/0xad8e53a423049f7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049f83 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.706690:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428608/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.706698:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:00000040:0.0:1783144442.706705:0:96747:0:(mgc_request.c:108:config_log_get()) log params (ffff9c2b01425000) refs 2 00000020:00000040:0.0:1783144442.706707:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f7a00 refcount=3 10000000:00000040:0.0:1783144442.706755:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2acad0bd80 : new refcount 2 10000000:00000040:0.0:1783144442.706759:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2ad3fe6480 : new refcount 2 10000000:00000040:0.0:1783144442.706761:0:96747:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.104@tcp: copy local log params 00000040:00080000:0.0:1783144442.706893:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783144442.707077:0:96747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783144442.707251:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783144442.707276:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783144442.707305:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783144442.707310:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:0.0:1783144442.707340:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.707344:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.707360:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.707371:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428736:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783144442.707392:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.707398:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.707415:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca5fac50 x1869759501428736 msgsize 504 00000100:00100000:0.0:1783144442.707420:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.707422:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.707436:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.707454:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144442.707649:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428736 00000100:00100000:2.0:1783144442.707654:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428736 00000020:00000040:2.0:1783144442.707657:0:94183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144442.707660:0:94183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=23 00000100:00000040:2.0:1783144442.707675:0:94183:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144442.707700:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00000040:2.0:1783144442.707704:0:94183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144442.707710:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca5fac50 x1869759501428736/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 504/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.708597:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501428736:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783144442.708615:0:94183:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:2.0:1783144442.708618:0:94183:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:2.0:1783144442.708661:0:94183:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:2.0:1783144442.708667:0:94183:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428736 00000100:00000040:2.0:1783144442.708674:0:94183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:2.0:1783144442.708679:0:94183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.708703:0:94183:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.708745:0:94183:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144442.708751:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca5fac50 x1869759501428736/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 504/272 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.708761:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501428736:12345-0@lo:501:mount.lustre.0 Request processed in 168us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.708768:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00000040:2.0:1783144442.708771:0:94183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:2.0:1783144442.708780:0:94183:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00000100:00000040:0.0:1783144442.708799:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.708809:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.708816:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428736:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783144442.708825:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.708836:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.708840:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428736/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.708847:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.708856:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.708859:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.708872:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.708880:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428864:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1783144442.708905:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.708916:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.708932:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca5f9450 x1869759501428864 msgsize 272 00000100:00100000:0.0:1783144442.708937:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.708938:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.708956:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.708974:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428864 00000100:00100000:2.0:1783144442.708980:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428864 00000100:00100000:0.0:1783144442.708980:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce5b40 going to sleep for 11 seconds 00000020:00000040:2.0:1783144442.708984:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144442.708988:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=23 00000100:00000040:2.0:1783144442.709002:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144442.709028:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00000040:2.0:1783144442.709032:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144442.709037:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca5f9450 x1869759501428864/t0(0) o503->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.709048:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501428864:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1783144442.709074:0:94185:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:2.0:1783144442.709102:0:94185:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:2.0:1783144442.709105:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428864 00000100:00000040:2.0:1783144442.709110:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:2.0:1783144442.709114:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.709133:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.709249:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144442.709255:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca5f9450 x1869759501428864/t0(0) o503->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8416 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.709263:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca5f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501428864:12345-0@lo:503:mount.lustre.0 Request processed in 217us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.709270:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00000040:2.0:1783144442.709272:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000100:00000040:0.0:1783144442.709307:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.709316:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.709322:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428864:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1783144442.709329:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.709341:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428864/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.709357:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.709363:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:0.0:1783144442.709631:0:96747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1783144442.709668:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.709672:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.709685:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.709694:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428992:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783144442.709715:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.709763:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.709795:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aca4d1c50 x1869759501428992 msgsize 272 00000100:00100000:0.0:1783144442.709799:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.709801:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 62 buffers still posted 00000100:00000040:0.0:1783144442.709821:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.709840:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501428992 00000100:00100000:0.0:1783144442.709843:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783144442.709846:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501428992 00000020:00000040:3.0:1783144442.709850:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.709853:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000020:00000040:2.0:1783144442.709901:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00100000:3.0:1783144442.709960:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00000040:3.0:1783144442.709964:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.709969:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aca4d1c50 x1869759501428992/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.709981:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501428992:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1783144442.709998:0:94188:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:3.0:1783144442.710027:0:94188:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:3.0:1783144442.710030:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501428992 00000100:00000040:3.0:1783144442.710035:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.710040:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.710066:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.710087:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.710092:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aca4d1c50 x1869759501428992/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8472 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.710100:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aca4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501428992:12345-0@lo:502:mount.lustre.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.710117:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00000040:0.0:1783144442.710120:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.710121:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:3.0:1783144442.710132:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00000100:00000040:0.0:1783144442.710133:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.710198:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501428992:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783144442.710208:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.710220:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501428992/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.710234:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.710241:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:0.0:1783144442.710428:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783144442.710452:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783144442.710467:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783144442.710481:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783144442.710493:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:0.0:1783144442.710500:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144442.710503:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144442.710519:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.710539:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429120:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783144442.710558:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.710566:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.710584:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeed57450 x1869759501429120 msgsize 272 00000100:00100000:0.0:1783144442.710590:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.710592:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144442.710646:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.710658:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2af5ce5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783144442.710692:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501429120 00000100:00100000:2.0:1783144442.710696:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501429120 00000020:00000040:2.0:1783144442.710698:0:94189:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144442.710701:0:94189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=23 00000100:00000040:2.0:1783144442.710712:0:94189:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144442.710853:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00000040:2.0:1783144442.710856:0:94189:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144442.710862:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeed57450 x1869759501429120/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.710874:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501429120:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783144442.710890:0:94189:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:2.0:1783144442.710913:0:94189:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:2.0:1783144442.710921:0:94189:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501429120 00000100:00000040:2.0:1783144442.710926:0:94189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:2.0:1783144442.710931:0:94189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.710950:0:94189:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.710974:0:94189:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:2.0:1783144442.710979:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeed57450 x1869759501429120/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8472 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.710987:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501429120:12345-0@lo:502:mount.lustre.0 Request processed in 115us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.710992:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00000040:2.0:1783144442.710995:0:94189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:2.0:1783144442.711001:0:94189:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00000100:00000040:1.0:1783144442.711074:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.711085:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.711093:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429120:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783144442.711100:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.711117:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29ca0d4700 x1869759501429120/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.711129:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.711135:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:1.0:1783144442.711161:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783144442.711168:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:1.0:1783144442.711342:0:96747:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c2acad0bd80 : new refcount 1 00000020:00000040:1.0:1783144442.711347:0:96747:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:3.0:1783144442.711897:0:96755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144442.711905:0:96755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.711907:0:96755:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783144442.711913:0:96755:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c29c496a800 00000020:00000080:3.0:1783144442.711916:0:96755:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783144442.711925:0:96755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144442.711927:0:96755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.711928:0:96755:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783144442.711931:0:96755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783144442.711933:0:96755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.711935:0:96755:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783144442.711938:0:96755:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c29c496a800 00000020:00000080:3.0:1783144442.711940:0:96755:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783144442.711990:0:96755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783144442.711995:0:96755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783144442.711997:0:96755:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783144442.712000:0:96755:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:1.0:1783144442.712123:0:96747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783144442.712148:0:96747:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:1.0:1783144442.712169:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f7a00 refcount=3 00010000:00010000:1.0:1783144442.712176:0:96747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7a00/0xad8e53a423049f7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f83 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.712186:0:96747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7a00/0xad8e53a423049f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f83 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144442.712229:0:96747:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783144442.712232:0:96747:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c29c496a800 10000000:01000000:1.0:1783144442.712235:0:96747:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c29c496a800 10000000:01000000:1.0:1783144442.712240:0:96747:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:1.0:1783144442.712244:0:96747:0:(genops.c:889:class_export_get()) GET export ffff9c2ac6d97000 refcount=20 10000000:01000000:1.0:1783144442.712248:0:96747:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9c29c496a800 from 1 10000000:01000000:1.0:1783144442.712250:0:96747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:1.0:1783144442.712255:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00010000:00000040:1.0:1783144442.712268:0:96747:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2afa089c00 count: 9 00000020:00000040:1.0:1783144442.712275:0:96747:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2b02150000 with handle 0xad8e53a423049f8a to hash 00010000:00010000:1.0:1783144442.712294:0:96747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02150000/0xad8e53a423049f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.712313:0:96747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c2b02150000/0xad8e53a423049f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.712321:0:96747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c2b02150000/0xad8e53a423049f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783144442.712334:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.712344:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429248:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1783144442.712360:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.712367:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.712390:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2ac9232c50 x1869759501429248 msgsize 328 00000100:00100000:1.0:1783144442.712395:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783144442.712397:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783144442.712453:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.712474:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144442.712509:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501429248 00000100:00100000:3.0:1783144442.712514:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501429248 00000020:00000040:3.0:1783144442.712516:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.712519:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=23 00000100:00000040:3.0:1783144442.712533:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783144442.712555:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:3.0:1783144442.712559:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.712564:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2ac9232c50 x1869759501429248/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.712576:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:96747:x1869759501429248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783144442.712592:0:94185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1783144442.712599:0:94185:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2ac676c000 count: 11 00000020:00000040:3.0:1783144442.712607:0:94185:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2afcbe9200 with handle 0xad8e53a423049f91 to hash 00010000:00010000:3.0:1783144442.712611:0:94185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe9200/0xad8e53a423049f91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049f8a expref: -99 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712618:0:94185:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c29c5721800 : new locks_count 18 00000020:00000040:3.0:1783144442.712620:0:94185:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=24 00010000:00000040:3.0:1783144442.712634:0:94185:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c2ac676c000) refcount = 11 00010000:00000040:3.0:1783144442.712637:0:94185:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783144442.712641:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2afcbe8800/0xad8e53a423049f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049f4b expref: 24 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712648:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f35800/0xad8e53a42304955e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049557 expref: 24 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712654:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2afcbe8c00/0xad8e53a423049534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304952d expref: 24 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712661:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af5fe0a00/0xad8e53a423049526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304951f expref: 24 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712668:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f35600/0xad8e53a423049518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049511 expref: 24 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712675:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af043fe00/0xad8e53a42304950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049503 expref: 24 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712682:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2afcbe9e00/0xad8e53a4230494fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494f5 expref: 24 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712690:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f34200/0xad8e53a4230494ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230494e7 expref: 24 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712707:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af043f600/0xad8e53a4230494e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dd0 expref: 9 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.712713:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af6f34600/0xad8e53a4230494d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41dc9 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.712779:0:94185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe9200/0xad8e53a423049f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049f8a expref: 24 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.712791:0:94185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2afcbe9200/0xad8e53a423049f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049f8a expref: 24 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.712798:0:94185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2afcbe9200, rc 0) 00010000:00000040:3.0:1783144442.712800:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501429248 00000100:00000040:3.0:1783144442.712805:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.712809:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.712826:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.712879:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.712884:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2ac9232c50 x1869759501429248/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/344 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.712892:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429248:12345-0@lo:101:mount.lustre.0 Request processed in 318us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.712897:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:3.0:1783144442.712899:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:3.0:1783144442.712905:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00000040:1.0:1783144442.712945:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.712953:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.712959:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429248:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1783144442.712964:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.712972:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2b02150000 refcount=4 00010000:00000040:1.0:1783144442.712980:0:96747:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c2b02150000, remote cookie: 0xad8e53a423049f91, flags: 0x0 00010000:00000040:1.0:1783144442.712983:0:96747:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c2afa089c00) refcount = 9 00010000:00000040:1.0:1783144442.712986:0:96747:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783144442.712988:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6a00/0xad8e53a423049f4b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049f52 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.712994:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043e600/0xad8e53a423049557 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304955e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.712999:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043fa00/0xad8e53a42304952d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049534 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.713004:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043f400/0xad8e53a42304951f lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049526 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.713009:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043ee00/0xad8e53a423049511 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049518 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.713013:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2afcbe9600/0xad8e53a423049503 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a42304950a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.713018:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043fc00/0xad8e53a4230494f5 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494fc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.713022:0:96747:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c2af043e200/0xad8e53a4230494e7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a4230494ee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.713027:0:96747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c2b02150000/0xad8e53a423049f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f91 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.713034:0:96747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c2b02150000/0xad8e53a423049f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049f91 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783144442.713048:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588380 x1869759501429248/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.713055:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:00000040:1.0:1783144442.713059:0:96747:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff9c2af5dd0c00) refs 2 00000020:00000040:1.0:1783144442.713062:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2b02150000 refcount=3 10000000:00000040:1.0:1783144442.713081:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2acad0bd80 : new refcount 2 10000000:00000040:1.0:1783144442.713084:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2ad3fe6480 : new refcount 2 10000000:00000040:1.0:1783144442.713086:0:96747:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.104@tcp: copy local log lustre-client 00000040:00080000:1.0:1783144442.713178:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1783144442.713339:0:96747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783144442.713528:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783144442.713557:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783144442.713577:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783144442.713592:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783144442.713606:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783144442.713619:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783144442.713637:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783144442.713655:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783144442.713672:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783144442.713685:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783144442.713700:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783144442.713714:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783144442.713913:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783144442.713932:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783144442.713948:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783144442.713967:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783144442.713988:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783144442.714006:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783144442.714025:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783144442.714040:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783144442.714068:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783144442.714083:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783144442.714097:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783144442.714110:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783144442.714123:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1783144442.714135:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1783144442.714148:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1783144442.714160:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1783144442.714171:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1783144442.714182:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1783144442.714193:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1783144442.714205:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1783144442.714216:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1783144442.714230:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1783144442.714243:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1783144442.714255:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1783144442.714269:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1783144442.716901:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1783144442.716915:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:1.0:1783144442.716979:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.716985:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:1.0:1783144442.717017:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.717029:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429376:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1783144442.717051:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.717059:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.717092:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2ac9231450 x1869759501429376 msgsize 512 00000100:00100000:1.0:1783144442.717096:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783144442.717098:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783144442.717155:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.717190:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e240 going to sleep for 11 seconds 00000100:00100000:3.0:1783144442.717230:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501429376 00000100:00100000:3.0:1783144442.717236:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501429376 00000020:00000040:3.0:1783144442.717244:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.717248:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:3.0:1783144442.717266:0:94188:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783144442.717301:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1783144442.717304:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.717309:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2ac9231450 x1869759501429376/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 512/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.717321:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429376:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1783144442.717337:0:94188:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:3.0:1783144442.717340:0:94188:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:3.0:1783144442.717392:0:94188:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00000020:00000040:3.0:1783144442.717400:0:94188:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=25 00000020:00000040:3.0:1783144442.717404:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 24 00010000:00000040:3.0:1783144442.717409:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501429376 00000100:00000040:3.0:1783144442.717417:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.717422:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.717440:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.717508:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.717513:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2ac9231450 x1869759501429376/t0(0) o501->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 512/272 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.717523:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429376:12345-0@lo:501:mount.lustre.0 Request processed in 204us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.717530:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1783144442.717534:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:3.0:1783144442.717545:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00000040:1.0:1783144442.717596:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.717606:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.717613:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429376:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1783144442.717619:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.717629:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000100:00000040:1.0:1783144442.717633:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588380 x1869759501429376/t0(0) o501->MGC192.168.203.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.717640:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.717648:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.717651:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:1.0:1783144442.717662:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.717671:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429504:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1783144442.717694:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.717701:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.717717:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2ac9232850 x1869759501429504 msgsize 272 00000100:00100000:1.0:1783144442.717798:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783144442.717800:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783144442.717898:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.717926:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e240 going to sleep for 11 seconds 00000100:00100000:3.0:1783144442.717954:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501429504 00000100:00100000:3.0:1783144442.717958:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501429504 00000020:00000040:3.0:1783144442.717960:0:94189:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.717967:0:94189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:3.0:1783144442.717977:0:94189:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783144442.718029:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:3.0:1783144442.718032:0:94189:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.718036:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2ac9232850 x1869759501429504/t0(0) o503->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.718046:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429504:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1783144442.718064:0:94189:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:3.0:1783144442.718134:0:94189:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:3.0:1783144442.718138:0:94189:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501429504 00000100:00000040:3.0:1783144442.718142:0:94189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.718146:0:94189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.718164:0:94189:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.718187:0:94189:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.718191:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2ac9232850 x1869759501429504/t0(0) o503->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8416 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.718200:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429504:12345-0@lo:503:mount.lustre.0 Request processed in 155us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.718206:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:3.0:1783144442.718208:0:94189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:3.0:1783144442.718214:0:94189:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00000040:1.0:1783144442.718267:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.718277:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.718293:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429504:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1783144442.718299:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.718310:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588380 x1869759501429504/t0(0) o503->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.718324:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.718328:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:1.0:1783144442.718620:0:96747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1783144442.718666:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.718670:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:1.0:1783144442.718685:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.718693:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429632:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783144442.718714:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.718917:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.718935:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2ac9230850 x1869759501429632 msgsize 272 00000100:00100000:1.0:1783144442.718939:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783144442.718941:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783144442.718959:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.718979:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501429632 00000100:00100000:0.0:1783144442.718983:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501429632 00000020:00000040:0.0:1783144442.718985:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000100:00100000:1.0:1783144442.718988:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000020:00000040:0.0:1783144442.718988:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:0.0:1783144442.719002:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783144442.719026:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:0.0:1783144442.719029:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:0.0:1783144442.719034:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2ac9230850 x1869759501429632/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.719046:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429632:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783144442.719191:0:94185:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:0.0:1783144442.719223:0:94185:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:0.0:1783144442.719225:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501429632 00000100:00000040:0.0:1783144442.719230:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144442.719232:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.719249:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.719276:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144442.719292:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2ac9230850 x1869759501429632/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8472 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.719300:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429632:12345-0@lo:502:mount.lustre.0 Request processed in 257us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144442.719306:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:1.0:1783144442.719307:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.719309:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000100:00000040:1.0:1783144442.719316:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.719316:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00100000:1.0:1783144442.719322:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429632:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783144442.719328:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.719338:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588380 x1869759501429632/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.719351:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.719356:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:1.0:1783144442.719505:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783144442.719535:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783144442.719554:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783144442.719566:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783144442.719577:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783144442.719588:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783144442.719601:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783144442.719614:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783144442.719628:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783144442.719642:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783144442.719657:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783144442.719672:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783144442.719689:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783144442.719707:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783144442.719767:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783144442.719787:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783144442.719814:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783144442.719831:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783144442.719849:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783144442.719864:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783144442.719880:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783144442.719895:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783144442.719908:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783144442.719922:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783144442.719937:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1783144442.719954:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1783144442.719970:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1783144442.719980:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1783144442.719988:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1783144442.719995:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1783144442.720005:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1783144442.720013:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1783144442.720021:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1783144442.720029:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1783144442.720036:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1783144442.720043:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1783144442.720050:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1783144442.720058:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1783144442.720065:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1783144442.720076:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1783144442.720090:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1783144442.720104:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1783144442.720121:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1783144442.720129:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1783144442.720137:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1783144442.720145:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1783144442.720152:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1783144442.720158:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:1.0:1783144442.720167:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.720174:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:1.0:1783144442.720184:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.720191:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429760:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783144442.720206:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.720212:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.720227:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2ac9231050 x1869759501429760 msgsize 272 00000100:00100000:1.0:1783144442.720231:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783144442.720232:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783144442.720247:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.720264:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:3.0:1783144442.720325:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501429760 00000100:00100000:3.0:1783144442.720328:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501429760 00000020:00000040:3.0:1783144442.720329:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:3.0:1783144442.720332:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:3.0:1783144442.720340:0:94188:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783144442.720384:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:3.0:1783144442.720386:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:3.0:1783144442.720394:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2ac9231050 x1869759501429760/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.720402:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429760:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1783144442.720419:0:94188:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:3.0:1783144442.720439:0:94188:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:3.0:1783144442.720441:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501429760 00000100:00000040:3.0:1783144442.720445:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:3.0:1783144442.720447:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.720461:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.720479:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:3.0:1783144442.720485:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2ac9231050 x1869759501429760/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8472 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.720493:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429760:12345-0@lo:502:mount.lustre.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.720499:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:3.0:1783144442.720501:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000100:00000040:1.0:1783144442.720507:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783144442.720508:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00000040:1.0:1783144442.720515:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.720521:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429760:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783144442.720526:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.720536:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588380 x1869759501429760/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.720548:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.720552:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:1.0:1783144442.720634:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1783144442.720649:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:1.0:1783144442.720656:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1783144442.720672:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:1.0:1783144442.720683:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:1.0:1783144442.720693:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:1.0:1783144442.720703:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:1.0:1783144442.720712:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:1.0:1783144442.720744:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:1.0:1783144442.720762:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:1.0:1783144442.720774:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:1.0:1783144442.720787:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:1.0:1783144442.720800:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:1.0:1783144442.720808:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:1.0:1783144442.720812:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.720816:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:1.0:1783144442.720825:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.720831:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429888:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783144442.720846:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.720850:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.720861:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c2ac9230450 x1869759501429888 msgsize 272 00000100:00100000:1.0:1783144442.720864:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783144442.720865:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783144442.720880:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.720897:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19e300 going to sleep for 11 seconds 00000100:00100000:0.0:1783144442.720909:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501429888 00000100:00100000:0.0:1783144442.720913:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501429888 00000020:00000040:0.0:1783144442.720915:0:94184:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:0.0:1783144442.720918:0:94184:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:0.0:1783144442.720927:0:94184:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783144442.720948:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1783144442.720950:0:94184:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:0.0:1783144442.720954:0:94184:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2ac9230450 x1869759501429888/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.720962:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429888:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783144442.720977:0:94184:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c29c4a9d480 : new refcount 2 00000040:00000040:0.0:1783144442.720993:0:94184:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c29c4a9d480 : new refcount 1 00010000:00000040:0.0:1783144442.720995:0:94184:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501429888 00000100:00000040:0.0:1783144442.720998:0:94184:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:0.0:1783144442.721001:0:94184:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.721013:0:94184:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.721030:0:94184:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 51 to 0@lo 00000100:00000040:0.0:1783144442.721035:0:94184:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2ac9230450 x1869759501429888/t0(0) o502->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 272/8472 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.721049:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2ac9230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501429888:12345-0@lo:502:mount.lustre.0 Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00000040:1.0:1783144442.721053:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.721056:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1783144442.721058:0:94184:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000100:00000040:1.0:1783144442.721061:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.721063:0:94184:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00100000:1.0:1783144442.721079:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501429888:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783144442.721085:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.721095:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588380 x1869759501429888/t0(0) o502->MGC192.168.203.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.721107:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:1.0:1783144442.721113:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000040:00080000:1.0:1783144442.721134:0:96747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:1.0:1783144442.721143:0:96747:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:1.0:1783144442.721387:0:96747:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c2acad0bd80 : new refcount 1 00000020:00000040:1.0:1783144442.721392:0:96747:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:1.0:1783144442.721866:0:96758:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.203.104@tcp 192.168.203.104@tcp cnt=1 00000020:01000004:1.0:1783144442.721886:0:96758:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783144442.721899:0:96758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c29c4aeb380) 00000020:00000040:1.0:1783144442.721906:0:96758:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c29c3efe800 with handle 0xad8e53a423049f98 to hash 00000020:00000040:1.0:1783144442.721912:0:96758:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c3efe800 : new refcount 1 00000020:00000040:1.0:1783144442.721926:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c29c4aeb380) now 2 - obd_device_list 00000020:00000080:1.0:1783144442.721931:0:96758:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783144442.722105:0:96758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c496a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783144442.722110:0:96758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c29c496a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783144442.722112:0:96758:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c29c496a800 3 00000020:00000040:1.0:1783144442.722128:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c29c4aeb380) now 3 - import 00000020:00000040:1.0:1783144442.722132:0:96758:0:(genops.c:1244:class_import_put()) import ffff9c2ac91e6000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1783144442.722139:0:96758:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:1.0:1783144442.722141:0:96758:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 52 to 0@lo 00000100:00000040:1.0:1783144442.722143:0:96758:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.104@tcp -> ffff9c2aca4c0680 00010000:00080000:1.0:1783144442.722146:0:96758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ac91e6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1783144442.723943:0:96758:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:1.0:1783144442.724034:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c29c4aeb380) now 4 - setup 00000020:00000080:1.0:1783144442.724037:0:96758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783144442.724078:0:96758:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1783144442.724084:0:96758:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2af9da0000 with handle 0xad8e53a423049f9f to hash 00000020:00000040:1.0:1783144442.724089:0:96758:0:(genops.c:889:class_export_get()) GET export ffff9c2af9da0000 refcount=3 00000020:00000040:1.0:1783144442.724092:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c29c4aeb380) now 5 - export 00000020:00000040:1.0:1783144442.724095:0:96758:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9da0000 : new refcount 2 00000020:00000080:1.0:1783144442.724097:0:96758:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xad8e53a423049f9f 00000020:00000040:1.0:1783144442.724100:0:96758:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f9f 00000020:00000040:1.0:1783144442.724102:0:96758:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9da0000 refcount=3 00000100:00080000:1.0:1783144442.724109:0:96758:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1783144442.724113:0:96758:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 53 to 0@lo 00000020:00000040:1.0:1783144442.724116:0:96758:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f9f 00000020:00000040:1.0:1783144442.724117:0:96758:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9da0000 refcount=4 00000100:00000040:1.0:1783144442.724120:0:96758:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 54 to 0@lo 00000020:00000040:1.0:1783144442.724121:0:96758:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9da0000 : new refcount 3 00000100:00080000:1.0:1783144442.724125:0:96758:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2ac91e6000 using connection 192.168.203.104@tcp/0@lo 00000020:00000040:1.0:1783144442.724135:0:96758:0:(genops.c:1231:class_import_get()) import ffff9c2ac91e6000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:1.0:1783144442.724153:0:96758:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783144442.724166:0:96758:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000dd912d20] to pc [ptlrpcd_rcv+-1] req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144442.724184:0:96758:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:1.0:1783144442.724188:0:96758:0:(genops.c:1231:class_import_get()) import ffff9c2ac91e6000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1783144442.724208:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.724223:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501430016:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1783144442.724251:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783144452 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.724260:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.724295:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01523b80 x1869759501430016 msgsize 520 00000100:00100000:2.0:1783144442.724300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144442.724318:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783144452 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.724329:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:2.0:1783144442.724361:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430016 00000100:00100000:2.0:1783144442.724366:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430016 00000020:00000040:2.0:1783144442.724368:0:66947:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1783144442.724397:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00000040:2.0:1783144442.724409:0:66947:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01523b80 x1869759501430016/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783144462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.724419:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1869759501430016:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1783144442.724433:0:66947:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2aee5919c0) now 14 - find 00010000:00000040:2.0:1783144442.724442:0:66947:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1783144442.724448:0:66947:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 2977 last 0 00000020:00000040:2.0:1783144442.724455:0:66947:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2afab25000 with handle 0xad8e53a423049fa6 to hash 00000020:00000040:2.0:1783144442.724489:0:66947:0:(genops.c:889:class_export_get()) GET export ffff9c2afab25000 refcount=3 00000020:00000040:2.0:1783144442.724492:0:66947:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2aee5919c0) now 15 - export 00000020:00000040:2.0:1783144442.724495:0:66947:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afab25000 : new refcount 2 00000020:00000080:2.0:1783144442.724501:0:66947:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad8e53a423049fa6 00000020:00000040:2.0:1783144442.724503:0:66947:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049fa6 00000020:00000040:2.0:1783144442.724505:0:66947:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2afab25000 refcount=3 00000001:00000040:2.0:1783144442.724514:0:66947:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.104@tcp 00000100:00000040:3.0:1783144442.724517:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000001:00000040:2.0:1783144442.724518:0:66947:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 17 00000020:00000040:2.0:1783144442.724524:0:66947:0:(genops.c:889:class_export_get()) GET export ffff9c2afab25000 refcount=4 00000020:00000040:3.0:1783144442.724527:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c29c340b000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000001:00000040:2.0:1783144442.724528:0:66947:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 18 00000001:00000040:2.0:1783144442.724535:0:66947:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2ac31a8400) : new refcount 17 00000100:00000040:3.0:1783144442.724540:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:2.0:1783144442.724540:0:66947:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1783144442.724558:0:66947:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c2aeedc94e0 for nid 0@lo - ref 6 00000100:00000040:3.0:1783144442.724566:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000861d6947] to pc [ptlrpcd_00_03+3] req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.724568:0:66947:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2aee5919c0) now 16 - import 00000020:00000040:2.0:1783144442.724579:0:66947:0:(genops.c:1244:class_import_put()) import ffff9c2afab21000 refcount=1 obd=lustre-MDT0000 00000100:00000040:3.0:1783144442.724586:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144442.724586:0:66947:0:(genops.c:889:class_export_get()) GET export ffff9c2afab25000 refcount=5 00000100:00000040:2.0:1783144442.724590:0:66947:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c2afab25000 : new rpc_count 1 00000100:00000040:2.0:1783144442.724595:0:66947:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 55 to 0@lo 00000100:00000040:2.0:1783144442.724601:0:66947:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 55 to 0@lo 00000020:00000040:3.0:1783144442.724604:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c2af9ecb800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000020:00000040:2.0:1783144442.724605:0:66947:0:(genops.c:889:class_export_get()) GET export ffff9c2afab25000 refcount=6 00000100:00000040:2.0:1783144442.724613:0:66947:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:3.0:1783144442.724618:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783144442.724619:0:66947:0:(import.c:65:import_set_state_nolock()) ffff9c2afab21000 : changing import state from RECOVER to FULL 00000100:00000040:3.0:1783144442.724633:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000dabb08d8] to pc [ptlrpcd_00_00+0] req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.724633:0:66947:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afab25000 : new refcount 5 00000020:00000040:2.0:1783144442.724638:0:66947:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2aee5919c0) now 16 - find 00010000:00000040:2.0:1783144442.724652:0:66947:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501430016 00000100:00000040:3.0:1783144442.724658:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783144442.724661:0:66947:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000020:00000040:3.0:1783144442.724676:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c2af7208000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783144442.724677:0:66947:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.724689:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783144442.724700:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000020001701] to pc [ptlrpcd_00_01+1] req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.724701:0:66947:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783144452 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144442.724719:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783144442.724738:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783144442.724740:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783144442.724743:0:35504:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2975 00000100:00080000:3.0:1783144442.724746:0:35504:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1783144442.724749:0:35504:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:0.0:1783144442.724751:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.724752:0:66947:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 55 to 0@lo 00000100:00000040:3.0:1783144442.724754:0:35504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000020:00000040:3.0:1783144442.724759:0:35504:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042e9c 00000100:00000040:2.0:1783144442.724761:0:66947:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01523b80 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783144462 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783144442.724764:0:35504:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e41800 refcount=4 00000100:00000040:3.0:1783144442.724772:0:35504:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 55 to 0@lo 00000100:00000040:3.0:1783144442.724780:0:35504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00100000:0.0:1783144442.724783:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501430144:0@lo:400:kworker.0 00000020:00000040:3.0:1783144442.724786:0:35504:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e41800 : new refcount 3 00000100:00100000:2.0:1783144442.724787:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869759501430016:12345-0@lo:38:llog_process_th.0 Request processed in 365us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.724799:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00080000:3.0:1783144442.724803:0:35504:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2af9da2800 using connection 192.168.203.104@tcp/0@lo 00000100:00000040:2.0:1783144442.724804:0:66947:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2afab25000 : new rpc_count 0 00000100:00000040:0.0:1783144442.724807:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.724814:0:66947:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afab25000 : new refcount 4 00000020:00000040:3.0:1783144442.724815:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c2af9da2800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783144442.724819:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1783144442.724829:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144442.724839:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca0d6680 x1869759501430144 msgsize 224 00000100:00000040:2.0:1783144442.724851:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.724852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783144442.724853:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008ba51c72] to pc [ptlrpcd_rcv+-1] req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.724871:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.724882:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783144442.724884:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501430400:0@lo:400:kworker.0 00000100:00000040:0.0:1783144442.724889:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 4602 usecs (5 jiffies) 00000020:00000040:3.0:1783144442.724890:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c2ac5d51000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1783144442.724903:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144442.724904:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.724915:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.724934:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.724938:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000035c5439d] to pc [ptlrpcd_00_02+2] req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.724943:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501430272:0@lo:400:kworker.0 00000100:00000040:2.0:1783144442.724951:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521500 x1869759501430400 msgsize 224 00000100:00100000:2.0:1783144442.724957:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.724963:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.724973:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.724976:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783144442.724977:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783144442.724987:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c2aefa7c800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783144442.724991:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2779155 usecs (2780 jiffies) 00000100:00000040:0.0:1783144442.724991:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca0d4700 x1869759501430272 msgsize 224 00000100:00000040:3.0:1783144442.725001:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144442.725002:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783144442.725019:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cee0fbe1] to pc [ptlrpcd_00_03+3] req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725021:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430144 00000100:00000040:0.0:1783144442.725023:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725026:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430144 00000020:00000040:2.0:1783144442.725035:0:66143:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049175 00000020:00000040:2.0:1783144442.725041:0:66143:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2afcbbf800 refcount=5 00000100:00000040:3.0:1783144442.725051:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144442.725053:0:66143:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2aee5919c0) now 16 - evictor 00000020:00000040:3.0:1783144442.725062:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c2ad13c7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1783144442.725069:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 4243 usecs (5 jiffies) 00000100:00000040:3.0:1783144442.725073:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144442.725076:0:66143:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:3.0:1783144442.725092:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002ab48d5f] to pc [ptlrpcd_00_00+0] req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725098:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725099:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430272 00000100:00100000:2.0:1783144442.725104:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430272 00000020:00000040:2.0:1783144442.725109:0:66143:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042f36 00000100:00080000:3.0:1783144442.725111:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144442.725113:0:66143:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac9d63800 refcount=5 00000100:00100000:0.0:1783144442.725115:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501430784:0@lo:400:kworker.0 00000100:00080000:3.0:1783144442.725120:0:35504:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000020:00000040:2.0:1783144442.725123:0:66143:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c2ac6ddb380) now 10 - evictor 00000100:00080000:3.0:1783144442.725124:0:35504:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1783144442.725132:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144442.725138:0:35504:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2975 00000100:00080000:3.0:1783144442.725146:0:35504:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:0.0:1783144442.725149:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.725153:0:35504:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 55 to 0@lo 00000100:00000040:3.0:1783144442.725157:0:35504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000020:00000040:3.0:1783144442.725160:0:35504:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304901e 00000100:00100000:2.0:1783144442.725163:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000020:00000040:3.0:1783144442.725165:0:35504:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c4968000 refcount=4 00000100:00000040:0.0:1783144442.725165:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc5500 x1869759501430784 msgsize 224 00000100:00000040:2.0:1783144442.725167:0:66143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2afcbbf800 : new rpc_count 1 00000100:00000040:3.0:1783144442.725173:0:35504:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 55 to 0@lo 00000100:00000040:2.0:1783144442.725175:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca0d6680 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.725177:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783144442.725181:0:35504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000020:00000040:3.0:1783144442.725186:0:35504:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c4968000 : new refcount 3 00000100:00080000:3.0:1783144442.725193:0:35504:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c29c5a45800 using connection 192.168.203.104@tcp/0@lo 00000100:00000040:0.0:1783144442.725196:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725198:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501430144:12345-0@lo:400:kworker.0 00000020:00000040:3.0:1783144442.725203:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c29c5a45800 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783144442.725216:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 48430 usecs (49 jiffies) 00010000:00000040:2.0:1783144442.725217:0:66143:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501430144 00000100:00100000:3.0:1783144442.725220:0:35504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144442.725226:0:66143:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00100000:0.0:1783144442.725226:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1783144442.725236:0:66143:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.725237:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002586d35d] to pc [ptlrpcd_rcv+-1] req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725238:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.725256:0:66143:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.725269:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783144442.725273:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501430656:0@lo:400:kworker.0 00000100:00000040:2.0:1783144442.725290:0:66143:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000020:00000040:3.0:1783144442.725296:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c29c5a41800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1783144442.725296:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d6680 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725302:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.725312:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144442.725316:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759501430144:12345-0@lo:400:kworker.0 Request processed in 119us (472us total) trans 0 rc 0/0 00000100:00000040:0.0:1783144442.725328:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783144442.725333:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00000040:2.0:1783144442.725337:0:66143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2afcbbf800 : new rpc_count 0 00000100:00000040:3.0:1783144442.725340:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ccfbd41b] to pc [ptlrpcd_00_01+1] req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.725345:0:66143:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afcbbf800 : new refcount 4 00000100:00000040:0.0:1783144442.725348:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc7800 x1869759501430656 msgsize 224 00000100:00100000:2.0:1783144442.725354:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430784 00000100:00100000:2.0:1783144442.725359:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430784 00000100:00100000:0.0:1783144442.725360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783144442.725361:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783144442.725367:0:66143:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304917c 00000020:00000040:3.0:1783144442.725371:0:35504:0:(genops.c:1231:class_import_get()) import ffff9c2ad085c000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:2.0:1783144442.725371:0:66143:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2afcbba000 refcount=5 00000100:00000040:0.0:1783144442.725380:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.725383:0:35504:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144442.725400:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00000040:0.0:1783144442.725401:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 2072 usecs (3 jiffies) 00000100:00000040:2.0:1783144442.725405:0:66143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac9d63800 : new rpc_count 1 00000100:00000040:3.0:1783144442.725411:0:35504:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1308533] to pc [ptlrpcd_00_02+2] req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.725412:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca0d4700 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725424:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00100000:2.0:1783144442.725426:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501430272:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783144442.725433:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144442.725441:0:66143:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501430272 00000100:00000040:3.0:1783144442.725445:0:35504:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (2982) 00000100:00000040:2.0:1783144442.725449:0:66143:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:2.0:1783144442.725457:0:66143:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.725461:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.725468:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759501430144:0@lo:400:kworker.0 00000100:00000040:2.0:1783144442.725475:0:66143:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725477:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab79c00 x1869759501430144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.725499:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c29c340b000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1783144442.725503:0:66143:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00100000:0.0:1783144442.725507:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1783144442.725509:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca0d4700 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725518:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725520:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869759501430272:12345-0@lo:400:kworker.0 Request processed in 96us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.725536:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00000040:2.0:1783144442.725539:0:66143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac9d63800 : new rpc_count 0 00000100:00100000:0.0:1783144442.725540:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c20d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501431296:0@lo:400:kworker.0 00000020:00000040:2.0:1783144442.725547:0:66143:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac9d63800 : new refcount 4 00000100:00000040:0.0:1783144442.725556:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725560:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00000040:2.0:1783144442.725565:0:66143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2afcbba000 : new rpc_count 1 00000100:00000040:2.0:1783144442.725572:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc5500 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725573:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783144442.725586:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501430784:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783144442.725591:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc7b80 x1869759501431296 msgsize 224 00010000:00000040:2.0:1783144442.725597:0:66143:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501430784 00000100:00100000:0.0:1783144442.725597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144442.725606:0:66143:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:0.0:1783144442.725610:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.725620:0:66143:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.725627:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 1935 usecs (2 jiffies) 00000100:00000040:2.0:1783144442.725639:0:66143:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.725648:0:26147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430656 00000100:00100000:0.0:1783144442.725653:0:26147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430656 00000020:00000040:0.0:1783144442.725655:0:26147:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042ebf 00000020:00000040:0.0:1783144442.725658:0:26147:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e40000 refcount=5 00000100:00000040:2.0:1783144442.725663:0:66143:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000020:00000040:0.0:1783144442.725664:0:26147:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c29c31e19c0) now 10 - evictor 00000100:00000040:2.0:1783144442.725670:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5500 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725680:0:26147:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1783144442.725682:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759501430784:12345-0@lo:400:kworker.0 Request processed in 97us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.725690:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00000040:2.0:1783144442.725693:0:66143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2afcbba000 : new rpc_count 0 00000100:00000040:3.0:1783144442.725696:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000020:00000040:2.0:1783144442.725700:0:66143:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afcbba000 : new refcount 4 00000100:00000040:3.0:1783144442.725705:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.725708:0:26147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1783144442.725711:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501431296 00000100:00000040:0.0:1783144442.725715:0:26147:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af9e40000 : new rpc_count 1 00000100:00100000:2.0:1783144442.725716:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501431296 00000020:00000040:2.0:1783144442.725735:0:66143:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049183 00000020:00000040:2.0:1783144442.725738:0:66143:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af5ddc000 refcount=5 00000100:00000040:3.0:1783144442.725743:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725747:0:26147:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc7800 x1869759501430656/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.725748:0:66143:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1783144442.725752:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759501430784:0@lo:400:kworker.0 00000100:00100000:2.0:1783144442.725764:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00000040:3.0:1783144442.725765:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab7a300 x1869759501430784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.725770:0:66143:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af5ddc000 : new rpc_count 1 00000100:00100000:0.0:1783144442.725775:0:26147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501430656:12345-0@lo:400:kworker.0 00000020:00000040:3.0:1783144442.725777:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2aefa7c800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783144442.725779:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc7b80 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1783144442.725794:0:26147:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968829, transno 0, xid 1869759501430656 00000100:00100000:2.0:1783144442.725795:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501431296:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783144442.725804:0:26147:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00010000:00000040:2.0:1783144442.725808:0:66143:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501431296 00000100:00000040:0.0:1783144442.725811:0:26147:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.725816:0:66143:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 58 to 0@lo 00000100:00000040:2.0:1783144442.725821:0:66143:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.725833:0:26147:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.725840:0:66143:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725866:0:26147:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:2.0:1783144442.725868:0:66143:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:0.0:1783144442.725875:0:26147:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7800 x1869759501430656/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.725876:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7b80 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.725877:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1783144442.725884:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.725904:0:26147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759501430656:12345-0@lo:400:kworker.0 Request processed in 133us (551us total) trans 0 rc 0/0 00000100:00000040:3.0:1783144442.725915:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725917:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759501431296:12345-0@lo:400:kworker.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144442.725918:0:26147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00000040:0.0:1783144442.725925:0:26147:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af9e40000 : new rpc_count 0 00000100:00100000:3.0:1783144442.725935:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c20d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759501431296:0@lo:400:kworker.0 00000100:00100000:2.0:1783144442.725936:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000020:00000040:0.0:1783144442.725937:0:26147:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e40000 : new refcount 4 00000100:00000040:2.0:1783144442.725942:0:66143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af5ddc000 : new rpc_count 0 00000020:00000040:2.0:1783144442.725951:0:66143:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af5ddc000 : new refcount 4 00000100:00000040:3.0:1783144442.725952:0:3651:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968829 00000100:00000040:3.0:1783144442.725959:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.725963:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.725971:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430400 00000100:00100000:2.0:1783144442.725977:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430400 00000100:00000040:3.0:1783144442.725980:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.725981:0:23926:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048fd1 00000100:00100000:0.0:1783144442.725985:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501430912:0@lo:400:kworker.0 00000020:00000040:2.0:1783144442.725986:0:23926:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefa7e800 refcount=7 00000100:00100000:3.0:1783144442.725999:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1869759501430656:0@lo:400:kworker.0 00000100:00000040:2.0:1783144442.725999:0:23926:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:0.0:1783144442.726008:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.726009:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29c20d9180 x1869759501431296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.726019:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783144442.726022:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00000040:2.0:1783144442.726029:0:23926:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefa7e800 : new rpc_count 1 00000020:00000040:3.0:1783144442.726030:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2ad085c000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1783144442.726035:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521500 x1869759501430400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.726036:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc5c00 x1869759501430912 msgsize 224 00000100:00100000:0.0:1783144442.726049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144442.726056:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869759501430400:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783144442.726067:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144442.726069:0:23926:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 115964117002, transno 0, xid 1869759501430400 00000100:00000040:2.0:1783144442.726077:0:23926:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:2.0:1783144442.726083:0:23926:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.726087:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1836 usecs (2 jiffies) 00000100:00000040:3.0:1783144442.726091:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab78000 x1869759501430656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783144442.726102:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2ac5d51000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1783144442.726102:0:23926:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.726104:0:3648:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783144442.726118:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.726120:0:23926:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:2.0:1783144442.726128:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521500 x1869759501430400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.726136:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.726142:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869759501430400:12345-0@lo:400:kworker.0 Request processed in 88us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.726156:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:0.0:1783144442.726157:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1869759501430272:0@lo:400:kworker.0 00000100:00000040:2.0:1783144442.726159:0:23926:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefa7e800 : new rpc_count 0 00000100:00000040:0.0:1783144442.726167:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab78a80 x1869759501430272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.726175:0:23926:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefa7e800 : new refcount 6 00000020:00000040:0.0:1783144442.726177:0:3648:0:(genops.c:1244:class_import_put()) import ffff9c2af9ecb800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:2.0:1783144442.726184:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430912 00000100:00100000:2.0:1783144442.726189:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430912 00000100:00100000:0.0:1783144442.726189:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00000040:2.0:1783144442.726191:0:23926:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049017 00000020:00000040:2.0:1783144442.726195:0:23926:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af71e2000 refcount=5 00000100:00000040:0.0:1783144442.726197:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.726207:0:23926:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1783144442.726208:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c20d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501431168:0@lo:400:kworker.0 00000100:00000040:0.0:1783144442.726224:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.726230:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00000040:2.0:1783144442.726236:0:23926:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af71e2000 : new rpc_count 1 00000100:00000040:0.0:1783144442.726241:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.726243:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc5c00 x1869759501430912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.726256:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501430912:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783144442.726257:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc7480 x1869759501431168 msgsize 224 00000100:00100000:0.0:1783144442.726264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000040:2.0:1783144442.726267:0:23926:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501430912 00000100:00000040:2.0:1783144442.726273:0:23926:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:2.0:1783144442.726289:0:23926:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1783144442.726293:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501431168 00000100:00000040:0.0:1783144442.726294:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.726299:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501431168 00000020:00000040:3.0:1783144442.726304:0:26149:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049041 00000100:00000040:2.0:1783144442.726306:0:23926:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783144442.726309:0:26149:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac9d61800 refcount=5 00000100:00000040:0.0:1783144442.726311:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 3497 usecs (4 jiffies) 00000100:00000040:3.0:1783144442.726329:0:26149:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:2.0:1783144442.726330:0:23926:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:0.0:1783144442.726333:0:3648:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783144442.726338:0:23926:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5c00 x1869759501430912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.726341:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.726357:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1783144442.726359:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501430912:12345-0@lo:400:kworker.0 Request processed in 103us (319us total) trans 0 rc 0/0 00000100:00000040:3.0:1783144442.726364:0:26149:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac9d61800 : new rpc_count 1 00000100:00000040:0.0:1783144442.726370:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.726375:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc7480 x1869759501431168/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:553/0 lens 224/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.726375:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00000040:2.0:1783144442.726380:0:23926:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af71e2000 : new rpc_count 0 00000020:00000040:2.0:1783144442.726387:0:23926:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af71e2000 : new refcount 4 00000100:00100000:0.0:1783144442.726393:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501430912:0@lo:400:kworker.0 00000100:00100000:3.0:1783144442.726403:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501431168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783144442.726409:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000040:0.0:1783144442.726411:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab7b100 x1869759501430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783144442.726416:0:26149:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968832, transno 0, xid 1869759501431168 00000020:00000040:2.0:1783144442.726416:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c29c31e19c0) now 10 - evictor 00000100:00080000:2.0:1783144442.726422:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1783144442.726425:0:3648:0:(genops.c:1244:class_import_put()) import ffff9c2ad13c7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:2.0:1783144442.726426:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c2ac6ddb380) now 10 - evictor 00000100:00080000:2.0:1783144442.726431:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1783144442.726440:0:6517:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2aee5919c0) now 16 - evictor 00000100:00000040:3.0:1783144442.726475:0:26149:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:3.0:1783144442.726481:0:26149:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.726489:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.726499:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501430528:0@lo:8:kworker.0 00000100:00000040:3.0:1783144442.726505:0:26149:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.726520:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144462 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.726527:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.726534:0:26149:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:3.0:1783144442.726540:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7480 x1869759501431168/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:553/0 lens 224/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.726546:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501431168:12345-0@lo:400:kworker.0 Request processed in 149us (288us total) trans 0 rc 0/0 00000100:00000040:2.0:1783144442.726547:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01632c50 x1869759501430528 msgsize 520 00000100:00100000:2.0:1783144442.726554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144442.726556:0:3647:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1783144442.726565:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00000040:3.0:1783144442.726569:0:26149:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac9d61800 : new rpc_count 0 00000100:00000040:2.0:1783144442.726572:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144462 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783144442.726579:0:26149:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac9d61800 : new refcount 4 00000100:00000040:2.0:1783144442.726584:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2415 usecs (3 jiffies) 00000100:00000040:2.0:1783144442.726593:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.726596:0:3648:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968832 00000100:00100000:3.0:1783144442.726598:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501430528 00000100:00100000:3.0:1783144442.726605:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501430528 00000100:00000040:0.0:1783144442.726607:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.726608:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501431040:0@lo:8:kworker.0 00000020:00000040:3.0:1783144442.726609:0:26149:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042eaa 00000100:00000040:0.0:1783144442.726624:0:3648:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.726629:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144462 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.726639:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5059 00000100:00100000:0.0:1783144442.726644:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c20d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501431168:0@lo:400:kworker.0 00000100:00000040:3.0:1783144442.726648:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01632c50 x1869759501430528/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.726654:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.726659:0:3648:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29c20d8a80 x1869759501431168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.726668:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3647:x1869759501430528:12345-0@lo:8:kworker.0 00000100:00000040:2.0:1783144442.726673:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01523480 x1869759501431040 msgsize 520 00000100:00100000:2.0:1783144442.726677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:3.0:1783144442.726680:0:26149:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 7 - find 00010000:00000040:3.0:1783144442.726686:0:26149:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1783144442.726689:0:26149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2ad08d99c0) now 7 - find 00000100:00000040:2.0:1783144442.726692:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144462 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.726699:0:26149:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:2.0:1783144442.726702:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 3190 usecs (4 jiffies) 00000100:00000040:3.0:1783144442.726704:0:26149:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:3.0:1783144442.726711:0:26149:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783144442.726717:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000020:00000040:0.0:1783144442.726738:0:3648:0:(genops.c:1244:class_import_put()) import ffff9c29c5a41800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1783144442.726800:0:26149:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144462 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.726815:0:26149:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:3.0:1783144442.726819:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01632c50 x1869759501430528/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.726828:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3647:x1869759501430528:12345-0@lo:8:kworker.0 Request processed in 163us (279us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783144442.726835:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5059 00000100:00100000:3.0:1783144442.726981:0:26149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501431040 00000100:00100000:3.0:1783144442.726986:0:26149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501431040 00000020:00000040:3.0:1783144442.726988:0:26149:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304902c 00000100:00100000:3.0:1783144442.727018:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5060 00000100:00000040:3.0:1783144442.727022:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01523480 x1869759501431040/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.727028:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3647:x1869759501431040:12345-0@lo:8:kworker.0 00000020:00000040:3.0:1783144442.727034:0:26149:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 7 - find 00000100:00000040:2.0:1783144442.727050:0:3647:0:(client.c:3221:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1783144442.727058:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144442.727078:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000020:00000040:2.0:1783144442.727080:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f9f 00000020:00000040:2.0:1783144442.727082:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9da0000 refcount=4 00000100:00080000:2.0:1783144442.727088:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1783144442.727090:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9da0000 : new refcount 3 00000100:00080000:2.0:1783144442.727093:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783144442.727096:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ac91e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1783144442.727103:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144452 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.727109:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1869759501430016:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1783144442.727116:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588380 x1869759501430016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144452 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.727125:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c2ac91e6000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1783144442.727141:0:3647:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968818 00000100:00000040:2.0:1783144442.727145:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144442.727152:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144442.727156:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:2.0:1783144442.727160:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.727167:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501430528:0@lo:8:kworker.0 00000100:00000040:2.0:1783144442.727171:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab7b800 x1869759501430528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.727178:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c2af9da2800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00010000:00000040:3.0:1783144442.727215:0:26149:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000100:00000040:2.0:1783144442.727215:0:3649:0:(client.c:3107:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 115964117002 00000020:00000040:3.0:1783144442.727220:0:26149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2ad08d99c0) now 7 - find 00000100:00000040:2.0:1783144442.727223:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.727232:0:26149:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:2.0:1783144442.727236:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.727238:0:26149:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:3.0:1783144442.727247:0:26149:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1783144442.727255:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501430400:0@lo:400:kworker.0 00000100:00000040:2.0:1783144442.727261:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab79180 x1869759501430400/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.727268:0:26149:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144462 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.727271:0:3649:0:(genops.c:1244:class_import_put()) import ffff9c2af7208000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1783144442.727304:0:26149:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 56 to 0@lo 00000100:00000040:3.0:1783144442.727308:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01523480 x1869759501431040/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.727317:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3647:x1869759501431040:12345-0@lo:8:kworker.0 Request processed in 288us (642us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783144442.727323:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5060 00000100:00000040:2.0:1783144442.727421:0:3647:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968830 00000100:00000040:2.0:1783144442.727427:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144442.727433:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783144442.727436:0:3647:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:2.0:1783144442.727440:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.727447:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501431040:0@lo:8:kworker.0 00000100:00000040:2.0:1783144442.727452:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29cab79880 x1869759501431040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783144462 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.727459:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c29c5a45800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:3.0:1783144442.727525:0:96758:0:(genops.c:889:class_export_get()) GET export ffff9c2af9da0000 refcount=4 00000020:00000040:3.0:1783144442.727559:0:96758:0:(genops.c:889:class_export_get()) GET export ffff9c2af9da0000 refcount=5 00000100:00000040:3.0:1783144442.727613:0:96758:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.203.104@tcp 192.168.203.104@tcp cnt=1 00000020:01000004:3.0:1783144442.727632:0:96758:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783144442.727645:0:96758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c29c236b380) 00000020:00000040:3.0:1783144442.727651:0:96758:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2ae4b2a800 with handle 0xad8e53a423049fad to hash 00000020:00000040:3.0:1783144442.727655:0:96758:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ae4b2a800 : new refcount 1 00000020:00000040:3.0:1783144442.727665:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c29c236b380) now 2 - obd_device_list 00000020:00000080:3.0:1783144442.727669:0:96758:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:00000040:2.0:1783144442.727891:0:96760:0:(genops.c:889:class_export_get()) GET export ffff9c2af9da0000 refcount=6 00000020:00000040:2.0:1783144442.727895:0:96760:0:(genops.c:889:class_export_get()) GET export ffff9c2af9da0000 refcount=7 00000020:00000040:2.0:1783144442.727899:0:96760:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9da0000 : new refcount 6 00000020:01000004:3.0:1783144442.727966:0:96758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c29c496a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783144442.727971:0:96758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c29c496a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783144442.727974:0:96758:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9c29c496a800 3 00000020:00000040:3.0:1783144442.727990:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c29c236b380) now 3 - import 00000020:00000040:3.0:1783144442.727994:0:96758:0:(genops.c:1244:class_import_put()) import ffff9c2ad13c7000 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1783144442.728003:0:96758:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:3.0:1783144442.728006:0:96758:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 57 to 0@lo 00000100:00000040:3.0:1783144442.728009:0:96758:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.104@tcp -> ffff9c2aca4c0680 00010000:00080000:3.0:1783144442.728018:0:96758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2ad13c7000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1783144442.731353:0:96758:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:3.0:1783144442.731442:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c29c236b380) now 4 - setup 00000020:00000080:3.0:1783144442.731446:0:96758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783144442.731484:0:96758:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1783144442.731489:0:96758:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2ad06c4000 with handle 0xad8e53a423049fb4 to hash 00000020:00000040:3.0:1783144442.731495:0:96758:0:(genops.c:889:class_export_get()) GET export ffff9c2ad06c4000 refcount=3 00000020:00000040:3.0:1783144442.731498:0:96758:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c29c236b380) now 5 - export 00000020:00000040:3.0:1783144442.731502:0:96758:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad06c4000 : new refcount 2 00000020:00000080:3.0:1783144442.731504:0:96758:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xad8e53a423049fb4 00000020:00000040:3.0:1783144442.731507:0:96758:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049fb4 00000020:00000040:3.0:1783144442.731509:0:96758:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad06c4000 refcount=3 00000100:00080000:3.0:1783144442.731516:0:96758:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1783144442.731520:0:96758:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 58 to 0@lo 00000020:00000040:3.0:1783144442.731522:0:96758:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049fb4 00000020:00000040:3.0:1783144442.731523:0:96758:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad06c4000 refcount=4 00000100:00000040:3.0:1783144442.731525:0:96758:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 59 to 0@lo 00000020:00000040:3.0:1783144442.731527:0:96758:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad06c4000 : new refcount 3 00000100:00080000:3.0:1783144442.731529:0:96758:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c2ad13c7000 using connection 192.168.203.104@tcp/0@lo 00000020:00000040:3.0:1783144442.731541:0:96758:0:(genops.c:1231:class_import_get()) import ffff9c2ad13c7000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:3.0:1783144442.731560:0:96758:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783144442.731574:0:96758:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1308533] to pc [ptlrpcd_rcv+-1] req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783144442.731600:0:96758:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:3.0:1783144442.731602:0:96758:0:(genops.c:1231:class_import_get()) import ffff9c2ad13c7000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1783144442.731696:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.731712:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c20d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1869759501431424:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1783144442.731762:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783144452 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.731771:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144442.731806:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc5180 x1869759501431424 msgsize 520 00000100:00100000:0.0:1783144442.731812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144442.731832:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783144452 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.731844:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:3.0:1783144442.731920:0:66143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501431424 00000100:00100000:3.0:1783144442.731927:0:66143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501431424 00000020:00000040:3.0:1783144442.731929:0:66143:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:3.0:1783144442.731972:0:66143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00000040:3.0:1783144442.731978:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc5180 x1869759501431424/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783144462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.731988:0:66143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1869759501431424:12345-0@lo:38:llog_process_th.0 00000100:00000040:1.0:1783144442.731999:0:35504:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (2982) 00000020:00000040:3.0:1783144442.732000:0:66143:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c2ac6ddb380) now 10 - find 00010000:00000040:3.0:1783144442.732011:0:66143:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00000020:00000040:0.0:1783144442.732014:0:96758:0:(genops.c:889:class_export_get()) GET export ffff9c2ad06c4000 refcount=4 00010000:00080000:3.0:1783144442.732019:0:66143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 2977 last 0 00000020:00000040:0.0:1783144442.732025:0:96758:0:(genops.c:889:class_export_get()) GET export ffff9c2ad06c4000 refcount=5 00000020:00000040:3.0:1783144442.732028:0:66143:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2ac91e4800 with handle 0xad8e53a423049fbb to hash 00000020:00000040:1.0:1783144442.732035:0:96762:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad06c4000 : new refcount 4 00000020:00000040:3.0:1783144442.732058:0:66143:0:(genops.c:889:class_export_get()) GET export ffff9c2ac91e4800 refcount=3 00000020:00000040:3.0:1783144442.732063:0:66143:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c2ac6ddb380) now 11 - export 00000020:00000040:3.0:1783144442.732067:0:66143:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac91e4800 : new refcount 2 00000020:00000080:3.0:1783144442.732069:0:66143:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xad8e53a423049fbb 00000020:00000040:3.0:1783144442.732071:0:66143:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049fbb 00000020:00000040:3.0:1783144442.732073:0:66143:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac91e4800 refcount=3 00000001:00000040:3.0:1783144442.732082:0:66143:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.104@tcp 00000001:00000040:3.0:1783144442.732085:0:66143:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 18 00000020:00000040:3.0:1783144442.732088:0:66143:0:(genops.c:889:class_export_get()) GET export ffff9c2ac91e4800 refcount=4 00000001:00000040:3.0:1783144442.732090:0:66143:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 19 00000001:00000040:3.0:1783144442.732094:0:66143:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2ac31a8400) : new refcount 18 00000004:00100000:3.0:1783144442.732099:0:66143:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:0.0:1783144442.732099:0:96758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:00000040:3.0:1783144442.732108:0:66143:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c2af9d36120 for nid 0@lo - ref 4 00000020:00000040:3.0:1783144442.732117:0:66143:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c2ac6ddb380) now 12 - import 00000020:00000040:3.0:1783144442.732123:0:66143:0:(genops.c:1244:class_import_put()) import ffff9c2aee191800 refcount=1 obd=lustre-MDT0001 00000020:01000000:1.0:1783144442.732247:0:96747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:1.0:1783144442.732287:0:96747:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:1.0:1783144442.732333:0:96747:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2b02150000 refcount=3 00010000:00010000:1.0:1783144442.732347:0:96747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c2b02150000/0xad8e53a423049f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f91 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.732357:0:96747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c2b02150000/0xad8e53a423049f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049f91 expref: -99 pid: 96747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783144442.732405:0:96747:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783144442.732408:0:96747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144442.732409:0:96747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144442.732410:0:96747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144442.732412:0:96747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144442.732414:0:96747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144442.732415:0:96747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144442.732417:0:96747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144442.732418:0:96747:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783144442.732422:0:96747:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783144442.732425:0:96747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783144442.732426:0:96747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783144442.732428:0:96747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783144442.732430:0:96747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783144442.732431:0:96747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783144442.732432:0:96747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783144442.732433:0:96747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783144442.732434:0:96747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783144442.732435:0:96747:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:1.0:1783144442.732441:0:96747:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 10000000:01000000:1.0:1783144442.732453:0:96747:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:1.0:1783144442.732463:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.732474:0:96747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01588e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501431552:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1783144442.732490:0:96747:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.732498:0:96747:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.732519:0:96747:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c47c8c50 x1869759501431552 msgsize 4848 00000100:00100000:1.0:1783144442.732530:0:96747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783144442.732532:0:96747:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783144442.732549:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.732567:0:96747:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2aca19ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783144442.732613:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501431552 00000100:00100000:0.0:1783144442.732618:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501431552 00000020:00000040:0.0:1783144442.732620:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:0.0:1783144442.732623:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:0.0:1783144442.732639:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783144442.732659:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1783144442.732662:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:0.0:1783144442.732667:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c47c8c50 x1869759501431552/t0(0) o253->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 4848/0 e 0 to 0 dl 1783144453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.732679:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501431552:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783144442.732700:0:94185:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783144442.732710:0:94185:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000040:3.0:1783144442.732717:0:66143:0:(genops.c:889:class_export_get()) GET export ffff9c2ac91e4800 refcount=5 00000100:00000040:3.0:1783144442.732751:0:66143:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c2ac91e4800 : new rpc_count 1 00000100:00000040:3.0:1783144442.732757:0:66143:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 60 to 0@lo 00000100:00000040:3.0:1783144442.732760:0:66143:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 60 to 0@lo 00000020:00000040:3.0:1783144442.732763:0:66143:0:(genops.c:889:class_export_get()) GET export ffff9c2ac91e4800 refcount=6 00000100:00000040:3.0:1783144442.732769:0:66143:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00080000:3.0:1783144442.732781:0:66143:0:(import.c:65:import_set_state_nolock()) ffff9c2aee191800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1783144442.732785:0:66143:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac91e4800 : new refcount 5 00000020:00000040:3.0:1783144442.732789:0:66143:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c2ac6ddb380) now 12 - find 00010000:00000040:3.0:1783144442.732799:0:66143:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501431424 00000100:00000040:3.0:1783144442.732807:0:66143:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:3.0:1783144442.732813:0:66143:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.732889:0:66143:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783144452 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.732911:0:66143:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00000040:3.0:1783144442.732917:0:66143:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783144462 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144442.732926:0:66143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869759501431424:12345-0@lo:38:llog_process_th.0 Request processed in 938us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144442.732933:0:66143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00000040:3.0:1783144442.732936:0:66143:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac91e4800 : new rpc_count 0 00000020:00000040:3.0:1783144442.732943:0:66143:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac91e4800 : new refcount 4 00000100:00100000:2.0:1783144442.733931:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:2.0:1783144442.733936:0:3647:0:(client.c:3221:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1783144442.733942:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783144442.733959:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000020:00000040:2.0:1783144442.733961:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049fb4 00000020:00000040:2.0:1783144442.733964:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad06c4000 refcount=5 00000100:00080000:2.0:1783144442.733969:0:3647:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1783144442.733971:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad06c4000 : new refcount 4 00000100:00080000:2.0:1783144442.733974:0:3647:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783144442.733977:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2ad13c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1783144442.733983:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144452 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.733991:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c20d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1869759501431424:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1783144442.733996:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29c20d9180 x1869759501431424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783144452 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.734005:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c2ad13c7000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 20000000:01000000:0.0:1783144442.736782:0:94185:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783144442.736794:0:94185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783144442.736890:0:94186:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783144442.736895:0:94186:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:3.0:1783144442.736904:0:94186:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c29cd096200 count: 4 00000020:00000040:3.0:1783144442.736914:0:94186:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2afcbe8200 with handle 0xad8e53a423049fc2 to hash 00010000:00010000:3.0:1783144442.736921:0:94186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144442.736932:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501431552 00010000:00010000:3.0:1783144442.736937:0:94186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a42304908e expref: 24 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.736942:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00010000:00010000:3.0:1783144442.736951:0:94186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a4230490aa expref: 24 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.736952:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:3.0:1783144442.736964:0:94186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.736978:0:94186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.736986:0:94186:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c29cd096200) refcount = 4 00000100:00000040:0.0:1783144442.736987:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783144442.736992:0:94186:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783144442.736999:0:94186:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.737006:0:94186:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xad8e53a4230490aa expref: 24 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.737011:0:94186:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xad8e53a42304908e expref: 24 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783144442.737016:0:94186:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:3.0:1783144442.737019:0:94186:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.737021:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00000040:0.0:1783144442.737028:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c47c8c50 x1869759501431552/t0(0) o253->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 4848/4768 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.737035:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:96747:x1869759501431552:12345-0@lo:253:mount.lustre.0 Request processed in 4359us (4515us total) trans 0 rc 0/0 00000020:00000040:3.0:1783144442.737040:0:94186:0:(genops.c:1231:class_import_get()) import ffff9c2aefddf800 refcount=2 obd=MGS 00000100:00100000:0.0:1783144442.737042:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1783144442.737046:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:0.0:1783144442.737053:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00010000:00010000:3.0:1783144442.737058:0:94186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 9 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783144442.737117:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.737126:0:96747:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.737146:0:96747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01588e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:96747:1869759501431552:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1783144442.737154:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783144442.737164:0:96747:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783144442.737167:0:96747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783144442.737169:0:96747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783144442.737170:0:96747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783144442.737172:0:96747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783144442.737178:0:96747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783144442.737179:0:96747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783144442.737181:0:96747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783144442.737182:0:96747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783144442.737183:0:96747:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:2.0:1783144442.737187:0:96747:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01588e00 x1869759501431552/t0(0) o253->MGC192.168.203.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.737195:0:96747:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00000020:02000000:2.0:1783144442.737205:0:96747:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:2.0:1783144442.737325:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:2.0:1783144442.737338:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:2.0:1783144442.737376:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:2.0:1783144442.737405:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:2.0:1783144442.737433:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:2.0:1783144442.737459:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:2.0:1783144442.737478:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:2.0:1783144442.737500:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:2.0:1783144442.737528:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:2.0:1783144442.737576:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00010000:00010000:3.0:1783144442.737691:0:94186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 9 pid: 94188 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783144442.737704:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29c20db800 x1869759501431680/t0(0) o104->MGS@192.168.203.4@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144442.737715:0:94186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c20db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501431680:192.168.203.4@tcp:104: 00000100:00000040:3.0:1783144442.737759:0:94186:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9c29c20db800 x1869759501431680/t0(0) o104->MGS@192.168.203.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783144442.737778:0:94186:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000020:00000040:3.0:1783144442.737835:0:94186:0:(genops.c:1231:class_import_get()) import ffff9c29c5727800 refcount=2 obd=MGS 00010000:00010000:3.0:1783144442.737845:0:94186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a4230490aa expref: 23 pid: 94189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.737853:0:94186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a4230490aa expref: 23 pid: 94189 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783144442.737862:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29c20d8000 x1869759501431808/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144442.737870:0:94186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c20d8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501431808:0@lo:104: 00000100:00000040:3.0:1783144442.737882:0:94186:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9c29c20d8000 x1869759501431808/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783144442.737888:0:94186:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783144442.737904:0:94186:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20da300 x1869759501431808 msgsize 328 00000100:00100000:3.0:1783144442.737907:0:94186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783144442.737927:0:94186:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29c20d8000 x1869759501431808/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1783144442.737940:0:94186:0:(genops.c:1231:class_import_get()) import ffff9c29c5727800 refcount=3 obd=MGS 00000100:00100000:1.0:1783144442.737945:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501431808 00010000:00010000:3.0:1783144442.737950:0:94186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad8e53a42304908e expref: 23 pid: 94184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144442.737953:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501431808 00000020:00000040:1.0:1783144442.737958:0:10342:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a4230030b1 00010000:00010000:3.0:1783144442.737962:0:94186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad8e53a42304908e expref: 23 pid: 94184 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783144442.737963:0:10342:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac6d95000 refcount=3 00000100:00000040:3.0:1783144442.737975:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c29c20db100 x1869759501431936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144442.737983:0:94186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c20db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501431936:0@lo:104: 00000100:00000040:1.0:1783144442.737983:0:10342:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00000040:3.0:1783144442.737998:0:94186:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9c29c20db100 x1869759501431936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144442.738010:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00000040:3.0:1783144442.738014:0:94186:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.738018:0:10342:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac6d95000 : new rpc_count 1 00000100:00000040:1.0:1783144442.738025:0:10342:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20da300 x1869759501431808/t0(0) o104->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783144442.738029:0:94186:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20d9880 x1869759501431936 msgsize 328 00000100:00100000:3.0:1783144442.738039:0:94186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144442.738047:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:94186:x1869759501431808:12345-0@lo:104: 00000020:00000040:1.0:1783144442.738056:0:10342:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2aeed01e00 refcount=2 00000100:00000040:3.0:1783144442.738057:0:94186:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29c20db100 x1869759501431936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783144442.738071:0:94186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c29c37edc00 going to sleep for 11 seconds 00010000:00010000:1.0:1783144442.738124:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783144442.738367:0:3641:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c29c20db800 x1869759501431680/t0(0) o104->MGS@192.168.203.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783144442.738396:0:10342:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:1.0:1783144442.738403:0:10342:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.738419:0:10342:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9c29c20d8000 x1869759501431808/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783144442.738444:0:10342:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00010000:00010000:1.0:1783144442.738461:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:1.0:1783144442.738467:0:10342:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20da300 x1869759501431808/t0(0) o104->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783144442.738473:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29c20d8000 x1869759501431808/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144442.738483:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:94186:x1869759501431808:12345-0@lo:104: Request processed in 438us (574us total) trans 0 rc 0/0 00000100:00000040:2.0:1783144442.738492:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d8000 x1869759501431808/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783144442.738509:0:94186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c20d8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501431808:0@lo:104: 00000100:00100000:1.0:1783144442.738511:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00000040:1.0:1783144442.738517:0:10342:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac6d95000 : new rpc_count 0 00000020:00000040:1.0:1783144442.738526:0:10342:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac6d95000 : new refcount 2 00000100:00100000:1.0:1783144442.738534:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501431936 00000100:00100000:1.0:1783144442.738537:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501431936 00000020:00000040:1.0:1783144442.738539:0:10342:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a4230030b1 00000020:00000040:1.0:1783144442.738540:0:10342:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ac6d95000 refcount=3 00000100:00000040:1.0:1783144442.738546:0:10342:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:1.0:1783144442.738560:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00000040:1.0:1783144442.738562:0:10342:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ac6d95000 : new rpc_count 1 00000100:00000040:1.0:1783144442.738565:0:10342:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20d9880 x1869759501431936/t0(0) o104->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144442.738572:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:94186:x1869759501431936:12345-0@lo:104: 00000020:00000040:1.0:1783144442.738576:0:10342:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2aeed01800 refcount=2 00010000:00010000:1.0:1783144442.738579:0:10342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783144442.738587:0:10342:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:1.0:1783144442.738590:0:10342:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.738603:0:10342:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9c29c20db100 x1869759501431936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783144442.738623:0:10342:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00010000:00010000:1.0:1783144442.738636:0:10342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:3.0:1783144442.738640:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29c20db100 x1869759501431936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783144442.738644:0:10342:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d9880 x1869759501431936/t0(0) o104->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783144442.738663:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20db100 x1869759501431936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783144442.738663:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+3:94186:x1869759501431936:12345-0@lo:104: Request processed in 89us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144442.738675:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783144442.738680:0:94186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c20db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501431936:0@lo:104: 00000100:00000040:1.0:1783144442.738683:0:10342:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ac6d95000 : new rpc_count 0 00000020:00000040:1.0:1783144442.738691:0:10342:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ac6d95000 : new refcount 2 00010000:00010000:1.0:1783144442.738706:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783144442.738710:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.738716:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01e00 already unused, calling callback (ffffffffc1204c20) 00010000:00010000:0.0:1783144442.738768:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783144442.738775:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.738789:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2aeed01800 already unused, calling callback (ffffffffc1204c20) 10000000:00010000:0.0:1783144442.738792:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1783144442.738799:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2aeed01800 refcount=3 00010000:00010000:0.0:1783144442.738803:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783144442.738811:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783144442.738817:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:0.0:1783144442.738820:0:6508:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:0.0:1783144442.738823:0:6508:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:0.0:1783144442.738840:0:6508:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c2af5628400) refs 2 00000020:00000040:0.0:1783144442.738846:0:6508:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2aeed01800 with handle 0xad8e53a42304908e from hash 00000020:00000040:0.0:1783144442.738856:0:6508:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00010000:00010000:0.0:1783144442.738866:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.738872:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1783144442.738877:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144442.738883:0:6508:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8495596] to pc [ptlrpcd_00_03+3] req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783144442.738886:0:6509:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2aeed01e00 refcount=3 00010000:00010000:1.0:1783144442.738891:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783144442.738907:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783144442.738911:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:1.0:1783144442.738913:0:6509:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:1.0:1783144442.738915:0:6509:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:1.0:1783144442.738916:0:6509:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c29c31b8200) refs 2 00000020:00000040:1.0:1783144442.738920:0:6509:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2aeed01e00 with handle 0xad8e53a4230490aa from hash 00010000:00010000:0.0:1783144442.738923:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783144442.738925:0:6509:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00010000:00010000:0.0:1783144442.738937:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01800/0xad8e53a42304908e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a423049095 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.738938:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144442.738973:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144442.738975:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783144442.738977:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1783144442.738983:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783144442.738993:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783144442.738996:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501432064:0@lo:103:ldlm_bl.0 00000100:00000040:1.0:1783144442.739002:0:6509:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000004c996d3] to pc [ptlrpcd_00_00+0] req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.739013:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144442.739021:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:1.0:1783144442.739023:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783144442.739035:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20da680 x1869759501432064 msgsize 328 00010000:00010000:1.0:1783144442.739037:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9c2aeed01e00/0xad8e53a4230490aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad8e53a4230490b1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783144442.739046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000040:1.0:1783144442.739048:0:6509:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9c2af71eab00 count: 0 00010000:00010000:1.0:1783144442.739057:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144442.739058:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783144442.739061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1783144442.739065:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.739073:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432064 00000100:00100000:1.0:1783144442.739078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432064 00000020:00000040:1.0:1783144442.739081:0:6506:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:1.0:1783144442.739084:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:1.0:1783144442.739096:0:6506:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:1.0:1783144442.739101:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2af9f6fa00 refcount=4 00010000:00010000:1.0:1783144442.739106:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304908e expref: 24 pid: 94184 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144442.739128:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783144442.739134:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00000040:1.0:1783144442.739137:0:6506:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144442.739140:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144442.739144:0:6506:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20da680 x1869759501432064/t0(0) o103->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.739161:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2b01589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501432192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783144442.739167:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3651:x1869759501432064:12345-0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1783144442.739177:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783144442.739181:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1783144442.739186:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2af9f6fa00 refcount=4 00000100:00000040:2.0:1783144442.739195:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144442.739209:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01522a00 x1869759501432192 msgsize 328 00000100:00100000:2.0:1783144442.739213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144442.739239:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783144442.739247:0:6506:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c29cd096200 count: 5 00010000:00010000:1.0:1783144442.739254:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a42304908e expref: 24 pid: 94184 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.739266:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a42304908e expref: 24 pid: 94184 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144442.739267:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432192 00000100:00100000:2.0:1783144442.739271:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432192 00000020:00000040:2.0:1783144442.739275:0:10343:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144442.739289:0:10343:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=25 00000020:00000040:1.0:1783144442.739299:0:6506:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2af9f6fa00 with handle 0xad8e53a423049095 from hash 00000020:00000040:2.0:1783144442.739304:0:10343:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2aeed00200 refcount=4 00010000:00010000:2.0:1783144442.739310:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490aa expref: 25 pid: 94189 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783144442.739338:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00000040:2.0:1783144442.739340:0:10343:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 2 00000100:00000040:2.0:1783144442.739343:0:10343:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01522a00 x1869759501432192/t0(0) o103->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.739354:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+25:3649:x1869759501432192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783144442.739361:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2af9f6fa00/0xad8e53a423049095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a42304908e expref: 25 pid: 94184 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783144442.739364:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1783144442.739368:0:10343:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2aeed00200 refcount=4 00010000:00000040:2.0:1783144442.739372:0:10343:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c29cd096200 count: 6 00010000:00000040:1.0:1783144442.739373:0:6506:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9c29c5721800 : new locks_count 17 00010000:00010000:2.0:1783144442.739378:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad8e53a4230490aa expref: 25 pid: 94189 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783144442.739378:0:6506:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 24 00010000:00000040:1.0:1783144442.739386:0:6506:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9c2afcbe8200 00010000:00010000:1.0:1783144442.739390:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783144442.739394:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad8e53a4230490aa expref: 24 pid: 94189 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783144442.739398:0:6506:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:1.0:1783144442.739406:0:6506:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:2.0:1783144442.739409:0:10343:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2aeed00200 with handle 0xad8e53a4230490b1 from hash 00010000:00010000:2.0:1783144442.739415:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2aeed00200/0xad8e53a4230490b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad8e53a4230490aa expref: 24 pid: 94189 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783144442.739426:0:6506:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144442.739429:0:10343:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9c29c5721800 : new locks_count 16 00000020:00000040:2.0:1783144442.739434:0:10343:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00010000:00000040:2.0:1783144442.739441:0:10343:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9c2afcbe8200 00010000:00010000:2.0:1783144442.739445:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1783144442.739450:0:10343:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 63 to 0@lo 00000100:00000040:2.0:1783144442.739455:0:10343:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144442.739461:0:6506:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:1.0:1783144442.739468:0:6506:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20da680 x1869759501432064/t0(0) o103->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.739474:0:10343:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.739480:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:3651:x1869759501432064:12345-0@lo:103:ldlm_bl.0 Request processed in 314us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144442.739494:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00000040:1.0:1783144442.739497:0:6506:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144442.739506:0:10343:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000020:00000040:1.0:1783144442.739506:0:6506:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00000100:00000040:2.0:1783144442.739513:0:10343:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01522a00 x1869759501432192/t0(0) o103->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:553/0 lens 328/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.739521:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01522a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:3649:x1869759501432192:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144442.739529:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00000040:2.0:1783144442.739532:0:10343:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:2.0:1783144442.739539:0:10343:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 21 00000100:00000040:0.0:1783144442.739771:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144442.739778:0:3651:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144442.739783:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3651:1869759501432064:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783144442.739787:0:3651:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc6a00 x1869759501432064/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144442.739792:0:3651:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00002000:00000040:0.0:1783144442.739836:0:96747:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00000100:00000040:2.0:1783144442.739897:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144442.739908:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144442.739915:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2b01589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3649:1869759501432192:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1783144442.739921:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2b01589f80 x1869759501432192/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144442.739929:0:3649:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 00010000:00080000:0.0:1783144442.739946:0:96747:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968851 00000100:00000040:2.0:1783144442.739969:0:3643:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9c29c20db800 x1869759501431680/t0(0) o104->MGS@192.168.203.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144442.740264:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c29c20db800 x1869759501431680/t0(0) o104->MGS@192.168.203.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144442.740274:0:94186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20db800 x1869759501431680/t0(0) o104->MGS@192.168.203.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783144442.740292:0:94186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c20db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94186:1869759501431680:192.168.203.4@tcp:104: 00000100:00000040:0.0:1783144442.740299:0:94186:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29c20d8000 x1869759501431808/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1783144442.740308:0:94186:0:(genops.c:1244:class_import_put()) import ffff9c29c5727800 refcount=2 obd=MGS 00000100:00000040:0.0:1783144442.740313:0:94186:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29c20db100 x1869759501431936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1783144442.740317:0:94186:0:(genops.c:1244:class_import_put()) import ffff9c29c5727800 refcount=1 obd=MGS 00000100:00000040:0.0:1783144442.740320:0:94186:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c29c20db800 x1869759501431680/t0(0) o104->MGS@192.168.203.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1783144458 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1783144442.740330:0:94186:0:(genops.c:1244:class_import_put()) import ffff9c2aefddf800 refcount=1 obd=MGS 00010000:00010000:0.0:1783144442.740336:0:94186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1783144442.740493:0:96764:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96764 00010000:02000000:3.0:1783144442.740504:0:96764:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1783144442.740507:0:96764:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1783144442.740510:0:96764:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:1.0:1783144442.740554:0:96747:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:1.0:1783144442.740560:0:96747:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9c2ad3fe6480 : new refcount 2 00000040:00000040:1.0:1783144442.740564:0:96747:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9c2ad3fe6480 : new refcount 1 00000020:00000040:1.0:1783144442.740587:0:96747:0:(genops.c:900:class_export_put()) PUTting export ffff9c2afa976000 : new refcount 1 00000020:00000040:1.0:1783144442.740598:0:96747:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.203.104@tcp (ffff9c2ac6dd99c0) now 6 - mgc_fs 10000000:01000000:1.0:1783144442.740601:0:96747:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783144442.740619:0:96747:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783144442.740638:0:96747:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00000040:3.0:1783144442.740958:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20d8700 x1869759481779200 msgsize 328 00000100:00100000:3.0:1783144442.740965:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00000004:1.0:1783144442.741825:0:96747:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783144442.742098:0:96747:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783144442.742429:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779200 00000100:00100000:1.0:1783144442.742435:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779200 00000020:00000040:1.0:1783144442.742437:0:9526:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049087 00000020:00000040:1.0:1783144442.742441:0:9526:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefdda000 refcount=10 00000100:00000040:1.0:1783144442.742455:0:9526:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:1.0:1783144442.742461:0:9526:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2ac7516000 refcount=4 00010000:00010000:1.0:1783144442.742467:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 10 pid: 94188 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783144442.742491:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2601 00000100:00000040:1.0:1783144442.742495:0:9526:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefdda000 : new rpc_count 1 00000100:00000040:1.0:1783144442.742501:0:9526:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20d8700 x1869759481779200/t0(0) o103->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:553/0 lens 328/0 e 0 to 0 dl 1783144453 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.742516:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2404:x1869759481779200:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783144442.742529:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1783144442.742531:0:9526:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2ac7516000 refcount=4 00010000:00000040:1.0:1783144442.742534:0:9526:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c29cd096200 count: 3 00010000:00010000:1.0:1783144442.742539:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 10 pid: 94188 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.742551:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 10 pid: 94188 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783144442.742565:0:9526:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2ac7516000 with handle 0xad8e53a423049152 from hash 00010000:00010000:1.0:1783144442.742571:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2ac7516000/0xad8e53a423049152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x3146c23da9c41d59 expref: 10 pid: 94188 timeout: 3077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.742578:0:9526:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9c2aefdda000 : new locks_count 3 00000020:00000040:1.0:1783144442.742588:0:9526:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefdda000 : new refcount 9 00010000:00000040:1.0:1783144442.742595:0:9526:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9c2afcbe8200 00010000:00010000:1.0:1783144442.742600:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144442.742609:0:9526:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c29cd096200) refcount = 2 00010000:00010000:1.0:1783144442.742613:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783144442.742628:0:9526:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005733460s 00000020:00000040:1.0:1783144442.742632:0:9526:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2afcbe8200 refcount=5 00010000:00010000:1.0:1783144442.742635:0:9526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.742642:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.742648:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.742655:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.742661:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2afcbe8200 already unused, calling callback (ffffffffc0c0bce0) 00010000:00010000:1.0:1783144442.742665:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783144442.742670:0:9526:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2afcbe8200 refcount=6 00010000:00010000:1.0:1783144442.742674:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783144442.742695:0:9526:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2afcbe8200 with handle 0xad8e53a423049fc2 from hash 00010000:00010000:3.0:1783144442.742783:0:94186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.742784:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783144442.742802:0:94186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144442.742807:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783144442.742810:0:94186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2afcbe8200/0xad8e53a423049fc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783144442.742817:0:9526:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00010000:00000040:3.0:1783144442.742819:0:94186:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9c29cd096200 count: 0 00000100:00000040:1.0:1783144442.742829:0:9526:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144442.742879:0:9526:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 8 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144442.742887:0:9526:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d8700 x1869759481779200/t0(0) o103->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:553/0 lens 328/224 e 0 to 0 dl 1783144453 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144442.742899:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:2404:x1869759481779200:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 386us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144442.742909:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2601 00000100:00000040:1.0:1783144442.742912:0:9526:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefdda000 : new rpc_count 0 00000020:00000040:1.0:1783144442.742924:0:9526:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefdda000 : new refcount 8 00010000:00010000:2.0:1783144442.829917:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783144443.109912:0:96814:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783144443.110129:0:96814:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000040:0.0:1783144443.405905:0:75528:0:(genops.c:1231:class_import_get()) import ffff9c2ac5d51000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783144443.405935:0:75528:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8495596] to pc [ptlrpcd_00_01+1] req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144443.406005:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144443.406015:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501432320:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1783144443.406036:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144459 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144443.406042:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144443.406072:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01522d80 x1869759501432320 msgsize 224 00000100:00100000:2.0:1783144443.406076:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144443.406161:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144459 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144443.406171:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 2070 usecs (3 jiffies) 00000100:00100000:0.0:1783144443.406496:0:11960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432320 00000100:00100000:0.0:1783144443.406503:0:11960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432320 00000020:00000040:0.0:1783144443.406504:0:11960:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042ebf 00000020:00000040:0.0:1783144443.406508:0:11960:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e40000 refcount=5 00000100:00000040:0.0:1783144443.406529:0:11960:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1783144443.406561:0:11960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00000040:0.0:1783144443.406565:0:11960:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2af9e40000 : new rpc_count 1 00000100:00000040:0.0:1783144443.406571:0:11960:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01522d80 x1869759501432320/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1783144454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144443.406584:0:11960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501432320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144443.406611:0:11960:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1783144443.406631:0:11960:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968829, transno 0, xid 1869759501432320 00000100:00000040:0.0:1783144443.406641:0:11960:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:0.0:1783144443.406647:0:11960:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144443.406665:0:11960:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144443.406754:0:11960:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00000040:0.0:1783144443.406759:0:11960:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01522d80 x1869759501432320/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/368 e 0 to 0 dl 1783144454 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144443.406775:0:11960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501432320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 195us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144443.406781:0:11960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00000040:0.0:1783144443.406783:0:11960:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2af9e40000 : new rpc_count 0 00000020:00000040:0.0:1783144443.406800:0:11960:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e40000 : new refcount 4 00000100:00000040:2.0:1783144443.406897:0:3649:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968829 00000100:00000040:2.0:1783144443.406902:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783144443.406910:0:3649:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1783144443.406912:0:3649:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1783144443.406917:0:3649:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144459 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144443.406922:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501432320:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1783144443.406926:0:3649:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc6a00 x1869759501432320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783144459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783144443.406933:0:3649:0:(genops.c:1244:class_import_put()) import ffff9c2ac5d51000 refcount=2 obd=lustre-OST0001-osc-MDT0001 40000000:00000040:1.0:1783144443.506754:0:96863:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00010000:00010000:2.0:1783144443.853869:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1783144443.880050:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff9c2aee593380) now 12 - health_check_show 00000020:00000040:0.0:1783144443.880120:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff9c2aee593380) now 12 - health_check_show 00000020:00000040:0.0:1783144443.880124:0:96911:0:(obd_config.c:994:class_incref()) incref MGS (ffff9c2aee590000) now 8 - health_check_show 00000020:00000040:0.0:1783144443.880129:0:96911:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff9c2aee590000) now 8 - health_check_show 00000020:00000040:0.0:1783144443.880131:0:96911:0:(obd_config.c:994:class_incref()) incref MGC192.168.203.104@tcp (ffff9c2ac6dd99c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880134:0:96911:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.203.104@tcp (ffff9c2ac6dd99c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880136:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff9c2ac49f8000) now 10 - health_check_show 00000020:00000040:0.0:1783144443.880139:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff9c2ac49f8000) now 10 - health_check_show 00000020:00000040:0.0:1783144443.880141:0:96911:0:(obd_config.c:994:class_incref()) incref MDS (ffff9c29c356b380) now 4 - health_check_show 00000020:00000040:0.0:1783144443.880148:0:96911:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff9c29c356b380) now 4 - health_check_show 00000020:00000040:0.0:1783144443.880150:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff9c2af9f119c0) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880152:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff9c2af9f119c0) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880154:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c2ac6ddb380) now 12 - health_check_show 00000020:00000040:0.0:1783144443.880157:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c2ac6ddb380) now 12 - health_check_show 00000020:00000040:0.0:1783144443.880159:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff9c2ac6dd8000) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880161:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff9c2ac6dd8000) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880164:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff9c29cb13cd40) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880167:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff9c29cb13cd40) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880169:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff9c2ad08d8000) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880171:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff9c2ad08d8000) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880173:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff9c2ac49f99c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880175:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff9c2ac49f99c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880183:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff9c2ac49fcd40) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880185:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff9c2ac49fcd40) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880187:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff9c2aee594d40) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880189:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff9c2aee594d40) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880191:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2aee5919c0) now 16 - health_check_show 00000020:00000040:0.0:1783144443.880193:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2aee5919c0) now 16 - health_check_show 00000020:00000040:0.0:1783144443.880195:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff9c29c3568000) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880197:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff9c29c3568000) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880198:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff9c29c356cd40) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880200:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff9c29c356cd40) now 5 - health_check_show 00000020:00000040:0.0:1783144443.880202:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c2af5d58000) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880206:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff9c2af5d58000) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880208:0:96911:0:(obd_config.c:994:class_incref()) incref OSS (ffff9c2ac6ddcd40) now 4 - health_check_show 00000020:00000040:0.0:1783144443.880213:0:96911:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff9c2ac6ddcd40) now 4 - health_check_show 00000020:00000040:0.0:1783144443.880215:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 7 - health_check_show 00000020:00000040:0.0:1783144443.880282:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2ad08d99c0) now 7 - health_check_show 00000020:00000040:0.0:1783144443.880286:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c29c4aeb380) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880287:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff9c29c4aeb380) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880290:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c29c236b380) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880292:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff9c29c236b380) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880294:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff9c2af5d5cd40) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880296:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff9c2af5d5cd40) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880298:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff9c2af9c78000) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880300:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff9c2af9c78000) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880303:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff9c2af5d599c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880306:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff9c2af5d599c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880308:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c29c31e19c0) now 10 - health_check_show 00000020:00000040:0.0:1783144443.880336:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c29c31e19c0) now 10 - health_check_show 00000020:00000040:0.0:1783144443.880339:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff9c2af5d5b380) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880341:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff9c2af5d5b380) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880343:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff9c29c35699c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880345:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff9c29c35699c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880347:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff9c2af9c799c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880349:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff9c2af9c799c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880351:0:96911:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff9c29c4ae99c0) now 6 - health_check_show 00000020:00000040:0.0:1783144443.880353:0:96911:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff9c29c4ae99c0) now 6 - health_check_show 10000000:00000040:0.0:1783144444.627836:0:6518:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c2af5628400) refs 2 10000000:01000000:0.0:1783144444.627844:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783144444.627847:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c29c5808800 from 125 10000000:01000000:0.0:1783144444.627851:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:0.0:1783144444.627858:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144444.627886:0:6518:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c29ca7f7c00 with handle 0xad8e53a423049fc9 to hash 00010000:00010000:0.0:1783144444.627894:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.627905:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.627915:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144444.627936:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.627948:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432448:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.627971:0:6518:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.627984:0:6518:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144444.628017:0:6518:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c47cbc50 x1869759501432448 msgsize 328 00000100:00100000:0.0:1783144444.628021:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144444.628023:0:6518:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144444.628046:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.628068:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432448 00000100:00100000:0.0:1783144444.628074:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d9d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783144444.628076:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432448 00000020:00000040:1.0:1783144444.628081:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:1.0:1783144444.628085:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=22 00000100:00000040:1.0:1783144444.628107:0:94188:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783144444.628140:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1783144444.628144:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:1.0:1783144444.628150:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c47cbc50 x1869759501432448/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.628165:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+22:6518:x1869759501432448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144444.628178:0:94188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:1.0:1783144444.628190:0:94188:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2b02150a00 with handle 0xad8e53a423049fd0 to hash 00010000:00010000:1.0:1783144444.628194:0:94188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02150a00/0xad8e53a423049fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049fc9 expref: -99 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144444.628209:0:94188:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c29c5721800 : new locks_count 17 00000020:00000040:1.0:1783144444.628212:0:94188:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=23 00010000:00000040:1.0:1783144444.628229:0:94188:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c29c476e500) refcount = 1 00010000:00010000:1.0:1783144444.628234:0:94188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02150a00/0xad8e53a423049fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049fc9 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144444.628244:0:94188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02150a00/0xad8e53a423049fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049fc9 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783144444.628254:0:94188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02150a00, rc 0) 00010000:00000040:1.0:1783144444.628257:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501432448 00000100:00000040:1.0:1783144444.628276:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:1.0:1783144444.628281:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144444.628350:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144444.628378:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00000040:1.0:1783144444.628383:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c47cbc50 x1869759501432448/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 328/344 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.628392:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501432448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144444.628399:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1783144444.628402:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:1.0:1783144444.628411:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00000100:00000040:0.0:1783144444.628841:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.628851:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.628858:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432448:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.628865:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.628874:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f7c00 refcount=4 00010000:00000040:0.0:1783144444.628878:0:6518:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c29ca7f7c00, remote cookie: 0xad8e53a423049fd0, flags: 0x0 00010000:00000040:0.0:1783144444.628882:0:6518:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2af6d31b00) refcount = 1 00010000:00010000:0.0:1783144444.628886:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049fd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.628894:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049fd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144444.628902:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc4000 x1869759501432448/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.628910:0:6518:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:00000040:0.0:1783144444.628916:0:6518:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c2af5628400) refs 3 00000020:00000040:0.0:1783144444.628924:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f7c00 refcount=3 00000020:00000040:0.0:1783144444.628938:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144444.628948:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00000100:00000040:0.0:1783144444.628958:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.628966:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432576:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.628980:0:6518:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.628987:0:6518:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144444.629001:0:6518:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c47ca850 x1869759501432576 msgsize 304 00000100:00100000:0.0:1783144444.629005:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144444.629007:0:6518:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144444.629027:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.629041:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d9d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783144444.629087:0:94189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432576 00000100:00100000:2.0:1783144444.629096:0:94189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432576 00000020:00000040:2.0:1783144444.629098:0:94189:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144444.629100:0:94189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=23 00000100:00000040:2.0:1783144444.629111:0:94189:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144444.629133:0:94189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1783144444.629135:0:94189:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144444.629139:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c47ca850 x1869759501432576/t0(0) o256->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 304/0 e 0 to 0 dl 1783144455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.629150:0:94189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501432576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783144444.629162:0:94189:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1783144444.629173:0:94189:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1783144444.629179:0:94189:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783144444.629181:0:94189:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:2.0:1783144444.629186:0:94189:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=24 00000020:00000040:2.0:1783144444.629228:0:94189:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00010000:00000040:2.0:1783144444.629241:0:94189:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501432576 00000100:00000040:2.0:1783144444.629246:0:94189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:2.0:1783144444.629250:0:94189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144444.629261:0:94189:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.629287:0:94189:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00000040:2.0:1783144444.629291:0:94189:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c47ca850 x1869759501432576/t0(0) o256->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 304/240 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.629299:0:94189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501432576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144444.629305:0:94189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1783144444.629308:0:94189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:2.0:1783144444.629314:0:94189:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 22 00000100:00000040:1.0:1783144444.629404:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144444.629416:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144444.629437:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.629443:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432576:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1783144444.629448:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1783144444.629456:0:6518:0:(mgc_request.c:1601:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:0.0:1783144444.629757:0:6518:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783144444.629770:0:6518:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.203.104@tcp has 192.168.203.104@tcp. 10000000:00000040:0.0:1783144444.629839:0:6518:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:0.0:1783144444.629843:0:6518:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c29c5a45800 already not connected (conn 4, was 0): DISCONN 00000100:00000040:0.0:1783144444.629852:0:6518:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:0.0:1783144444.629855:0:6518:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:0.0:1783144444.629857:0:6518:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.104@tcp -> ffff9c2aca4c0680 00010000:00080000:0.0:1783144444.629860:0:6518:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9c29c5a45800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.104@tcp, moved to head 00010000:00000040:0.0:1783144444.629863:0:6518:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00080000:0.0:1783144444.629867:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1783144444.629871:0:6518:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 60 to 0@lo 00000100:00000040:0.0:1783144444.629873:0:6518:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000020:00000040:0.0:1783144444.629875:0:6518:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304901e 00000020:00000040:0.0:1783144444.629883:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c4968000 refcount=4 00000100:00000040:0.0:1783144444.629886:0:6518:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 60 to 0@lo 00000100:00000040:0.0:1783144444.629888:0:6518:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000020:00000040:0.0:1783144444.629890:0:6518:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c4968000 : new refcount 3 00000100:00080000:0.0:1783144444.629892:0:6518:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c29c5a45800 using connection 192.168.203.104@tcp/0@lo 00000020:00000040:0.0:1783144444.629901:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c29c5a45800 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783144444.629912:0:6518:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144444.629923:0:6518:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b13125bc] to pc [ptlrpcd_rcv+-1] req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1783144444.629938:0:6518:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783144444.629944:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc4000 x1869759501432576/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.629951:0:6518:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144444.629953:0:6518:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:01000000:0.0:1783144444.629965:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:0.0:1783144444.629969:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f7c00 refcount=3 00010000:00010000:0.0:1783144444.629973:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049fd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.629980:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049fd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:0.0:1783144444.629988:0:6518:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c29c31b8200) refs 2 10000000:00000040:0.0:1783144444.629990:0:6518:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c2af5628400) refs 3 10000000:01000000:0.0:1783144444.629992:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783144444.629994:0:6518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9c2ac91e0000 from 125 10000000:01000000:0.0:1783144444.629996:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:0.0:1783144444.629999:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00010000:00000040:0.0:1783144444.630012:0:6518:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2af6d31b00 count: 2 00000020:00000040:0.0:1783144444.630016:0:6518:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c29ca7f6000 with handle 0xad8e53a423049fd7 to hash 00010000:00010000:0.0:1783144444.630021:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423049fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.630027:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423049fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.630034:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423049fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144444.630045:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.630054:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432832:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.630064:0:6518:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.630070:0:6518:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144444.630084:0:6518:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c47c8050 x1869759501432832 msgsize 328 00000100:00100000:0.0:1783144444.630088:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144444.630089:0:6518:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144444.630104:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.630117:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d9d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783144444.630149:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432832 00000100:00100000:1.0:1783144444.630154:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432832 00000020:00000040:1.0:1783144444.630156:0:94185:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:1.0:1783144444.630158:0:94185:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=23 00000100:00000040:1.0:1783144444.630169:0:94185:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783144444.630194:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1783144444.630196:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144444.630198:0:94185:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:1.0:1783144444.630204:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c47c8050 x1869759501432832/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.630222:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501432704:0@lo:8:ll_cfg_requeue.0 00000100:00100000:1.0:1783144444.630228:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+23:6518:x1869759501432832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783144444.630237:0:94185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00000040:2.0:1783144444.630239:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144464 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783144444.630243:0:94185:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c29c476e500 count: 2 00000100:00000040:2.0:1783144444.630250:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1783144444.630251:0:94185:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2b02151800 with handle 0xad8e53a423049fde to hash 00010000:00010000:1.0:1783144444.630256:0:94185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2b02151800/0xad8e53a423049fde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad8e53a423049fd7 expref: -99 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783144444.630272:0:94185:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c29c5721800 : new locks_count 18 00000020:00000040:1.0:1783144444.630276:0:94185:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:2.0:1783144444.630279:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521c00 x1869759501432704 msgsize 520 00000100:00100000:2.0:1783144444.630285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000040:1.0:1783144444.630286:0:94185:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c29c476e500) refcount = 2 00000100:00000040:2.0:1783144444.630301:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144464 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.630312:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 3158 usecs (4 jiffies) 00000100:00100000:2.0:1783144444.630332:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432704 00000100:00100000:2.0:1783144444.630335:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432704 00000020:00000040:2.0:1783144444.630337:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304902c 00000100:00100000:2.0:1783144444.630357:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061 00000100:00000040:2.0:1783144444.630361:0:8438:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521c00 x1869759501432704/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.630370:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1869759501432704:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:2.0:1783144444.630382:0:8438:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 7 - find 00010000:00000040:2.0:1783144444.630389:0:8438:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1783144444.630395:0:8438:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9c2ad085b000, cookie 0xad8e53a423049f6e 00010000:00080000:2.0:1783144444.630398:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294968847 exp ffff9c2ad085b000 cur 2978 last 1783144442 00010000:02000400:2.0:1783144444.630405:0:8438:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:2.0:1783144444.630410:0:8438:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:2.0:1783144444.630418:0:8438:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.104@tcp 00010000:00000040:1.0:1783144444.630420:0:94185:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00000001:00000040:2.0:1783144444.630423:0:8438:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 19 00000020:00000040:2.0:1783144444.630428:0:8438:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085b000 refcount=4 00000001:00000040:2.0:1783144444.630433:0:8438:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 20 00010000:00000040:1.0:1783144444.630433:0:94185:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2b02150a00/0xad8e53a423049fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049fc9 expref: 24 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000040:2.0:1783144444.630446:0:8438:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2ac31a8400) : new refcount 19 00010000:00010000:1.0:1783144444.630446:0:94185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2b02151800/0xad8e53a423049fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad8e53a423049fd7 expref: 24 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1783144444.630454:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2ad085b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783144444.630459:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00010000:00010000:1.0:1783144444.630460:0:94185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2b02151800/0xad8e53a423049fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049fd7 expref: 24 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1783144444.630463:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1783144444.630475:0:94185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2b02151800, rc 0) 00000020:00000040:2.0:1783144444.630477:0:8438:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c29c6022f60 for nid 0@lo - ref 2 00010000:00000040:1.0:1783144444.630478:0:94185:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501432832 00000100:00000040:1.0:1783144444.630486:0:94185:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:1.0:1783144444.630491:0:94185:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144444.630514:0:94185:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144444.630534:0:94185:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 61 to 0@lo 00000100:00000040:1.0:1783144444.630540:0:94185:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c47c8050 x1869759501432832/t0(0) o101->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 328/344 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.630550:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501432832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 326us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144444.630560:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:1.0:1783144444.630563:0:94185:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:1.0:1783144444.630571:0:94185:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000020:00000040:2.0:1783144444.630590:0:8438:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 8 - import 00000020:00000040:2.0:1783144444.630598:0:8438:0:(genops.c:1244:class_import_put()) import ffff9c2afab22800 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1783144444.630603:0:8438:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085b000 refcount=5 00000100:00000040:2.0:1783144444.630606:0:8438:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c2ad085b000 : new rpc_count 1 00000100:00000040:2.0:1783144444.630609:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:2.0:1783144444.630611:0:8438:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000020:00000040:2.0:1783144444.630614:0:8438:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085b000 refcount=6 00000100:00000040:2.0:1783144444.630618:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 63 to 0@lo 00000100:00080000:2.0:1783144444.630624:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9c2afab22800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1783144444.630629:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad085b000 : new refcount 5 00000020:00000040:2.0:1783144444.630632:0:8438:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2ad08d99c0) now 8 - find 00010000:00000040:2.0:1783144444.630639:0:8438:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968847, transno 0, xid 1869759501432704 00000100:00000040:2.0:1783144444.630643:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 64 to 0@lo 00000100:00000040:2.0:1783144444.630646:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144444.630661:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144464 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.630685:0:8438:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 63 to 0@lo 00000100:00000040:2.0:1783144444.630689:0:8438:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521c00 x1869759501432704/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.630696:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501432704:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 326us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144444.630702:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061 00000100:00000040:2.0:1783144444.630704:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad085b000 : new rpc_count 0 00000020:00000040:2.0:1783144444.630716:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad085b000 : new refcount 4 00000100:00000040:0.0:1783144444.630844:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.630852:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.630859:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432832:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.630869:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.630877:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f6000 refcount=4 00010000:00000040:0.0:1783144444.630881:0:6518:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c29ca7f6000, remote cookie: 0xad8e53a423049fde, flags: 0x0 00010000:00000040:0.0:1783144444.630884:0:6518:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2af6d31b00) refcount = 2 00010000:00000040:0.0:1783144444.630887:0:6518:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783144444.630889:0:6518:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f7c00/0xad8e53a423049fc9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049fd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.630895:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423049fd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049fde expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.630902:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423049fd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad8e53a423049fde expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783144444.630910:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc4000 x1869759501432832/t0(0) o101->MGC192.168.203.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783144460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.630917:0:6518:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:00000040:0.0:1783144444.630923:0:6518:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c29c31b8200) refs 3 00000020:00000040:0.0:1783144444.630926:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f6000 refcount=3 00000020:00000040:0.0:1783144444.630940:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144444.630949:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c2ac6d92000 refcount=5 obd=MGC192.168.203.104@tcp 00010000:00080000:1.0:1783144444.630952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.630961:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.630966:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968847 gen 2 00000100:00100000:0.0:1783144444.630974:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432960:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1783144444.630977:0:3647:0:(client.c:3167:ptlrpc_free_committed()) @@@ commit (last_committed 4294968847) req@ffff9c2affdb6680 x1869759501420928/t4294968847(4294968847) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783144445 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.630990:0:6518:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.631019:0:6518:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783144444.631023:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2affdb6680 x1869759501420928/t4294968847(4294968847) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783144445 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.631041:0:6518:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c47c9050 x1869759501432960 msgsize 304 00000100:00100000:0.0:1783144444.631045:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144444.631047:0:6518:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783144444.631065:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.631079:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9c2ac4d9d0c0 going to sleep for 11 seconds 00000020:00000040:1.0:1783144444.631170:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c29c5a45800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1783144444.631178:0:3647:0:(client.c:3221:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:1.0:1783144444.631184:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783144444.631193:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:1.0:1783144444.631196:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a42304901e 00000020:00000040:1.0:1783144444.631198:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c4968000 refcount=4 00000020:00000040:1.0:1783144444.631203:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c4968000 : new refcount 3 00000100:00080000:1.0:1783144444.631207:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783144444.631211:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1783144444.631214:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968847 gen 2 00000100:00000040:1.0:1783144444.631216:0:3647:0:(client.c:3221:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1783144444.631219:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c29c5a45800 from lustre-OST0000_UUID committed 4294968847 last 0 00000100:00080000:1.0:1783144444.631222:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1783144444.631225:0:3647:0:(genops.c:1231:class_import_get()) import ffff9c29c5a45800 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1783144444.632834:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501432960 00000100:00100000:2.0:1783144444.632840:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501432960 00000020:00000040:2.0:1783144444.632843:0:94188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423048f68 00000020:00000040:2.0:1783144444.632846:0:94188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c29c5721800 refcount=24 00000100:00000040:2.0:1783144444.632859:0:94188:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783144444.632878:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:2.0:1783144444.632882:0:94188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c29c5721800 : new rpc_count 1 00000100:00000040:2.0:1783144444.632888:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c47c9050 x1869759501432960/t0(0) o256->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 304/0 e 0 to 0 dl 1783144455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.632901:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501432960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783144444.632914:0:94188:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1783144444.632925:0:94188:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1783144444.632930:0:94188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783144444.632933:0:94188:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:2.0:1783144444.632938:0:94188:0:(genops.c:889:class_export_get()) GET export ffff9c29c5721800 refcount=25 00000100:00000040:0.0:1783144444.633323:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.633332:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501432704:0@lo:8:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.633337:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc6d80 x1869759501432704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.633346:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c29c5a45800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:0.0:1783144444.633362:0:96984:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1783144444.633366:0:96984:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1783144444.633371:0:96984:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1783144444.633400:0:96984:0:(import.c:65:import_set_state_nolock()) ffff9c29c5a45800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:0.0:1783144444.633405:0:96984:0:(genops.c:1231:class_import_get()) import ffff9c29c5a45800 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783144444.633418:0:96984:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b13125bc] to pc [ptlrpcd_rcv+-1] req@ffff9c2afabc6d80 x1869759501433088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.633430:0:96984:0:(genops.c:1244:class_import_put()) import ffff9c29c5a45800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783144444.633438:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6d80 x1869759501433088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.633447:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1869759501433088:0@lo:400:ldlm_lock_repla.0 00000100:00000040:0.0:1783144444.633461:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9c2afabc6d80 x1869759501433088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144460 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.633469:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144444.633488:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc5f80 x1869759501433088 msgsize 224 00000100:00100000:0.0:1783144444.633492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144444.633506:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6d80 x1869759501433088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144460 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.633516:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 3046 usecs (4 jiffies) 00000100:00100000:0.0:1783144444.633595:0:26141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433088 00000100:00100000:0.0:1783144444.633600:0:26141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433088 00000020:00000040:0.0:1783144444.633601:0:26141:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f6e 00000020:00000040:0.0:1783144444.633604:0:26141:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad085b000 refcount=5 00000100:00000040:0.0:1783144444.633616:0:26141:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1783144444.633631:0:26141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00000040:0.0:1783144444.633634:0:26141:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad085b000 : new rpc_count 1 00000100:00000040:0.0:1783144444.633638:0:26141:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc5f80 x1869759501433088/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.633648:0:26141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501433088:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:0.0:1783144444.633655:0:26141:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc5f80 x1869759501433088/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1783144444.633663:0:26141:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad085b000 : new rpc_count 2 00010000:00080000:0.0:1783144444.633666:0:26141:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2afabc5f80 x1869759501433088/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.633682:0:26141:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc5f80 x1869759501433088/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.633689:0:26141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1869759501433088:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 42us (199us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.633694:0:26141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00000040:0.0:1783144444.633696:0:26141:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad085b000 : new rpc_count 1 00010000:00080000:0.0:1783144444.633717:0:96764:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000040:2.0:1783144444.633841:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 24 00010000:00000040:2.0:1783144444.633855:0:94188:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759501432960 00000100:00000040:2.0:1783144444.633862:0:94188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 64 to 0@lo 00000100:00000040:2.0:1783144444.633868:0:94188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144444.633887:0:94188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.633903:0:94188:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 63 to 0@lo 00000100:00000040:2.0:1783144444.633908:0:94188:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c47c9050 x1869759501432960/t0(0) o256->4e9e4714-8000-4c64-bed6-3cadd5fdfc80@0@lo:555/0 lens 304/240 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.633917:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:6518:x1869759501432960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1018us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144444.633923:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:2.0:1783144444.633926:0:94188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c29c5721800 : new rpc_count 0 00000020:00000040:2.0:1783144444.633939:0:94188:0:(genops.c:900:class_export_put()) PUTting export ffff9c29c5721800 : new refcount 23 00000100:00000040:0.0:1783144444.634032:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.634040:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.634047:0:6518:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.634052:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:6518:1869759501432960:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.634058:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1783144444.634065:0:6518:0:(mgc_request.c:1601:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:0.0:1783144444.634073:0:6518:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783144444.634080:0:6518:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.203.104@tcp has 192.168.203.104@tcp. 10000000:00000040:0.0:1783144444.634089:0:6518:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:0.0:1783144444.634093:0:6518:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c2af9da2800 already not connected (conn 4, was 0): DISCONN 00000100:00000040:0.0:1783144444.634100:0:6518:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 64 to 0@lo 00000100:00000040:0.0:1783144444.634102:0:6518:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 64 to 0@lo 00000100:00000040:0.0:1783144444.634104:0:6518:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.104@tcp -> ffff9c2aca4c0680 00010000:00080000:0.0:1783144444.634107:0:6518:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9c2af9da2800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.104@tcp, moved to head 00010000:00000040:0.0:1783144444.634109:0:6518:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 63 to 0@lo 00000100:00080000:0.0:1783144444.634112:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1783144444.634115:0:6518:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:0.0:1783144444.634117:0:6518:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 63 to 0@lo 00000020:00000040:0.0:1783144444.634119:0:6518:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042e9c 00000020:00000040:0.0:1783144444.634122:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e41800 refcount=4 00000100:00000040:0.0:1783144444.634124:0:6518:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 62 to 0@lo 00000100:00000040:0.0:1783144444.634126:0:6518:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 63 to 0@lo 00000020:00000040:0.0:1783144444.634128:0:6518:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e41800 : new refcount 3 00000100:00080000:0.0:1783144444.634136:0:6518:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2af9da2800 using connection 192.168.203.104@tcp/0@lo 00000020:00000040:0.0:1783144444.634144:0:6518:0:(genops.c:1231:class_import_get()) import ffff9c2af9da2800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1783144444.634153:0:6518:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783144444.634162:0:6518:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8495596] to pc [ptlrpcd_rcv+-1] req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1783144444.634182:0:6518:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783144444.634187:0:6518:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc4000 x1869759501432960/t0(0) o256->MGC192.168.203.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783144460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.634194:0:6518:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=4 obd=MGC192.168.203.104@tcp 00000020:00000040:0.0:1783144444.634196:0:6518:0:(genops.c:1244:class_import_put()) import ffff9c2ac6d92000 refcount=3 obd=MGC192.168.203.104@tcp 10000000:01000000:0.0:1783144444.634209:0:6518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:0.0:1783144444.634213:0:6518:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c29ca7f6000 refcount=3 00010000:00010000:0.0:1783144444.634217:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423049fd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049fde expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.634225:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9c29ca7f6000/0xad8e53a423049fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad8e53a423049fde expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:0.0:1783144444.634234:0:6518:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c29c31b8200) refs 3 00000100:00000040:2.0:1783144444.634277:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.634286:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501433216:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1783144444.634297:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144464 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.634303:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783144444.634314:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01520a80 x1869759501433216 msgsize 520 00000100:00100000:2.0:1783144444.634317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783144444.634335:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144464 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.634343:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2416 usecs (3 jiffies) 00000100:00100000:0.0:1783144444.634378:0:26145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433216 00000100:00100000:0.0:1783144444.634382:0:26145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433216 00000020:00000040:0.0:1783144444.634383:0:26145:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042eaa 00000100:00100000:0.0:1783144444.634405:0:26145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5062 00000100:00000040:0.0:1783144444.634409:0:26145:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01520a80 x1869759501433216/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.634418:0:26145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3647:x1869759501433216:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:0.0:1783144444.634428:0:26145:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 8 - find 00010000:00000040:0.0:1783144444.634441:0:26145:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1783144444.634446:0:26145:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2ad085f000, cookie 0xad8e53a423049f67 00010000:00080000:0.0:1783144444.634451:0:26145:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c2ad085f000 cur 2978 last 1783144442 00000001:00000040:0.0:1783144444.634459:0:26145:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.104@tcp 00000001:00000040:0.0:1783144444.634462:0:26145:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 20 00000020:00000040:0.0:1783144444.634465:0:26145:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085f000 refcount=4 00000001:00000040:0.0:1783144444.634467:0:26145:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 21 00000001:00000040:0.0:1783144444.634470:0:26145:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2ac31a8400) : new refcount 20 00002000:00100000:0.0:1783144444.634473:0:26145:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c2ad085f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783144444.634476:0:26145:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1783144444.634479:0:26145:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:0.0:1783144444.634484:0:26145:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c29c6022f60 for nid 0@lo - ref 3 00000020:00000040:0.0:1783144444.634491:0:26145:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 9 - import 00000020:00000040:0.0:1783144444.634495:0:26145:0:(genops.c:1244:class_import_put()) import ffff9c2afa9b9800 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1783144444.634499:0:26145:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085f000 refcount=5 00000100:00000040:0.0:1783144444.634501:0:26145:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c2ad085f000 : new rpc_count 1 00000100:00000040:0.0:1783144444.634504:0:26145:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 64 to 0@lo 00000100:00000040:0.0:1783144444.634506:0:26145:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2aca4c0680 refcount 64 to 0@lo 00000020:00000040:0.0:1783144444.634508:0:26145:0:(genops.c:889:class_export_get()) GET export ffff9c2ad085f000 refcount=6 00000100:00000040:0.0:1783144444.634513:0:26145:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 65 to 0@lo 00000100:00080000:0.0:1783144444.634517:0:26145:0:(import.c:65:import_set_state_nolock()) ffff9c2afa9b9800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1783144444.634522:0:26145:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad085f000 : new refcount 5 00000020:00000040:0.0:1783144444.634523:0:26145:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2ad08d99c0) now 9 - find 00010000:00000040:0.0:1783144444.634530:0:26145:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968818, transno 0, xid 1869759501433216 00000100:00000040:0.0:1783144444.634534:0:26145:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2aca4c0680 refcount 66 to 0@lo 00000100:00000040:0.0:1783144444.634537:0:26145:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144444.634553:0:26145:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783144464 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.634569:0:26145:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c2aca4c0680 refcount 65 to 0@lo 00000100:00000040:0.0:1783144444.634578:0:26145:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01520a80 x1869759501433216/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.634586:0:26145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1869759501433216:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 167us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144444.634591:0:26145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5062 00000100:00000040:0.0:1783144444.634593:0:26145:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad085f000 : new rpc_count 0 00000020:00000040:0.0:1783144444.634598:0:26145:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad085f000 : new refcount 4 00010000:00080000:0.0:1783144444.634617:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.634625:0:3647:0:(client.c:3107:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968818 00000100:00000040:0.0:1783144444.634629:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783144444.634637:0:3647:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:0.0:1783144444.634638:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423042e9c 00000020:00000040:0.0:1783144444.634641:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2af9e41800 refcount=4 00000020:00000040:0.0:1783144444.634645:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff9c2af9e41800 : new refcount 3 00000100:00080000:0.0:1783144444.634647:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783144444.634650:0:3647:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1783144444.634652:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968818 gen 2 00000100:00000040:0.0:1783144444.634654:0:3647:0:(client.c:3221:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:0.0:1783144444.634657:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2af9da2800 from lustre-OST0000_UUID committed 4294968818 last 0 00000100:00080000:0.0:1783144444.634659:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:0.0:1783144444.634661:0:3647:0:(genops.c:1231:class_import_get()) import ffff9c2af9da2800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783144444.634713:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.634742:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501433216:0@lo:8:ll_cfg_requeue.0 00000100:00000040:0.0:1783144444.634755:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2afabc6a00 x1869759501433216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.634762:0:3647:0:(genops.c:1244:class_import_put()) import ffff9c2af9da2800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:0.0:1783144444.634772:0:96985:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1783144444.634775:0:96985:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:0.0:1783144444.634777:0:96985:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:0.0:1783144444.634868:0:96985:0:(import.c:65:import_set_state_nolock()) ffff9c2af9da2800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:0.0:1783144444.634874:0:96985:0:(genops.c:1231:class_import_get()) import ffff9c2af9da2800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783144444.634885:0:96985:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c8495596] to pc [ptlrpcd_rcv+-1] req@ffff9c2afabc6a00 x1869759501433344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783144444.634897:0:96985:0:(genops.c:1244:class_import_put()) import ffff9c2af9da2800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783144444.634906:0:3647:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2afabc6a00 x1869759501433344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.634915:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2afabc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1869759501433344:0@lo:400:ldlm_lock_repla.0 00000100:00000040:0.0:1783144444.634927:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9c2afabc6a00 x1869759501433344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144460 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.634934:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783144444.634947:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc4000 x1869759501433344 msgsize 224 00000100:00100000:0.0:1783144444.634951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783144444.634961:0:3647:0:(client.c:2861:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2afabc6a00 x1869759501433344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783144460 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783144444.634969:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 2408 usecs (3 jiffies) 00000100:00100000:2.0:1783144444.635055:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433344 00000100:00100000:2.0:1783144444.635059:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433344 00000020:00000040:2.0:1783144444.635061:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f67 00000020:00000040:2.0:1783144444.635064:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad085f000 refcount=5 00000100:00100000:2.0:1783144444.635099:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00000040:2.0:1783144444.635102:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad085f000 : new rpc_count 1 00000100:00000040:2.0:1783144444.635106:0:8437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc4000 x1869759501433344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.635117:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869759501433344:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1783144444.635124:0:8437:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc4000 x1869759501433344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144444.635131:0:8437:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad085f000 : new rpc_count 2 00010000:00080000:2.0:1783144444.635134:0:8437:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9c2afabc4000 x1869759501433344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.635147:0:8437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4000 x1869759501433344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.635161:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869759501433344:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 46us (212us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.635167:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00000040:2.0:1783144444.635170:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad085f000 : new rpc_count 1 00010000:00080000:2.0:1783144444.635183:0:96764:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:2.0:1783144444.643436:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c47cac50 x1869759481779328 msgsize 328 00000100:00100000:2.0:1783144444.643450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00000040:2.0:1783144444.643452:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1783144444.643555:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779328 00000100:00100000:0.0:1783144444.643564:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779328 00000020:00000040:0.0:1783144444.643566:0:94183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049087 00000020:00000040:0.0:1783144444.643571:0:94183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefdda000 refcount=9 00000100:00000040:0.0:1783144444.643597:0:94183:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783144444.643626:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00000040:0.0:1783144444.643630:0:94183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefdda000 : new rpc_count 1 00000100:00000040:0.0:1783144444.643637:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c47cac50 x1869759481779328/t0(0) o101->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.643651:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+9:70816:x1869759481779328:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783144444.643666:0:94183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1783144444.643675:0:94183:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c29c476e500 count: 3 00000020:00000040:0.0:1783144444.643682:0:94183:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c29ca7f7400 with handle 0xad8e53a423049fe5 to hash 00010000:00010000:0.0:1783144444.643688:0:94183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423049fe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3146c23da9c420e0 expref: -99 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144444.643696:0:94183:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c2aefdda000 : new locks_count 4 00000020:00000040:0.0:1783144444.643698:0:94183:0:(genops.c:889:class_export_get()) GET export ffff9c2aefdda000 refcount=10 00010000:00000040:0.0:1783144444.643714:0:94183:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c29c476e500) refcount = 3 00010000:00000040:0.0:1783144444.643717:0:94183:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783144444.643747:0:94183:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2b02151800/0xad8e53a423049fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049fd7 expref: 23 pid: 94185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783144444.643755:0:94183:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2b02150a00/0xad8e53a423049fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad8e53a423049fc9 expref: 23 pid: 94188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.643762:0:94183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423049fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420e0 expref: 10 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.643772:0:94183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c29ca7f7400/0xad8e53a423049fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x3146c23da9c420e0 expref: 10 pid: 94183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783144444.643782:0:94183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c29ca7f7400, rc 0) 00010000:00000040:0.0:1783144444.643845:0:94183:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759481779328 00000100:00000040:0.0:1783144444.643861:0:94183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.643867:0:94183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144444.643904:0:94183:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 8 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.643910:0:94183:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c47cac50 x1869759481779328/t0(0) o101->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:555/0 lens 328/344 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783144444.643920:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481779328:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 271us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144444.643926:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 197 00000100:00000040:0.0:1783144444.643930:0:94183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefdda000 : new rpc_count 0 00000020:00000040:0.0:1783144444.643939:0:94183:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefdda000 : new refcount 9 00000100:00000040:2.0:1783144444.645834:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c47ca050 x1869759481779456 msgsize 304 00000100:00100000:2.0:1783144444.645844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00000040:2.0:1783144444.645846:0:3641:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1783144444.645871:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779456 00000100:00100000:1.0:1783144444.645878:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779456 00000020:00000040:1.0:1783144444.645880:0:94184:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049087 00000020:00000040:1.0:1783144444.645885:0:94184:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2aefdda000 refcount=10 00000100:00000040:1.0:1783144444.645901:0:94184:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783144444.645932:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00000040:1.0:1783144444.645935:0:94184:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2aefdda000 : new rpc_count 1 00000100:00000040:1.0:1783144444.645941:0:94184:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c47ca050 x1869759481779456/t0(0) o256->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:555/0 lens 304/0 e 0 to 0 dl 1783144455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.645954:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481779456:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783144444.645977:0:94184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:1.0:1783144444.645988:0:94184:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1783144444.645994:0:94184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783144444.645997:0:94184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:1.0:1783144444.646005:0:94184:0:(genops.c:889:class_export_get()) GET export ffff9c2aefdda000 refcount=11 00000020:00000040:1.0:1783144444.648110:0:94184:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefdda000 : new refcount 10 00010000:00000040:1.0:1783144444.648127:0:94184:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1869759481779456 00000100:00000040:1.0:1783144444.648138:0:94184:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.648145:0:94184:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.648179:0:94184:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 8 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.648186:0:94184:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c47ca050 x1869759481779456/t0(0) o256->a1ed6386-b53d-4b75-b3e0-82656a667de7@192.168.203.4@tcp:555/0 lens 304/240 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.648196:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:70816:x1869759481779456:12345-192.168.203.4@tcp:256:ll_cfg_requeue.0 Request processed in 2244us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144444.648204:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00000040:1.0:1783144444.648207:0:94184:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2aefdda000 : new rpc_count 0 00000020:00000040:1.0:1783144444.648216:0:94184:0:(genops.c:900:class_export_put()) PUTting export ffff9c2aefdda000 : new refcount 9 00000100:00000040:2.0:1783144444.651104:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521180 x1869759481779584 msgsize 520 00000100:00100000:2.0:1783144444.651116:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.651204:0:26151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779584 00000100:00100000:2.0:1783144444.651211:0:26151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779584 00000020:00000040:2.0:1783144444.651214:0:26151:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a4230491b4 00000100:00100000:2.0:1783144444.651251:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5063 00000100:00000040:2.0:1783144444.651258:0:26151:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521180 x1869759481779584/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783144464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.651282:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2402:x1869759481779584:12345-192.168.203.4@tcp:8:ll_cfg_requeue.0 00000020:00000040:2.0:1783144444.651300:0:26151:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 9 - find 00010000:00000040:2.0:1783144444.651311:0:26151:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1783144444.651317:0:26151:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef' at ffff9c2ad3866000, cookie 0xad8e53a423049f75 00010000:00080000:2.0:1783144444.651323:0:26151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp recovering/t4294968831 exp ffff9c2ad3866000 cur 2979 last 1783144442 00000001:00000040:2.0:1783144444.651334:0:26151:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 21 00000020:00000040:2.0:1783144444.651339:0:26151:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=4 00000001:00000040:2.0:1783144444.651348:0:26151:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2ac31a8400) : new refcount 22 00000001:00000040:2.0:1783144444.651352:0:26151:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2ac31a8400) : new refcount 21 00002000:00100000:2.0:1783144444.651356:0:26151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef/ffff9c2ad3866000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783144444.651375:0:26151:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:2.0:1783144444.651386:0:26151:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c29c6022c60 for nid 192.168.203.4@tcp - ref 2 00000020:00000040:2.0:1783144444.651641:0:26151:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2ad08d99c0) now 10 - import 00000020:00000040:2.0:1783144444.651650:0:26151:0:(genops.c:1244:class_import_put()) import ffff9c2afab20800 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1783144444.651658:0:26151:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=5 00000100:00000040:2.0:1783144444.651660:0:26151:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.651669:0:26151:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.651673:0:26151:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c29c3649c40 refcount 9 to 192.168.203.4@tcp 00000020:00000040:2.0:1783144444.651676:0:26151:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=6 00000100:00000040:2.0:1783144444.651682:0:26151:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00000100:00080000:2.0:1783144444.651690:0:26151:0:(import.c:65:import_set_state_nolock()) ffff9c2afab20800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1783144444.651702:0:26151:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 5 00000020:00000040:2.0:1783144444.651704:0:26151:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2ad08d99c0) now 10 - find 00010000:00000040:2.0:1783144444.651715:0:26151:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 0, xid 1869759481779584 00010000:00080000:3.0:1783144444.651781:0:96764:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:3.0:1783144444.651786:0:96764:0:(ldlm_lib.c:2861:target_recovery_thread()) 1: request replay stage - 1 clients from t4294968852 00010000:00080000:3.0:1783144444.651789:0:96764:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 4294968852 00010000:00080000:3.0:1783144444.651794:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968852 00010000:00080000:3.0:1783144444.651797:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968852 00000100:00000040:2.0:1783144444.651886:0:26151:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.651894:0:26151:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.651965:0:26151:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.651973:0:26151:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521180 x1869759481779584/t0(0) o8->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:0/0 lens 520/416 e 0 to 0 dl 1783144464 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.651983:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2402:x1869759481779584:12345-192.168.203.4@tcp:8:ll_cfg_requeue.0 Request processed in 701us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144444.651993:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5063 00000100:00000040:2.0:1783144444.651996:0:26151:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.652006:0:26151:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 4 00000100:00000040:3.0:1783144444.655290:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20d8380 x1869759481752192 msgsize 440 00000100:00100000:3.0:1783144444.655300:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.655618:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752192 00000100:00100000:0.0:1783144444.655631:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752192 00000020:00000040:0.0:1783144444.655634:0:24812:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.655642:0:24812:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=5 00000100:00000040:0.0:1783144444.655667:0:24812:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.655704:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 794 00000100:00000040:0.0:1783144444.655708:0:24812:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.655714:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20d8380 x1869759481752192/t0(4294968852) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.655742:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2402:x1869759481752192:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:0.0:1783144444.655755:0:24812:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d8380 x1869759481752192/t0(4294968852) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.655763:0:24812:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968852, current: 4294968852, replaying 00010000:00000040:0.0:1783144444.655766:0:24812:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.655777:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d8380 x1869759481752192/t0(4294968852) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.655787:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+5:2402:x1869759481752192:12345-192.168.203.4@tcp:10:dd.0 Request processed in 48us (496us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.655799:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 794 00000100:00000040:0.0:1783144444.655802:0:24812:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.655808:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968852, next_transno: 4294968852 00010000:00080000:3.0:1783144444.655813:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968852) 00010000:00080000:3.0:1783144444.655824:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481752192 t4294968852 from 192.168.203.4@tcp req@ffff9c29c20d8380 x1869759481752192/t0(4294968852) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.655841:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d8380 x1869759481752192/t0(4294968852) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.655869:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x766:0x0] 00000001:00000040:3.0:1783144444.656636:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 1 00000020:00000040:3.0:1783144444.656641:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=6 00010000:00000040:3.0:1783144444.656689:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968852, xid 1869759481752192 00000100:00000040:3.0:1783144444.656698:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.656704:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.656850:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.656862:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.656869:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.656878:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 5 00010000:00080000:3.0:1783144444.656882:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968853 00010000:00080000:3.0:1783144444.656885:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968853 00000100:00000040:3.0:1783144444.658439:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20d8e00 x1869759481752448 msgsize 440 00000100:00100000:3.0:1783144444.658446:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.658495:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752448 00000100:00100000:0.0:1783144444.658500:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752448 00000020:00000040:0.0:1783144444.658502:0:24813:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.658505:0:24813:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=6 00000100:00000040:0.0:1783144444.658518:0:24813:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.658543:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 795 00000100:00000040:0.0:1783144444.658550:0:24813:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.658554:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20d8e00 x1869759481752448/t0(4294968853) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.658564:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481752448:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:0.0:1783144444.658570:0:24813:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d8e00 x1869759481752448/t0(4294968853) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.658574:0:24813:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968853, current: 4294968853, replaying 00010000:00000040:0.0:1783144444.658576:0:24813:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.658588:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d8e00 x1869759481752448/t0(4294968853) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.658594:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+6:2402:x1869759481752448:12345-192.168.203.4@tcp:10:dd.0 Request processed in 32us (154us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.658598:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 795 00000100:00000040:0.0:1783144444.658599:0:24813:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.658704:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968853, next_transno: 4294968853 00010000:00080000:1.0:1783144444.658709:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968853) 00010000:00080000:1.0:1783144444.658717:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481752448 t4294968853 from 192.168.203.4@tcp req@ffff9c29c20d8e00 x1869759481752448/t0(4294968853) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.658750:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d8e00 x1869759481752448/t0(4294968853) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783144444.658771:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x763:0x0] 00000001:00000040:1.0:1783144444.658854:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 2 00000020:00000040:1.0:1783144444.658857:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=7 00010000:00000040:1.0:1783144444.658878:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968853, xid 1869759481752448 00000100:00000040:1.0:1783144444.658890:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.658894:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.658920:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.658927:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.658931:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.658939:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 6 00010000:00080000:1.0:1783144444.658942:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968854 00010000:00080000:1.0:1783144444.658946:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968854 00000100:00000040:3.0:1783144444.660283:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20d9f80 x1869759481752832 msgsize 440 00000100:00100000:3.0:1783144444.660290:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.660366:0:24826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481752832 00000100:00100000:2.0:1783144444.660377:0:24826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481752832 00000020:00000040:2.0:1783144444.660380:0:24826:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.660384:0:24826:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=7 00000100:00000040:2.0:1783144444.660401:0:24826:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.660435:0:24826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 796 00000100:00000040:2.0:1783144444.660439:0:24826:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.660445:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20d9f80 x1869759481752832/t0(4294968854) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.660459:0:24826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2402:x1869759481752832:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.660468:0:24826:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d9f80 x1869759481752832/t0(4294968854) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.660476:0:24826:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968854, current: 4294968854, replaying 00010000:00000040:2.0:1783144444.660479:0:24826:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.660496:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d9f80 x1869759481752832/t0(4294968854) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.660506:0:24826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2402:x1869759481752832:12345-192.168.203.4@tcp:10:dd.0 Request processed in 49us (220us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.660513:0:24826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 796 00000100:00000040:2.0:1783144444.660517:0:24826:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.660778:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968854, next_transno: 4294968854 00010000:00080000:1.0:1783144444.660782:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968854) 00010000:00080000:1.0:1783144444.660789:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481752832 t4294968854 from 192.168.203.4@tcp req@ffff9c29c20d9f80 x1869759481752832/t0(4294968854) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.660804:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d9f80 x1869759481752832/t0(4294968854) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783144444.660821:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x762:0x0] 00000001:00000040:1.0:1783144444.660901:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 3 00000020:00000040:1.0:1783144444.660905:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=8 00010000:00000040:1.0:1783144444.660926:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968854, xid 1869759481752832 00000100:00000040:1.0:1783144444.660933:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.660939:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.660973:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.660981:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.660985:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.660995:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 7 00010000:00080000:1.0:1783144444.660999:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968855 00010000:00080000:1.0:1783144444.661002:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968855 00000100:00000040:3.0:1783144444.663088:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20dbb80 x1869759481755136 msgsize 440 00000100:00100000:3.0:1783144444.663097:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.663306:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481755136 00000100:00100000:0.0:1783144444.663315:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481755136 00000020:00000040:0.0:1783144444.663317:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.663321:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=8 00000100:00000040:0.0:1783144444.663341:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.663376:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 797 00000100:00000040:0.0:1783144444.663380:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.663386:0:8442:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20dbb80 x1869759481755136/t0(4294968855) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.663398:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2402:x1869759481755136:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:0.0:1783144444.663407:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20dbb80 x1869759481755136/t0(4294968855) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.663415:0:8442:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968855, current: 4294968855, replaying 00010000:00000040:0.0:1783144444.663417:0:8442:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.663432:0:8442:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20dbb80 x1869759481755136/t0(4294968855) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.663440:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+8:2402:x1869759481755136:12345-192.168.203.4@tcp:10:dd.0 Request processed in 44us (351us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.663446:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 797 00000100:00000040:0.0:1783144444.663449:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.663457:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968855, next_transno: 4294968855 00010000:00080000:3.0:1783144444.663462:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968855) 00010000:00080000:3.0:1783144444.663471:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481755136 t4294968855 from 192.168.203.4@tcp req@ffff9c29c20dbb80 x1869759481755136/t0(4294968855) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.663486:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20dbb80 x1869759481755136/t0(4294968855) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.663505:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x767:0x0] 00000001:00000040:3.0:1783144444.663706:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 4 00000020:00000040:3.0:1783144444.663710:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=9 00010000:00000040:3.0:1783144444.663748:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968855, xid 1869759481755136 00000100:00000040:3.0:1783144444.663757:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.663762:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.663851:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.663859:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.663863:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.663871:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 8 00010000:00080000:3.0:1783144444.663880:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968856 00010000:00080000:3.0:1783144444.663883:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968856 00000100:00000040:0.0:1783144444.665486:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc4380 x1869759481756288 msgsize 440 00000100:00100000:0.0:1783144444.665496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.665633:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481756288 00000100:00100000:3.0:1783144444.665639:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481756288 00000020:00000040:3.0:1783144444.665641:0:24828:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.665645:0:24828:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=9 00000100:00000040:3.0:1783144444.665660:0:24828:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.665695:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 798 00000100:00000040:3.0:1783144444.665699:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.665704:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc4380 x1869759481756288/t0(4294968856) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.665717:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2402:x1869759481756288:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:3.0:1783144444.665741:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc4380 x1869759481756288/t0(4294968856) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.665749:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968856, current: 4294968856, replaying 00010000:00000040:3.0:1783144444.665752:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.665764:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4380 x1869759481756288/t0(4294968856) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.665773:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+9:2402:x1869759481756288:12345-192.168.203.4@tcp:10:dd.0 Request processed in 59us (286us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.665780:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 798 00000100:00000040:3.0:1783144444.665836:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.665853:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968856, next_transno: 4294968856 00010000:00080000:3.0:1783144444.665857:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968856) 00010000:00080000:3.0:1783144444.665863:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481756288 t4294968856 from 192.168.203.4@tcp req@ffff9c2afabc4380 x1869759481756288/t0(4294968856) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.665891:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc4380 x1869759481756288/t0(4294968856) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.665910:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x775:0x0] 00000001:00000040:3.0:1783144444.666004:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 5 00000020:00000040:3.0:1783144444.666007:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=10 00010000:00000040:3.0:1783144444.666026:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968856, xid 1869759481756288 00000100:00000040:3.0:1783144444.666033:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.666038:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.666070:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.666076:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.666080:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.666086:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 9 00010000:00080000:3.0:1783144444.666090:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968857 00010000:00080000:3.0:1783144444.666092:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968857 00000100:00000040:0.0:1783144444.670816:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc4700 x1869759481757952 msgsize 440 00000100:00100000:0.0:1783144444.670830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.670884:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481757952 00000100:00100000:3.0:1783144444.670892:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481757952 00000020:00000040:3.0:1783144444.670895:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.670899:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=10 00000100:00000040:3.0:1783144444.670920:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.670961:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 799 00000100:00000040:3.0:1783144444.670966:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.670974:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc4700 x1869759481757952/t0(4294968857) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.670989:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2402:x1869759481757952:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:3.0:1783144444.671000:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc4700 x1869759481757952/t0(4294968857) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.671021:0:8443:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968857, current: 4294968857, replaying 00010000:00000040:3.0:1783144444.671024:0:8443:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.671038:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4700 x1869759481757952/t0(4294968857) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.671047:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+10:2402:x1869759481757952:12345-192.168.203.4@tcp:10:dd.0 Request processed in 61us (231us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.671054:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 799 00000100:00000040:3.0:1783144444.671057:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.671072:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968857, next_transno: 4294968857 00010000:00080000:3.0:1783144444.671075:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968857) 00010000:00080000:3.0:1783144444.671082:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481757952 t4294968857 from 192.168.203.4@tcp req@ffff9c2afabc4700 x1869759481757952/t0(4294968857) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.671096:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc4700 x1869759481757952/t0(4294968857) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.671121:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x768:0x0] 00000001:00000040:3.0:1783144444.671258:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 6 00000020:00000040:3.0:1783144444.671262:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=11 00010000:00000040:3.0:1783144444.671304:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968857, xid 1869759481757952 00000100:00000040:3.0:1783144444.671312:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.671319:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.671363:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.671372:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.671379:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.671390:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 10 00010000:00080000:3.0:1783144444.671394:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968858 00010000:00080000:3.0:1783144444.671398:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968858 00000100:00000040:3.0:1783144444.672645:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20d9500 x1869759481758720 msgsize 440 00000100:00100000:3.0:1783144444.672651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.672841:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481758720 00000100:00100000:1.0:1783144444.672852:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481758720 00000020:00000040:1.0:1783144444.672854:0:24827:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.672858:0:24827:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=11 00000100:00000040:1.0:1783144444.672872:0:24827:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.672905:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 800 00000100:00000040:1.0:1783144444.672909:0:24827:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.672915:0:24827:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20d9500 x1869759481758720/t0(4294968858) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.672929:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2402:x1869759481758720:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:1.0:1783144444.672936:0:24827:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d9500 x1869759481758720/t0(4294968858) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.672945:0:24827:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968858, current: 4294968858, replaying 00010000:00000040:1.0:1783144444.672948:0:24827:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.672966:0:24827:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d9500 x1869759481758720/t0(4294968858) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.672975:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2402:x1869759481758720:12345-192.168.203.4@tcp:10:dd.0 Request processed in 49us (329us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.672982:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 800 00000100:00000040:1.0:1783144444.672985:0:24827:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.673012:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968858, next_transno: 4294968858 00010000:00080000:3.0:1783144444.673017:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968858) 00010000:00080000:3.0:1783144444.673025:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481758720 t4294968858 from 192.168.203.4@tcp req@ffff9c29c20d9500 x1869759481758720/t0(4294968858) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.673041:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d9500 x1869759481758720/t0(4294968858) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.673061:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x765:0x0] 00000001:00000040:3.0:1783144444.673163:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 7 00000020:00000040:3.0:1783144444.673167:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=12 00010000:00000040:3.0:1783144444.673187:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968858, xid 1869759481758720 00000100:00000040:3.0:1783144444.673192:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.673196:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.673220:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.673225:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.673231:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.673240:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 11 00010000:00080000:3.0:1783144444.673243:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968859 00010000:00080000:3.0:1783144444.673247:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968859 00000100:00000040:1.0:1783144444.674453:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158bb80 x1869759481759104 msgsize 440 00000100:00100000:1.0:1783144444.674562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.674681:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481759104 00000100:00100000:3.0:1783144444.674686:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481759104 00000020:00000040:3.0:1783144444.674688:0:24814:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.674691:0:24814:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=12 00000100:00000040:3.0:1783144444.674710:0:24814:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.674778:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 801 00000100:00000040:3.0:1783144444.674782:0:24814:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.674789:0:24814:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158bb80 x1869759481759104/t0(4294968859) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.674810:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:2402:x1869759481759104:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:3.0:1783144444.674819:0:24814:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158bb80 x1869759481759104/t0(4294968859) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.674825:0:24814:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968859, current: 4294968859, replaying 00010000:00000040:3.0:1783144444.674828:0:24814:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.674844:0:24814:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158bb80 x1869759481759104/t0(4294968859) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.674853:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+12:2402:x1869759481759104:12345-192.168.203.4@tcp:10:dd.0 Request processed in 47us (398us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.674860:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 801 00000100:00000040:3.0:1783144444.674863:0:24814:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.674864:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968859, next_transno: 4294968859 00010000:00080000:1.0:1783144444.674870:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968859) 00010000:00080000:1.0:1783144444.674882:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481759104 t4294968859 from 192.168.203.4@tcp req@ffff9c2b0158bb80 x1869759481759104/t0(4294968859) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.674900:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158bb80 x1869759481759104/t0(4294968859) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783144444.674933:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x769:0x0] 00000001:00000040:1.0:1783144444.675043:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 8 00000020:00000040:1.0:1783144444.675048:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=13 00010000:00000040:1.0:1783144444.675070:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968859, xid 1869759481759104 00000100:00000040:1.0:1783144444.675077:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.675081:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.675111:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.675119:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.675124:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.675134:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 12 00010000:00080000:1.0:1783144444.675138:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968860 00010000:00080000:1.0:1783144444.675143:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968860 00000100:00000040:1.0:1783144444.676387:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01589500 x1869759481760000 msgsize 440 00000100:00100000:1.0:1783144444.676400:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.676445:0:24826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481760000 00000100:00100000:0.0:1783144444.676455:0:24826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481760000 00000020:00000040:0.0:1783144444.676458:0:24826:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.676462:0:24826:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=13 00000100:00000040:0.0:1783144444.676483:0:24826:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.676564:0:24826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 802 00000100:00000040:0.0:1783144444.676569:0:24826:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.676585:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01589500 x1869759481760000/t0(4294968860) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.676597:0:24826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2402:x1869759481760000:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:0.0:1783144444.676607:0:24826:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589500 x1869759481760000/t0(4294968860) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.676613:0:24826:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968860, current: 4294968860, replaying 00010000:00000040:0.0:1783144444.676616:0:24826:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.676636:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01589500 x1869759481760000/t0(4294968860) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.676643:0:24826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+13:2402:x1869759481760000:12345-192.168.203.4@tcp:10:dd.0 Request processed in 49us (256us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.676648:0:24826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 802 00000100:00000040:0.0:1783144444.676651:0:24826:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.676685:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968860, next_transno: 4294968860 00010000:00080000:3.0:1783144444.676688:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968860) 00010000:00080000:3.0:1783144444.676695:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481760000 t4294968860 from 192.168.203.4@tcp req@ffff9c2b01589500 x1869759481760000/t0(4294968860) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.676706:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589500 x1869759481760000/t0(4294968860) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.676749:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x764:0x0] 00000001:00000040:3.0:1783144444.676891:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 9 00000020:00000040:3.0:1783144444.676894:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=14 00010000:00000040:3.0:1783144444.676929:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968860, xid 1869759481760000 00000100:00000040:3.0:1783144444.676937:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.676943:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.676982:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.676994:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.677002:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.677015:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 13 00010000:00080000:3.0:1783144444.677018:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968861 00010000:00080000:3.0:1783144444.677021:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968861 00000100:00000040:0.0:1783144444.679806:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc4a80 x1869759481761664 msgsize 440 00000100:00100000:0.0:1783144444.679821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.680333:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481761664 00000100:00100000:1.0:1783144444.680344:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481761664 00000020:00000040:1.0:1783144444.680347:0:24830:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.680353:0:24830:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=14 00000100:00000040:1.0:1783144444.680377:0:24830:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.680425:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 803 00000100:00000040:1.0:1783144444.680430:0:24830:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.680437:0:24830:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc4a80 x1869759481761664/t0(4294968861) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.680451:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:2402:x1869759481761664:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:1.0:1783144444.680462:0:24830:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc4a80 x1869759481761664/t0(4294968861) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.680472:0:24830:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968861, current: 4294968861, replaying 00010000:00000040:1.0:1783144444.680480:0:24830:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.680498:0:24830:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc4a80 x1869759481761664/t0(4294968861) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.680509:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+14:2402:x1869759481761664:12345-192.168.203.4@tcp:10:dd.0 Request processed in 59us (703us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.680518:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 803 00000100:00000040:1.0:1783144444.680522:0:24830:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.680541:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968861, next_transno: 4294968861 00010000:00080000:2.0:1783144444.680549:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968861) 00010000:00080000:2.0:1783144444.680565:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481761664 t4294968861 from 192.168.203.4@tcp req@ffff9c2afabc4a80 x1869759481761664/t0(4294968861) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.680596:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc4a80 x1869759481761664/t0(4294968861) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783144444.680627:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76a:0x0] 00000001:00000040:2.0:1783144444.680818:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 10 00000020:00000040:2.0:1783144444.680823:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=15 00010000:00000040:2.0:1783144444.680859:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968861, xid 1869759481761664 00000100:00000040:2.0:1783144444.680869:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.680875:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.680922:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.680934:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.680946:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.680960:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 14 00010000:00080000:2.0:1783144444.680966:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968862 00010000:00080000:2.0:1783144444.680969:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968862 00000100:00000040:1.0:1783144444.683352:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158b480 x1869759481762304 msgsize 440 00000100:00100000:1.0:1783144444.683364:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.683459:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481762304 00000100:00100000:2.0:1783144444.683470:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481762304 00000020:00000040:2.0:1783144444.683473:0:24810:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.683478:0:24810:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=15 00000100:00000040:2.0:1783144444.683498:0:24810:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.683538:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 804 00000100:00000040:2.0:1783144444.683543:0:24810:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.683551:0:24810:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158b480 x1869759481762304/t0(4294968862) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.683568:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:2402:x1869759481762304:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.683581:0:24810:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158b480 x1869759481762304/t0(4294968862) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.683589:0:24810:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968862, current: 4294968862, replaying 00010000:00000040:2.0:1783144444.683592:0:24810:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.683611:0:24810:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158b480 x1869759481762304/t0(4294968862) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.683637:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968862, next_transno: 4294968862 00000100:00100000:2.0:1783144444.683639:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+15:2402:x1869759481762304:12345-192.168.203.4@tcp:10:dd.0 Request processed in 74us (284us total) trans 0 rc 0/-999 00010000:00080000:0.0:1783144444.683650:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968862) 00000100:00100000:2.0:1783144444.683658:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 804 00000100:00000040:2.0:1783144444.683668:0:24810:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:0.0:1783144444.683669:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481762304 t4294968862 from 192.168.203.4@tcp req@ffff9c2b0158b480 x1869759481762304/t0(4294968862) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.683697:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158b480 x1869759481762304/t0(4294968862) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783144444.683757:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76b:0x0] 00000001:00000040:0.0:1783144444.683921:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 11 00000020:00000040:0.0:1783144444.683925:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=16 00010000:00000040:0.0:1783144444.683968:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968862, xid 1869759481762304 00000100:00000040:0.0:1783144444.683984:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.683990:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144444.684039:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:0.0:1783144444.684049:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783144444.684056:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:0.0:1783144444.684068:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 15 00010000:00080000:0.0:1783144444.684072:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968863 00010000:00080000:0.0:1783144444.684076:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968863 00000100:00000040:1.0:1783144444.686814:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158aa00 x1869759481764480 msgsize 440 00000100:00100000:1.0:1783144444.686827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.686878:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481764480 00000100:00100000:2.0:1783144444.686886:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481764480 00000020:00000040:2.0:1783144444.686888:0:24812:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.686894:0:24812:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=16 00000100:00000040:2.0:1783144444.686909:0:24812:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.686946:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 805 00000100:00000040:2.0:1783144444.686949:0:24812:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.686954:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158aa00 x1869759481764480/t0(4294968863) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.686964:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:2402:x1869759481764480:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.686973:0:24812:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158aa00 x1869759481764480/t0(4294968863) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.686979:0:24812:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968863, current: 4294968863, replaying 00010000:00000040:2.0:1783144444.686981:0:24812:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.686994:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158aa00 x1869759481764480/t0(4294968863) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.687000:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+16:2402:x1869759481764480:12345-192.168.203.4@tcp:10:dd.0 Request processed in 38us (187us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.687008:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 805 00000100:00000040:2.0:1783144444.687010:0:24812:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:0.0:1783144444.687021:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968863, next_transno: 4294968863 00010000:00080000:0.0:1783144444.687028:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968863) 00010000:00080000:0.0:1783144444.687042:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481764480 t4294968863 from 192.168.203.4@tcp req@ffff9c2b0158aa00 x1869759481764480/t0(4294968863) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.687064:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158aa00 x1869759481764480/t0(4294968863) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783144444.687097:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76c:0x0] 00000001:00000040:0.0:1783144444.687251:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 12 00000020:00000040:0.0:1783144444.687260:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=17 00010000:00000040:0.0:1783144444.687303:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968863, xid 1869759481764480 00000100:00000040:0.0:1783144444.687314:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.687321:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144444.687367:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:0.0:1783144444.687377:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783144444.687384:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:0.0:1783144444.687394:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 16 00010000:00080000:0.0:1783144444.687399:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968864 00010000:00080000:0.0:1783144444.687403:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968864 00000100:00000040:1.0:1783144444.688556:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158ad80 x1869759481764864 msgsize 440 00000100:00100000:1.0:1783144444.688566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.688618:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481764864 00000100:00100000:2.0:1783144444.688632:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481764864 00000020:00000040:2.0:1783144444.688634:0:24827:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.688638:0:24827:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=17 00000100:00000040:2.0:1783144444.688654:0:24827:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.688695:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 806 00000100:00000040:2.0:1783144444.688702:0:24827:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.688710:0:24827:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158ad80 x1869759481764864/t0(4294968864) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.688752:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:2402:x1869759481764864:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.688764:0:24827:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158ad80 x1869759481764864/t0(4294968864) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.688772:0:24827:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968864, current: 4294968864, replaying 00010000:00000040:2.0:1783144444.688775:0:24827:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.688795:0:24827:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158ad80 x1869759481764864/t0(4294968864) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.688807:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+17:2402:x1869759481764864:12345-192.168.203.4@tcp:10:dd.0 Request processed in 85us (248us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.688815:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 806 00000100:00000040:2.0:1783144444.688819:0:24827:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.688822:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968864, next_transno: 4294968864 00010000:00080000:1.0:1783144444.688828:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968864) 00010000:00080000:1.0:1783144444.688840:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481764864 t4294968864 from 192.168.203.4@tcp req@ffff9c2b0158ad80 x1869759481764864/t0(4294968864) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.688859:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158ad80 x1869759481764864/t0(4294968864) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783144444.688884:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76d:0x0] 00000001:00000040:1.0:1783144444.688987:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 13 00000020:00000040:1.0:1783144444.688991:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=18 00010000:00000040:1.0:1783144444.689009:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968864, xid 1869759481764864 00000100:00000040:1.0:1783144444.689016:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.689020:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.689051:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.689060:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.689071:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.689080:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 17 00010000:00080000:1.0:1783144444.689084:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968865 00010000:00080000:1.0:1783144444.689088:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968865 00000100:00000040:1.0:1783144444.691228:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01589c00 x1869759481766272 msgsize 440 00000100:00100000:1.0:1783144444.691243:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.691357:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481766272 00000100:00100000:2.0:1783144444.691366:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481766272 00000020:00000040:2.0:1783144444.691369:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.691373:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=18 00000100:00000040:2.0:1783144444.691389:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.691430:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 807 00000100:00000040:2.0:1783144444.691433:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.691440:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01589c00 x1869759481766272/t0(4294968865) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.691467:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:2402:x1869759481766272:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.691479:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589c00 x1869759481766272/t0(4294968865) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.691486:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968865, current: 4294968865, replaying 00010000:00000040:2.0:1783144444.691490:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.691566:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01589c00 x1869759481766272/t0(4294968865) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.691577:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+18:2402:x1869759481766272:12345-192.168.203.4@tcp:10:dd.0 Request processed in 113us (349us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.691585:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 807 00000100:00000040:2.0:1783144444.691589:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:0.0:1783144444.691624:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968865, next_transno: 4294968865 00010000:00080000:0.0:1783144444.691635:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968865) 00010000:00080000:0.0:1783144444.691646:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481766272 t4294968865 from 192.168.203.4@tcp req@ffff9c2b01589c00 x1869759481766272/t0(4294968865) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.691665:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589c00 x1869759481766272/t0(4294968865) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783144444.692307:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76e:0x0] 00000001:00000040:0.0:1783144444.692448:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 14 00000020:00000040:0.0:1783144444.692452:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=19 00010000:00000040:0.0:1783144444.692480:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968865, xid 1869759481766272 00000100:00000040:0.0:1783144444.692488:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.692493:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144444.692544:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:0.0:1783144444.692551:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783144444.692556:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:0.0:1783144444.692564:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 18 00010000:00080000:0.0:1783144444.692569:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968866 00010000:00080000:0.0:1783144444.692572:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968866 00000100:00000040:0.0:1783144444.694763:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc7800 x1869759481767808 msgsize 440 00000100:00100000:0.0:1783144444.694772:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.694849:0:24826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481767808 00000100:00100000:1.0:1783144444.694855:0:24826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481767808 00000020:00000040:1.0:1783144444.694857:0:24826:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.694861:0:24826:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=19 00000100:00000040:1.0:1783144444.694879:0:24826:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.694918:0:24826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 808 00000100:00000040:1.0:1783144444.694922:0:24826:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.694928:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc7800 x1869759481767808/t0(4294968866) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.694941:0:24826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:2402:x1869759481767808:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:1.0:1783144444.694951:0:24826:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc7800 x1869759481767808/t0(4294968866) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.694959:0:24826:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968866, current: 4294968866, replaying 00010000:00000040:1.0:1783144444.694962:0:24826:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.694980:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7800 x1869759481767808/t0(4294968866) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.694989:0:24826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+19:2402:x1869759481767808:12345-192.168.203.4@tcp:10:dd.0 Request processed in 51us (225us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.694996:0:24826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 808 00000100:00000040:1.0:1783144444.694999:0:24826:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.695019:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968866, next_transno: 4294968866 00010000:00080000:3.0:1783144444.695024:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968866) 00010000:00080000:3.0:1783144444.695042:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481767808 t4294968866 from 192.168.203.4@tcp req@ffff9c2afabc7800 x1869759481767808/t0(4294968866) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.695061:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc7800 x1869759481767808/t0(4294968866) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.695081:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76f:0x0] 00000001:00000040:3.0:1783144444.695198:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 15 00000020:00000040:3.0:1783144444.695201:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=20 00010000:00000040:3.0:1783144444.695230:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968866, xid 1869759481767808 00000100:00000040:3.0:1783144444.695237:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.695242:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.695285:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.695292:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.695298:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.695306:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 19 00010000:00080000:3.0:1783144444.695310:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968867 00010000:00080000:3.0:1783144444.695313:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968867 00000100:00000040:2.0:1783144444.698106:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521880 x1869759481769344 msgsize 440 00000100:00100000:2.0:1783144444.698117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.698183:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769344 00000100:00100000:0.0:1783144444.698190:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769344 00000020:00000040:0.0:1783144444.698193:0:24828:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.698198:0:24828:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=20 00000100:00000040:0.0:1783144444.698217:0:24828:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.698255:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 809 00000100:00000040:0.0:1783144444.698259:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.698281:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521880 x1869759481769344/t0(4294968867) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.698306:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:2402:x1869759481769344:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:0.0:1783144444.698316:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01521880 x1869759481769344/t0(4294968867) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.698324:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968867, current: 4294968867, replaying 00010000:00000040:0.0:1783144444.698327:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.698345:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521880 x1869759481769344/t0(4294968867) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.698354:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+20:2402:x1869759481769344:12345-192.168.203.4@tcp:10:dd.0 Request processed in 52us (248us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.698361:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 809 00000100:00000040:0.0:1783144444.698364:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.698770:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968867, next_transno: 4294968867 00010000:00080000:2.0:1783144444.698776:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968867) 00010000:00080000:2.0:1783144444.698785:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481769344 t4294968867 from 192.168.203.4@tcp req@ffff9c2b01521880 x1869759481769344/t0(4294968867) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.698801:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01521880 x1869759481769344/t0(4294968867) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783144444.698823:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x771:0x0] 00000001:00000040:2.0:1783144444.698952:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 16 00000020:00000040:2.0:1783144444.698956:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=21 00010000:00000040:2.0:1783144444.698983:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968867, xid 1869759481769344 00000100:00000040:2.0:1783144444.698991:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.699002:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.699031:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.699038:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.699042:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.699050:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 20 00010000:00080000:2.0:1783144444.699053:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968868 00010000:00080000:2.0:1783144444.699056:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968868 00000100:00000040:1.0:1783144444.700333:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01588a80 x1869759481769600 msgsize 440 00000100:00100000:1.0:1783144444.700342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.700418:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481769600 00000100:00100000:2.0:1783144444.700425:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481769600 00000020:00000040:2.0:1783144444.700428:0:24810:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.700431:0:24810:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=21 00000100:00000040:2.0:1783144444.700447:0:24810:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.700476:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 810 00000100:00000040:2.0:1783144444.700479:0:24810:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.700486:0:24810:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01588a80 x1869759481769600/t0(4294968868) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.700500:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+21:2402:x1869759481769600:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.700510:0:24810:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588a80 x1869759481769600/t0(4294968868) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.700518:0:24810:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968868, current: 4294968868, replaying 00010000:00000040:2.0:1783144444.700520:0:24810:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.700531:0:24810:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588a80 x1869759481769600/t0(4294968868) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.700541:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+21:2402:x1869759481769600:12345-192.168.203.4@tcp:10:dd.0 Request processed in 44us (207us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.700548:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 810 00000100:00000040:2.0:1783144444.700551:0:24810:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.700574:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968868, next_transno: 4294968868 00010000:00080000:2.0:1783144444.700578:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968868) 00010000:00080000:2.0:1783144444.700595:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481769600 t4294968868 from 192.168.203.4@tcp req@ffff9c2b01588a80 x1869759481769600/t0(4294968868) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.700612:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588a80 x1869759481769600/t0(4294968868) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783144444.700631:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x770:0x0] 00000001:00000040:2.0:1783144444.700827:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 17 00000020:00000040:2.0:1783144444.700830:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=22 00010000:00000040:2.0:1783144444.700853:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968868, xid 1869759481769600 00000100:00000040:2.0:1783144444.700860:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.700865:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.700928:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.700936:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.700942:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.700950:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 21 00010000:00080000:2.0:1783144444.700953:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968869 00010000:00080000:2.0:1783144444.700958:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968869 00000100:00000040:3.0:1783144444.702339:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20db480 x1869759481770368 msgsize 440 00000100:00100000:3.0:1783144444.702349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.702374:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481770368 00000100:00100000:3.0:1783144444.702380:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481770368 00000020:00000040:3.0:1783144444.702389:0:24813:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.702392:0:24813:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=22 00000100:00000040:3.0:1783144444.702406:0:24813:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.702444:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 811 00000100:00000040:3.0:1783144444.702447:0:24813:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.702453:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20db480 x1869759481770368/t0(4294968869) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.702467:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2402:x1869759481770368:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:3.0:1783144444.702477:0:24813:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20db480 x1869759481770368/t0(4294968869) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.702485:0:24813:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968869, current: 4294968869, replaying 00010000:00000040:3.0:1783144444.702488:0:24813:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.702505:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20db480 x1869759481770368/t0(4294968869) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.702514:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+22:2402:x1869759481770368:12345-192.168.203.4@tcp:10:dd.0 Request processed in 50us (174us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.702521:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 811 00000100:00000040:3.0:1783144444.702524:0:24813:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.702614:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968869, next_transno: 4294968869 00010000:00080000:2.0:1783144444.702618:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968869) 00010000:00080000:2.0:1783144444.702625:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481770368 t4294968869 from 192.168.203.4@tcp req@ffff9c29c20db480 x1869759481770368/t0(4294968869) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.702640:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20db480 x1869759481770368/t0(4294968869) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783144444.702661:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x772:0x0] 00000001:00000040:2.0:1783144444.702772:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 18 00000020:00000040:2.0:1783144444.702776:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=23 00010000:00000040:2.0:1783144444.702803:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968869, xid 1869759481770368 00000100:00000040:2.0:1783144444.702810:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.702814:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.702840:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.702847:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.702852:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.702859:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 22 00010000:00080000:2.0:1783144444.702863:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968870 00010000:00080000:2.0:1783144444.702866:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968870 00000100:00000040:2.0:1783144444.706050:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01522680 x1869759481772032 msgsize 440 00000100:00100000:2.0:1783144444.706061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.706090:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772032 00000100:00100000:2.0:1783144444.706096:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772032 00000020:00000040:2.0:1783144444.706099:0:24827:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.706103:0:24827:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=23 00000100:00000040:2.0:1783144444.706123:0:24827:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.706157:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 812 00000100:00000040:2.0:1783144444.706162:0:24827:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.706170:0:24827:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01522680 x1869759481772032/t0(4294968870) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.706185:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:2402:x1869759481772032:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.706194:0:24827:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01522680 x1869759481772032/t0(4294968870) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.706202:0:24827:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968870, current: 4294968870, replaying 00010000:00000040:2.0:1783144444.706205:0:24827:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.706221:0:24827:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01522680 x1869759481772032/t0(4294968870) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.706247:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968870, next_transno: 4294968870 00000100:00100000:2.0:1783144444.706249:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+23:2402:x1869759481772032:12345-192.168.203.4@tcp:10:dd.0 Request processed in 67us (198us total) trans 0 rc 0/-999 00010000:00080000:3.0:1783144444.706253:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968870) 00000100:00100000:2.0:1783144444.706275:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 812 00000100:00000040:2.0:1783144444.706281:0:24827:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.706283:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481772032 t4294968870 from 192.168.203.4@tcp req@ffff9c2b01522680 x1869759481772032/t0(4294968870) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.706301:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01522680 x1869759481772032/t0(4294968870) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.706323:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x774:0x0] 00000001:00000040:3.0:1783144444.706459:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 19 00000020:00000040:3.0:1783144444.706462:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=24 00010000:00000040:3.0:1783144444.706490:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968870, xid 1869759481772032 00000100:00000040:3.0:1783144444.706498:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.706503:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.706540:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.706547:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.706553:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.706563:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 23 00010000:00080000:3.0:1783144444.706567:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968871 00010000:00080000:3.0:1783144444.706571:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968871 00000100:00000040:0.0:1783144444.707687:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2afabc7480 x1869759481771904 msgsize 440 00000100:00100000:0.0:1783144444.707694:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.707811:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481771904 00000100:00100000:2.0:1783144444.707816:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481771904 00000020:00000040:2.0:1783144444.707818:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.707821:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=24 00000100:00000040:2.0:1783144444.707835:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.707860:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 813 00000100:00000040:2.0:1783144444.707864:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.707870:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2afabc7480 x1869759481771904/t0(4294968871) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.707883:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2afabc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+24:2402:x1869759481771904:12345-192.168.203.4@tcp:10:dd.0 00000020:00000040:2.0:1783144444.707891:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc7480 x1869759481771904/t0(4294968871) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.707898:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968871, current: 4294968871, replaying 00010000:00000040:2.0:1783144444.707900:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.707908:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2afabc7480 x1869759481771904/t0(4294968871) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.707918:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2afabc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+24:2402:x1869759481771904:12345-192.168.203.4@tcp:10:dd.0 Request processed in 36us (229us total) trans 0 rc 0/-999 00010000:00080000:3.0:1783144444.707919:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968871, next_transno: 4294968871 00010000:00080000:3.0:1783144444.707928:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968871) 00000100:00100000:2.0:1783144444.707930:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 813 00000100:00000040:2.0:1783144444.707935:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.707940:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481771904 t4294968871 from 192.168.203.4@tcp req@ffff9c2afabc7480 x1869759481771904/t0(4294968871) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.707958:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2afabc7480 x1869759481771904/t0(4294968871) o10->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 440/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.708182:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x773:0x0] 00000001:00000040:3.0:1783144444.708276:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 20 00000020:00000040:3.0:1783144444.708280:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=25 00010000:00000040:3.0:1783144444.708299:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968871, xid 1869759481771904 00000100:00000040:3.0:1783144444.708305:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.708310:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.708338:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.708345:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.708350:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.708361:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 24 00010000:00080000:3.0:1783144444.708364:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968872 00010000:00080000:3.0:1783144444.708375:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968872 00000100:00000040:3.0:1783144444.709622:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20daa00 x1869759481772672 msgsize 1512 00000100:00100000:3.0:1783144444.709630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.709684:0:24826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772672 00000100:00100000:0.0:1783144444.709689:0:24826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772672 00000020:00000040:0.0:1783144444.709692:0:24826:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.709695:0:24826:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=25 00000100:00000040:0.0:1783144444.709710:0:24826:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.709778:0:24826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 814 00000100:00000040:0.0:1783144444.709782:0:24826:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.709788:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20daa00 x1869759481772672/t0(4294968872) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.709801:0:24826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2402:x1869759481772672:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:0.0:1783144444.709809:0:24826:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20daa00 x1869759481772672/t0(4294968872) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.709823:0:24826:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968872, current: 4294968872, replaying 00010000:00000040:0.0:1783144444.709826:0:24826:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.709838:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20daa00 x1869759481772672/t0(4294968872) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.709845:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968872, next_transno: 4294968872 00000100:00100000:0.0:1783144444.709849:0:24826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+25:2402:x1869759481772672:12345-192.168.203.4@tcp:4:dd.0 Request processed in 50us (223us total) trans 0 rc 0/-999 00010000:00080000:3.0:1783144444.709851:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968872) 00000100:00100000:0.0:1783144444.709864:0:24826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 814 00010000:00080000:3.0:1783144444.709865:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481772672 t4294968872 from 192.168.203.4@tcp req@ffff9c29c20daa00 x1869759481772672/t0(4294968872) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:0.0:1783144444.709869:0:24826:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00000020:00000040:3.0:1783144444.709889:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20daa00 x1869759481772672/t0(4294968872) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783144444.709917:0:96764:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:3.0:1783144444.710149:0:96764:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:3.0:1783144444.710213:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783144444.710238:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:3.0:1783144444.710242:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783144444.710469:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 21 00000020:00000040:3.0:1783144444.710473:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=26 00010000:00000040:3.0:1783144444.711402:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968872, xid 1869759481772672 00000100:00000040:3.0:1783144444.711412:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.711417:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.711449:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.711456:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.711461:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.711470:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 25 00010000:00080000:3.0:1783144444.711474:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968873 00010000:00080000:3.0:1783144444.711479:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968873 00000100:00000040:2.0:1783144444.713305:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01521f80 x1869759481772928 msgsize 1512 00000100:00100000:2.0:1783144444.713320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.713420:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481772928 00000100:00100000:0.0:1783144444.713428:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481772928 00000020:00000040:0.0:1783144444.713430:0:24828:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.713435:0:24828:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=26 00000100:00000040:0.0:1783144444.713454:0:24828:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.713497:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 815 00000100:00000040:0.0:1783144444.713503:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.713511:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01521f80 x1869759481772928/t0(4294968873) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.713525:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2402:x1869759481772928:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:0.0:1783144444.713536:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01521f80 x1869759481772928/t0(4294968873) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.713555:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968873, current: 4294968873, replaying 00010000:00000040:0.0:1783144444.713559:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.713577:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01521f80 x1869759481772928/t0(4294968873) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.713594:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+26:2402:x1869759481772928:12345-192.168.203.4@tcp:4:dd.0 Request processed in 72us (288us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.713608:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 815 00000100:00000040:0.0:1783144444.713610:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.713653:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968873, next_transno: 4294968873 00010000:00080000:3.0:1783144444.713657:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968873) 00010000:00080000:3.0:1783144444.713670:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481772928 t4294968873 from 192.168.203.4@tcp req@ffff9c2b01521f80 x1869759481772928/t0(4294968873) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.713689:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01521f80 x1869759481772928/t0(4294968873) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.713778:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783144444.713801:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:3.0:1783144444.713814:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783144444.713988:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 22 00000020:00000040:3.0:1783144444.713992:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=27 00010000:00000040:3.0:1783144444.714477:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968873, xid 1869759481772928 00000100:00000040:3.0:1783144444.714486:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.714491:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.714528:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.714536:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.714541:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.714549:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 26 00010000:00080000:3.0:1783144444.714553:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968874 00010000:00080000:3.0:1783144444.714556:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968874 00000100:00000040:0.0:1783144444.715820:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c29cab79880 x1869759481773184 msgsize 1512 00000100:00100000:0.0:1783144444.715828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.715936:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773184 00000100:00100000:2.0:1783144444.715942:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773184 00000020:00000040:2.0:1783144444.715944:0:24812:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.715948:0:24812:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=27 00000100:00000040:2.0:1783144444.715965:0:24812:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.715998:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 816 00000100:00000040:2.0:1783144444.716002:0:24812:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.716008:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29cab79880 x1869759481773184/t0(4294968874) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.716023:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2402:x1869759481773184:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:2.0:1783144444.716032:0:24812:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab79880 x1869759481773184/t0(4294968874) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.716040:0:24812:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968874, current: 4294968874, replaying 00010000:00000040:2.0:1783144444.716043:0:24812:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.716052:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab79880 x1869759481773184/t0(4294968874) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.716061:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+27:2402:x1869759481773184:12345-192.168.203.4@tcp:4:dd.0 Request processed in 41us (240us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.716068:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 816 00000100:00000040:2.0:1783144444.716071:0:24812:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:0.0:1783144444.716120:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968874, next_transno: 4294968874 00010000:00080000:0.0:1783144444.716124:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968874) 00010000:00080000:0.0:1783144444.716130:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481773184 t4294968874 from 192.168.203.4@tcp req@ffff9c29cab79880 x1869759481773184/t0(4294968874) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.716145:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab79880 x1869759481773184/t0(4294968874) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.716213:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783144444.716245:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:0.0:1783144444.716248:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783144444.716435:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 23 00000020:00000040:0.0:1783144444.716439:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=28 00010000:00000040:0.0:1783144444.716682:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968874, xid 1869759481773184 00000100:00000040:0.0:1783144444.716691:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.716696:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144444.716745:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:0.0:1783144444.716754:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783144444.716759:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:0.0:1783144444.716768:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 27 00010000:00080000:0.0:1783144444.716772:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968875 00010000:00080000:0.0:1783144444.716776:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968875 00000100:00000040:0.0:1783144444.718832:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29cab79180 x1869759481773440 msgsize 1512 00000100:00100000:0.0:1783144444.718843:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.718996:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773440 00000100:00100000:3.0:1783144444.719002:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773440 00000020:00000040:3.0:1783144444.719005:0:24813:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.719009:0:24813:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=28 00000100:00000040:3.0:1783144444.719024:0:24813:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.719059:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 817 00000100:00000040:3.0:1783144444.719062:0:24813:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.719069:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29cab79180 x1869759481773440/t0(4294968875) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.719084:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2402:x1869759481773440:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:3.0:1783144444.719101:0:24813:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab79180 x1869759481773440/t0(4294968875) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.719108:0:24813:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968875, current: 4294968875, replaying 00010000:00000040:3.0:1783144444.719111:0:24813:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.719169:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab79180 x1869759481773440/t0(4294968875) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.719178:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+28:2402:x1869759481773440:12345-192.168.203.4@tcp:4:dd.0 Request processed in 97us (345us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.719186:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 817 00000100:00000040:3.0:1783144444.719189:0:24813:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:0.0:1783144444.719219:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968875, next_transno: 4294968875 00010000:00080000:0.0:1783144444.719222:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968875) 00010000:00080000:0.0:1783144444.719228:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481773440 t4294968875 from 192.168.203.4@tcp req@ffff9c29cab79180 x1869759481773440/t0(4294968875) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.719244:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab79180 x1869759481773440/t0(4294968875) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.719402:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783144444.719420:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:0.0:1783144444.719423:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783144444.719660:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 24 00000020:00000040:0.0:1783144444.719664:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=29 00010000:00000040:0.0:1783144444.719936:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968875, xid 1869759481773440 00000100:00000040:0.0:1783144444.719944:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.719948:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144444.719979:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:0.0:1783144444.719984:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783144444.719989:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:0.0:1783144444.719996:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 28 00010000:00080000:0.0:1783144444.719999:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968876 00010000:00080000:0.0:1783144444.720002:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968876 00000100:00000040:2.0:1783144444.721234:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01520e00 x1869759481773696 msgsize 1512 00000100:00100000:2.0:1783144444.721241:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.721360:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773696 00000100:00100000:3.0:1783144444.721365:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773696 00000020:00000040:3.0:1783144444.721367:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.721370:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=29 00000100:00000040:3.0:1783144444.721382:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.721436:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 818 00000100:00000040:3.0:1783144444.721444:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.721450:0:8442:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01520e00 x1869759481773696/t0(4294968876) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.721463:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2402:x1869759481773696:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:3.0:1783144444.721472:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01520e00 x1869759481773696/t0(4294968876) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.721479:0:8442:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968876, current: 4294968876, replaying 00010000:00000040:3.0:1783144444.721482:0:8442:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.721499:0:8442:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01520e00 x1869759481773696/t0(4294968876) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.721514:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+29:2402:x1869759481773696:12345-192.168.203.4@tcp:4:dd.0 Request processed in 53us (277us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.721521:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 818 00000100:00000040:3.0:1783144444.721524:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:0.0:1783144444.721569:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968876, next_transno: 4294968876 00010000:00080000:0.0:1783144444.721573:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968876) 00010000:00080000:0.0:1783144444.721580:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481773696 t4294968876 from 192.168.203.4@tcp req@ffff9c2b01520e00 x1869759481773696/t0(4294968876) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.721592:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01520e00 x1869759481773696/t0(4294968876) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783144444.721636:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783144444.721656:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:0.0:1783144444.721659:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783144444.722388:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 25 00000020:00000040:0.0:1783144444.722392:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=30 00010000:00000040:0.0:1783144444.722594:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968876, xid 1869759481773696 00000100:00000040:0.0:1783144444.722602:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:0.0:1783144444.722608:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:0.0:1783144444.722643:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:0.0:1783144444.722649:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783144444.722654:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:0.0:1783144444.722660:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 29 00010000:00080000:0.0:1783144444.722664:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968877 00010000:00080000:0.0:1783144444.722668:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968877 00000100:00000040:1.0:1783144444.724326:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01589180 x1869759481773952 msgsize 1512 00000100:00100000:1.0:1783144444.724334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.724567:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481773952 00000100:00100000:2.0:1783144444.724572:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481773952 00000020:00000040:2.0:1783144444.724574:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.724578:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=30 00000100:00000040:2.0:1783144444.724595:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.724625:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 819 00000100:00000040:2.0:1783144444.724629:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.724634:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01589180 x1869759481773952/t0(4294968877) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.724645:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2402:x1869759481773952:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:2.0:1783144444.724653:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589180 x1869759481773952/t0(4294968877) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.724659:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968877, current: 4294968877, replaying 00010000:00000040:2.0:1783144444.724661:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.724676:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01589180 x1869759481773952/t0(4294968877) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.724684:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+30:2402:x1869759481773952:12345-192.168.203.4@tcp:4:dd.0 Request processed in 39us (357us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.724689:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 819 00000100:00000040:2.0:1783144444.724691:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.725317:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968877, next_transno: 4294968877 00010000:00080000:1.0:1783144444.725322:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968877) 00010000:00080000:1.0:1783144444.725329:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481773952 t4294968877 from 192.168.203.4@tcp req@ffff9c2b01589180 x1869759481773952/t0(4294968877) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.725343:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589180 x1869759481773952/t0(4294968877) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.725401:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.725419:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.725421:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.725566:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 26 00000020:00000040:1.0:1783144444.725569:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=31 00010000:00000040:1.0:1783144444.725895:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968877, xid 1869759481773952 00000100:00000040:1.0:1783144444.725905:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.725913:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.725979:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.725988:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.725996:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.726004:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 30 00010000:00080000:1.0:1783144444.726008:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968878 00010000:00080000:1.0:1783144444.726011:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968878 00000100:00000040:3.0:1783144444.726995:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20dad80 x1869759481774208 msgsize 1512 00000100:00100000:3.0:1783144444.727003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.727045:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774208 00000100:00100000:1.0:1783144444.727050:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774208 00000020:00000040:1.0:1783144444.727053:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.727056:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=31 00000100:00000040:1.0:1783144444.727078:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.727108:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 820 00000100:00000040:1.0:1783144444.727110:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.727116:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20dad80 x1869759481774208/t0(4294968878) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.727130:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2402:x1869759481774208:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:1.0:1783144444.727138:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20dad80 x1869759481774208/t0(4294968878) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.727144:0:8443:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968878, current: 4294968878, replaying 00010000:00000040:1.0:1783144444.727147:0:8443:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.727159:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20dad80 x1869759481774208/t0(4294968878) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.727168:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+31:2402:x1869759481774208:12345-192.168.203.4@tcp:4:dd.0 Request processed in 42us (171us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.727175:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 820 00010000:00080000:3.0:1783144444.727176:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968878, next_transno: 4294968878 00000100:00000040:1.0:1783144444.727178:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.727182:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968878) 00010000:00080000:3.0:1783144444.727194:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481774208 t4294968878 from 192.168.203.4@tcp req@ffff9c29c20dad80 x1869759481774208/t0(4294968878) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.727208:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20dad80 x1869759481774208/t0(4294968878) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.727321:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783144444.727334:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:3.0:1783144444.727336:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783144444.727511:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 27 00000020:00000040:3.0:1783144444.727515:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=32 00010000:00000040:1.0:1783144444.728427:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968878, xid 1869759481774208 00000100:00000040:1.0:1783144444.728435:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.728441:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.728479:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.728487:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.728492:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.728500:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 31 00010000:00080000:1.0:1783144444.728504:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968879 00010000:00080000:1.0:1783144444.728507:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968879 00000100:00000040:2.0:1783144444.730383:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca08fb80 x1869759481774464 msgsize 1512 00000100:00100000:2.0:1783144444.730392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.730577:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774464 00000100:00100000:0.0:1783144444.730584:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774464 00000020:00000040:0.0:1783144444.730586:0:24828:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.730590:0:24828:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=32 00000100:00000040:0.0:1783144444.730606:0:24828:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.730643:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 821 00000100:00000040:0.0:1783144444.730647:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.730652:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca08fb80 x1869759481774464/t0(4294968879) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.730665:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:2402:x1869759481774464:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:0.0:1783144444.730674:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29ca08fb80 x1869759481774464/t0(4294968879) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.730682:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968879, current: 4294968879, replaying 00010000:00000040:0.0:1783144444.730685:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.730697:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca08fb80 x1869759481774464/t0(4294968879) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.730710:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+32:2402:x1869759481774464:12345-192.168.203.4@tcp:4:dd.0 Request processed in 47us (326us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.730716:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 821 00000100:00000040:0.0:1783144444.730719:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.730869:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968879, next_transno: 4294968879 00010000:00080000:1.0:1783144444.730879:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968879) 00010000:00080000:1.0:1783144444.730885:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481774464 t4294968879 from 192.168.203.4@tcp req@ffff9c29ca08fb80 x1869759481774464/t0(4294968879) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.730901:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29ca08fb80 x1869759481774464/t0(4294968879) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.730960:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.730979:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.730982:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.731160:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 28 00000020:00000040:1.0:1783144444.731165:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=33 00010000:00000040:1.0:1783144444.731669:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968879, xid 1869759481774464 00000100:00000040:1.0:1783144444.731678:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.731684:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.731716:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.731745:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.731751:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.731759:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 32 00010000:00080000:1.0:1783144444.731764:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968880 00010000:00080000:1.0:1783144444.731767:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968880 00000100:00000040:2.0:1783144444.734379:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c29ca08d880 x1869759481774720 msgsize 1512 00000100:00100000:2.0:1783144444.734388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144444.734424:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774720 00000100:00100000:0.0:1783144444.734430:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774720 00000020:00000040:0.0:1783144444.734432:0:24812:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:0.0:1783144444.734435:0:24812:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=33 00000100:00000040:0.0:1783144444.734448:0:24812:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783144444.734478:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 822 00000100:00000040:0.0:1783144444.734480:0:24812:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:0.0:1783144444.734485:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29ca08d880 x1869759481774720/t0(4294968880) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.734494:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:2402:x1869759481774720:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:0.0:1783144444.734500:0:24812:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29ca08d880 x1869759481774720/t0(4294968880) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783144444.734505:0:24812:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968880, current: 4294968880, replaying 00010000:00000040:0.0:1783144444.734507:0:24812:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:0.0:1783144444.734552:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29ca08d880 x1869759481774720/t0(4294968880) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783144444.734563:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+33:2402:x1869759481774720:12345-192.168.203.4@tcp:4:dd.0 Request processed in 69us (182us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783144444.734570:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 822 00000100:00000040:0.0:1783144444.734572:0:24812:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.734595:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968880, next_transno: 4294968880 00010000:00080000:1.0:1783144444.734598:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968880) 00010000:00080000:1.0:1783144444.734603:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481774720 t4294968880 from 192.168.203.4@tcp req@ffff9c29ca08d880 x1869759481774720/t0(4294968880) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.734614:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29ca08d880 x1869759481774720/t0(4294968880) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.734664:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.734688:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.734698:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.734991:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 29 00000020:00000040:1.0:1783144444.734994:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=34 00010000:00000040:1.0:1783144444.735756:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968880, xid 1869759481774720 00000100:00000040:1.0:1783144444.735765:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.735770:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.735807:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.735814:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.735819:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.735827:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 33 00010000:00080000:1.0:1783144444.735831:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968881 00010000:00080000:1.0:1783144444.735834:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968881 00000100:00000040:0.0:1783144444.738052:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29cab7b800 x1869759481774976 msgsize 1512 00000100:00100000:0.0:1783144444.738065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.738118:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481774976 00000100:00100000:3.0:1783144444.738125:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481774976 00000020:00000040:3.0:1783144444.738127:0:24813:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.738131:0:24813:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=34 00000100:00000040:3.0:1783144444.738148:0:24813:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.738208:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 823 00000100:00000040:3.0:1783144444.738213:0:24813:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.738218:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29cab7b800 x1869759481774976/t0(4294968881) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.738231:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2402:x1869759481774976:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:3.0:1783144444.738246:0:24813:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab7b800 x1869759481774976/t0(4294968881) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.738253:0:24813:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968881, current: 4294968881, replaying 00010000:00000040:3.0:1783144444.738256:0:24813:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.738279:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab7b800 x1869759481774976/t0(4294968881) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.738295:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+34:2402:x1869759481774976:12345-192.168.203.4@tcp:4:dd.0 Request processed in 65us (242us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.738301:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 823 00000100:00000040:3.0:1783144444.738304:0:24813:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.738321:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968881, next_transno: 4294968881 00010000:00080000:1.0:1783144444.738326:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968881) 00010000:00080000:1.0:1783144444.738335:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481774976 t4294968881 from 192.168.203.4@tcp req@ffff9c29cab7b800 x1869759481774976/t0(4294968881) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.738352:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab7b800 x1869759481774976/t0(4294968881) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.738420:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.738438:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.738441:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.738629:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 30 00000020:00000040:1.0:1783144444.738633:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=35 00010000:00000040:1.0:1783144444.738897:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968881, xid 1869759481774976 00000100:00000040:1.0:1783144444.738906:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.738912:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.738938:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.738945:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.738957:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.738966:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 34 00010000:00080000:1.0:1783144444.738970:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968882 00010000:00080000:1.0:1783144444.738974:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968882 00000100:00000040:2.0:1783144444.741157:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aef484380 x1869759481775232 msgsize 1512 00000100:00100000:2.0:1783144444.741165:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.741199:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775232 00000100:00100000:2.0:1783144444.741204:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775232 00000020:00000040:2.0:1783144444.741207:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.741211:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=35 00000100:00000040:2.0:1783144444.741228:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.741275:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 824 00000100:00000040:2.0:1783144444.741279:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.741284:0:8442:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aef484380 x1869759481775232/t0(4294968882) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.741298:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2402:x1869759481775232:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:2.0:1783144444.741304:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2aef484380 x1869759481775232/t0(4294968882) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.741309:0:8442:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968882, current: 4294968882, replaying 00010000:00000040:2.0:1783144444.741310:0:8442:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.741319:0:8442:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aef484380 x1869759481775232/t0(4294968882) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.741331:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+35:2402:x1869759481775232:12345-192.168.203.4@tcp:4:dd.0 Request processed in 36us (171us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.741337:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 824 00000100:00000040:2.0:1783144444.741340:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.741358:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968882, next_transno: 4294968882 00010000:00080000:2.0:1783144444.741361:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968882) 00010000:00080000:2.0:1783144444.741368:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481775232 t4294968882 from 192.168.203.4@tcp req@ffff9c2aef484380 x1869759481775232/t0(4294968882) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.741382:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2aef484380 x1869759481775232/t0(4294968882) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.741424:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783144444.741439:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:2.0:1783144444.741441:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783144444.741599:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 31 00000020:00000040:2.0:1783144444.741608:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=36 00010000:00000040:2.0:1783144444.741938:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968882, xid 1869759481775232 00000100:00000040:2.0:1783144444.741946:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.741951:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.741972:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.741978:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.741982:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.741988:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 35 00010000:00080000:2.0:1783144444.741990:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968883 00010000:00080000:2.0:1783144444.741993:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968883 00000100:00000040:1.0:1783144444.743889:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158b800 x1869759481775488 msgsize 1512 00000100:00100000:1.0:1783144444.743900:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.743929:0:24826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775488 00000100:00100000:1.0:1783144444.743934:0:24826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775488 00000020:00000040:1.0:1783144444.743937:0:24826:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.743940:0:24826:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=36 00000100:00000040:1.0:1783144444.743955:0:24826:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.743985:0:24826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 825 00000100:00000040:1.0:1783144444.743989:0:24826:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.743995:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158b800 x1869759481775488/t0(4294968883) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.744009:0:24826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+36:2402:x1869759481775488:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:1.0:1783144444.744017:0:24826:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158b800 x1869759481775488/t0(4294968883) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.744025:0:24826:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968883, current: 4294968883, replaying 00010000:00000040:1.0:1783144444.744028:0:24826:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.744036:0:24826:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158b800 x1869759481775488/t0(4294968883) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.744046:0:24826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+36:2402:x1869759481775488:12345-192.168.203.4@tcp:4:dd.0 Request processed in 39us (155us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.744052:0:24826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 825 00000100:00000040:1.0:1783144444.744055:0:24826:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.744081:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968883, next_transno: 4294968883 00010000:00080000:1.0:1783144444.744085:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968883) 00010000:00080000:1.0:1783144444.744091:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481775488 t4294968883 from 192.168.203.4@tcp req@ffff9c2b0158b800 x1869759481775488/t0(4294968883) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.744105:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158b800 x1869759481775488/t0(4294968883) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.744155:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.744170:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.744173:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.745003:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 32 00000020:00000040:1.0:1783144444.745007:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=37 00010000:00000040:1.0:1783144444.745036:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968883, xid 1869759481775488 00000100:00000040:1.0:1783144444.745044:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.745049:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.745110:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.745118:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.745122:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.745129:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 36 00010000:00080000:1.0:1783144444.745132:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968884 00010000:00080000:1.0:1783144444.745135:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968884 00000100:00000040:3.0:1783144444.746518:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20d9c00 x1869759481775744 msgsize 1512 00000100:00100000:3.0:1783144444.746529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.746564:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481775744 00000100:00100000:1.0:1783144444.746570:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481775744 00000020:00000040:1.0:1783144444.746572:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.746575:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=37 00000100:00000040:1.0:1783144444.746589:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.746623:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 826 00000100:00000040:1.0:1783144444.746626:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.746632:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20d9c00 x1869759481775744/t0(4294968884) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.746658:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:2402:x1869759481775744:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:1.0:1783144444.746667:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d9c00 x1869759481775744/t0(4294968884) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.746674:0:8443:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968884, current: 4294968884, replaying 00010000:00000040:1.0:1783144444.746677:0:8443:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.746686:0:8443:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20d9c00 x1869759481775744/t0(4294968884) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.746695:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+37:2402:x1869759481775744:12345-192.168.203.4@tcp:4:dd.0 Request processed in 40us (182us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.746700:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 826 00000100:00000040:1.0:1783144444.746703:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.746715:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968884, next_transno: 4294968884 00010000:00080000:1.0:1783144444.746718:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968884) 00010000:00080000:1.0:1783144444.746766:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481775744 t4294968884 from 192.168.203.4@tcp req@ffff9c29c20d9c00 x1869759481775744/t0(4294968884) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.746779:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20d9c00 x1869759481775744/t0(4294968884) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.746844:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.746858:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.746861:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.746990:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 33 00000020:00000040:1.0:1783144444.746994:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=38 00010000:00000040:1.0:1783144444.747246:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968884, xid 1869759481775744 00000100:00000040:1.0:1783144444.747253:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.747277:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.747309:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.747316:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.747321:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.747327:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 37 00010000:00080000:1.0:1783144444.747331:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968885 00010000:00080000:1.0:1783144444.747335:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968885 00000100:00000040:1.0:1783144444.748777:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01588000 x1869759481776000 msgsize 1512 00000100:00100000:1.0:1783144444.748792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.748868:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776000 00000100:00100000:3.0:1783144444.748875:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776000 00000020:00000040:3.0:1783144444.748877:0:24814:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.748880:0:24814:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=38 00000100:00000040:3.0:1783144444.748896:0:24814:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.748979:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 827 00000100:00000040:3.0:1783144444.748985:0:24814:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.748993:0:24814:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01588000 x1869759481776000/t0(4294968885) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.749008:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:2402:x1869759481776000:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:3.0:1783144444.749018:0:24814:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588000 x1869759481776000/t0(4294968885) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.749026:0:24814:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968885, current: 4294968885, replaying 00010000:00000040:3.0:1783144444.749035:0:24814:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.749053:0:24814:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588000 x1869759481776000/t0(4294968885) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.749063:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+38:2402:x1869759481776000:12345-192.168.203.4@tcp:4:dd.0 Request processed in 59us (286us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.749074:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 827 00000100:00000040:3.0:1783144444.749078:0:24814:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.749080:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968885, next_transno: 4294968885 00010000:00080000:1.0:1783144444.749086:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968885) 00010000:00080000:1.0:1783144444.749100:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481776000 t4294968885 from 192.168.203.4@tcp req@ffff9c2b01588000 x1869759481776000/t0(4294968885) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.749122:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588000 x1869759481776000/t0(4294968885) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.749210:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.749236:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.749239:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.749482:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 34 00000020:00000040:1.0:1783144444.749487:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=39 00010000:00000040:1.0:1783144444.749949:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968885, xid 1869759481776000 00000100:00000040:1.0:1783144444.749960:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.749966:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.750007:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.750016:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.750025:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.750036:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 38 00010000:00080000:1.0:1783144444.750041:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968886 00010000:00080000:1.0:1783144444.750052:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968886 00000100:00000040:1.0:1783144444.751012:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158a300 x1869759481776256 msgsize 1512 00000100:00100000:1.0:1783144444.751021:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.751141:0:24812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776256 00000100:00100000:2.0:1783144444.751147:0:24812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776256 00000020:00000040:2.0:1783144444.751150:0:24812:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.751153:0:24812:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=39 00000100:00000040:2.0:1783144444.751169:0:24812:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.751204:0:24812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 828 00000100:00000040:2.0:1783144444.751209:0:24812:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.751216:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158a300 x1869759481776256/t0(4294968886) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.751230:0:24812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:2402:x1869759481776256:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:2.0:1783144444.751240:0:24812:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158a300 x1869759481776256/t0(4294968886) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.751249:0:24812:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968886, current: 4294968886, replaying 00010000:00000040:2.0:1783144444.751251:0:24812:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.751276:0:24812:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158a300 x1869759481776256/t0(4294968886) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.751285:0:24812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+39:2402:x1869759481776256:12345-192.168.203.4@tcp:4:dd.0 Request processed in 59us (273us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.751300:0:24812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 828 00000100:00000040:2.0:1783144444.751303:0:24812:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:1.0:1783144444.751390:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968886, next_transno: 4294968886 00010000:00080000:1.0:1783144444.751395:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968886) 00010000:00080000:1.0:1783144444.751406:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481776256 t4294968886 from 192.168.203.4@tcp req@ffff9c2b0158a300 x1869759481776256/t0(4294968886) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.751428:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158a300 x1869759481776256/t0(4294968886) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783144444.751507:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783144444.751538:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:1.0:1783144444.751541:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783144444.751754:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 35 00000020:00000040:1.0:1783144444.751759:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=40 00010000:00000040:1.0:1783144444.751996:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968886, xid 1869759481776256 00000100:00000040:1.0:1783144444.752005:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:1.0:1783144444.752011:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:1.0:1783144444.752045:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:1.0:1783144444.752055:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783144444.752062:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:1.0:1783144444.752071:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 39 00010000:00080000:1.0:1783144444.752075:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968887 00010000:00080000:1.0:1783144444.752078:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968887 00000100:00000040:0.0:1783144444.756506:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29cab7a680 x1869759481776512 msgsize 1512 00000100:00100000:0.0:1783144444.756522:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.756782:0:24813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776512 00000100:00100000:1.0:1783144444.756793:0:24813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776512 00000020:00000040:1.0:1783144444.756801:0:24813:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.756806:0:24813:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=40 00000100:00000040:1.0:1783144444.756832:0:24813:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.756896:0:24813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 829 00000100:00000040:1.0:1783144444.756902:0:24813:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.756911:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29cab7a680 x1869759481776512/t0(4294968887) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.756927:0:24813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:2402:x1869759481776512:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:1.0:1783144444.756941:0:24813:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab7a680 x1869759481776512/t0(4294968887) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.756950:0:24813:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968887, current: 4294968887, replaying 00010000:00000040:1.0:1783144444.756954:0:24813:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.756979:0:24813:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29cab7a680 x1869759481776512/t0(4294968887) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.756990:0:24813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+40:2402:x1869759481776512:12345-192.168.203.4@tcp:4:dd.0 Request processed in 65us (485us total) trans 0 rc 0/-999 00010000:00080000:2.0:1783144444.756996:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968887, next_transno: 4294968887 00000100:00100000:1.0:1783144444.756998:0:24813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 829 00010000:00080000:2.0:1783144444.757003:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968887) 00000100:00000040:1.0:1783144444.757005:0:24813:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.757018:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481776512 t4294968887 from 192.168.203.4@tcp req@ffff9c29cab7a680 x1869759481776512/t0(4294968887) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.757037:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29cab7a680 x1869759481776512/t0(4294968887) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.757140:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783144444.757175:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:2.0:1783144444.757178:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783144444.757472:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 36 00000020:00000040:2.0:1783144444.757476:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=41 00010000:00000040:2.0:1783144444.758412:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968887, xid 1869759481776512 00000100:00000040:2.0:1783144444.758433:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.758441:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.758490:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.758501:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.758512:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.758525:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 40 00010000:00080000:2.0:1783144444.758531:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968888 00010000:00080000:2.0:1783144444.758536:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968888 00000100:00000040:3.0:1783144444.761253:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20db800 x1869759481776768 msgsize 1512 00000100:00100000:3.0:1783144444.761277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.761482:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481776768 00000100:00100000:1.0:1783144444.761497:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481776768 00000020:00000040:1.0:1783144444.761501:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.761507:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=41 00000100:00000040:1.0:1783144444.761536:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.761593:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 830 00000100:00000040:1.0:1783144444.761600:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.761610:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20db800 x1869759481776768/t0(4294968888) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.761622:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+41:2402:x1869759481776768:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:1.0:1783144444.761633:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20db800 x1869759481776768/t0(4294968888) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.761651:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968888, current: 4294968888, replaying 00010000:00000040:1.0:1783144444.761654:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.761669:0:8441:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20db800 x1869759481776768/t0(4294968888) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.761679:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+41:2402:x1869759481776768:12345-192.168.203.4@tcp:4:dd.0 Request processed in 58us (424us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.761688:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 830 00010000:00080000:2.0:1783144444.761690:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968888, next_transno: 4294968888 00010000:00080000:2.0:1783144444.761694:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968888) 00000100:00000040:1.0:1783144444.761694:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.761710:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481776768 t4294968888 from 192.168.203.4@tcp req@ffff9c29c20db800 x1869759481776768/t0(4294968888) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.761765:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20db800 x1869759481776768/t0(4294968888) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.761840:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783144444.761862:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:2.0:1783144444.761864:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783144444.762065:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 37 00000020:00000040:2.0:1783144444.762069:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=42 00010000:00000040:2.0:1783144444.762461:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968888, xid 1869759481776768 00000100:00000040:2.0:1783144444.762469:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.762476:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.762512:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.762521:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.762527:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.762535:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 41 00010000:00080000:2.0:1783144444.762539:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968889 00010000:00080000:2.0:1783144444.762542:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968889 00000100:00000040:1.0:1783144444.764944:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01589f80 x1869759481777024 msgsize 1512 00000100:00100000:1.0:1783144444.764953:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1783144444.764993:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777024 00000100:00100000:3.0:1783144444.765002:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777024 00000020:00000040:3.0:1783144444.765006:0:24810:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:3.0:1783144444.765010:0:24810:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=42 00000100:00000040:3.0:1783144444.765028:0:24810:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783144444.765113:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 831 00000100:00000040:3.0:1783144444.765118:0:24810:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:3.0:1783144444.765125:0:24810:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01589f80 x1869759481777024/t0(4294968889) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.765139:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+42:2402:x1869759481777024:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:3.0:1783144444.765149:0:24810:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589f80 x1869759481777024/t0(4294968889) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783144444.765157:0:24810:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968889, current: 4294968889, replaying 00010000:00000040:3.0:1783144444.765159:0:24810:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:3.0:1783144444.765176:0:24810:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01589f80 x1869759481777024/t0(4294968889) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783144444.765185:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+42:2402:x1869759481777024:12345-192.168.203.4@tcp:4:dd.0 Request processed in 49us (239us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.765201:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 831 00000100:00000040:3.0:1783144444.765204:0:24810:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.765238:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968889, next_transno: 4294968889 00010000:00080000:2.0:1783144444.765243:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968889) 00010000:00080000:2.0:1783144444.765249:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481777024 t4294968889 from 192.168.203.4@tcp req@ffff9c2b01589f80 x1869759481777024/t0(4294968889) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.765276:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589f80 x1869759481777024/t0(4294968889) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.765337:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783144444.765351:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:2.0:1783144444.765353:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783144444.765461:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 38 00000020:00000040:2.0:1783144444.765469:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=43 00010000:00000040:2.0:1783144444.766075:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968889, xid 1869759481777024 00000100:00000040:2.0:1783144444.766083:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.766088:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.766116:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.766123:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.766128:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.766136:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 42 00010000:00080000:2.0:1783144444.766140:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968890 00010000:00080000:2.0:1783144444.766143:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968890 00000100:00000040:3.0:1783144444.767249:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c29c20db100 x1869759481777408 msgsize 1512 00000100:00100000:3.0:1783144444.767256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144444.767374:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777408 00000100:00100000:1.0:1783144444.767378:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777408 00000020:00000040:1.0:1783144444.767380:0:24828:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.767384:0:24828:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=43 00000100:00000040:1.0:1783144444.767395:0:24828:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783144444.767426:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 832 00000100:00000040:1.0:1783144444.767430:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:1.0:1783144444.767435:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c29c20db100 x1869759481777408/t0(4294968890) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.767448:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+43:2402:x1869759481777408:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:1.0:1783144444.767456:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20db100 x1869759481777408/t0(4294968890) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783144444.767463:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968890, current: 4294968890, replaying 00010000:00000040:1.0:1783144444.767466:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.767479:0:24828:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c29c20db100 x1869759481777408/t0(4294968890) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783144444.767495:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+43:2402:x1869759481777408:12345-192.168.203.4@tcp:4:dd.0 Request processed in 49us (244us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.767503:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 832 00000100:00000040:1.0:1783144444.767505:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:2.0:1783144444.767509:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968890, next_transno: 4294968890 00010000:00080000:2.0:1783144444.767512:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968890) 00010000:00080000:2.0:1783144444.767524:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481777408 t4294968890 from 192.168.203.4@tcp req@ffff9c29c20db100 x1869759481777408/t0(4294968890) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.767538:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c29c20db100 x1869759481777408/t0(4294968890) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783144444.767591:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783144444.767603:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:2.0:1783144444.767606:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783144444.767827:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 39 00000020:00000040:2.0:1783144444.767830:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=44 00010000:00000040:2.0:1783144444.767978:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968890, xid 1869759481777408 00000100:00000040:2.0:1783144444.767985:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:2.0:1783144444.767991:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:2.0:1783144444.768020:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:2.0:1783144444.768027:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783144444.768032:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:2.0:1783144444.768039:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 43 00010000:00080000:2.0:1783144444.768048:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968891 00010000:00080000:2.0:1783144444.768051:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968891 00000100:00000040:1.0:1783144444.771505:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01588e00 x1869759481777536 msgsize 1512 00000100:00100000:1.0:1783144444.771515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.771596:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481777536 00000100:00100000:2.0:1783144444.771602:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481777536 00000020:00000040:2.0:1783144444.771604:0:24814:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.771607:0:24814:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=44 00000100:00000040:2.0:1783144444.771623:0:24814:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783144444.771695:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 833 00000100:00000040:2.0:1783144444.771699:0:24814:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.771705:0:24814:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01588e00 x1869759481777536/t0(4294968891) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.771719:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:2402:x1869759481777536:12345-192.168.203.4@tcp:4:dd.0 00000020:00000040:2.0:1783144444.771800:0:24814:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588e00 x1869759481777536/t0(4294968891) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783144444.771808:0:24814:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968891, current: 4294968891, replaying 00010000:00000040:2.0:1783144444.771811:0:24814:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:2.0:1783144444.771820:0:24814:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588e00 x1869759481777536/t0(4294968891) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783144444.771829:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+44:2402:x1869759481777536:12345-192.168.203.4@tcp:4:dd.0 Request processed in 113us (324us total) trans 0 rc 0/-999 00010000:00080000:3.0:1783144444.771833:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968891, next_transno: 4294968891 00000100:00100000:2.0:1783144444.771837:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 833 00010000:00080000:3.0:1783144444.771841:0:96764:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968891) 00000100:00000040:2.0:1783144444.771843:0:24814:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00010000:00080000:3.0:1783144444.771853:0:96764:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1869759481777536 t4294968891 from 192.168.203.4@tcp req@ffff9c2b01588e00 x1869759481777536/t0(4294968891) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.771871:0:96764:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588e00 x1869759481777536/t0(4294968891) o4->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 1512/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783144444.771931:0:96764:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783144444.771950:0:96764:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5823 MB/s 00000020:00000040:3.0:1783144444.771952:0:96764:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783144444.772111:0:96764:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c2ad3866000 : new cb_count 40 00000020:00000040:3.0:1783144444.772123:0:96764:0:(genops.c:889:class_export_get()) GET export ffff9c2ad3866000 refcount=45 00010000:00000040:3.0:1783144444.772442:0:96764:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968851, transno 4294968891, xid 1869759481777536 00000100:00000040:3.0:1783144444.772451:0:96764:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c29c3649c40 refcount 11 to 192.168.203.4@tcp 00000100:00000040:3.0:1783144444.772457:0:96764:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.4@tcp 00000100:00000040:3.0:1783144444.772558:0:96764:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9c29c3649c40 refcount 10 to 192.168.203.4@tcp 00010000:00080000:3.0:1783144444.772566:0:96764:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783144444.772572:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.772581:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 44 00010000:00080000:3.0:1783144444.772585:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968892 00010000:00080000:3.0:1783144444.772588:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968892 00000100:00000040:1.0:1783144444.774662:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01588380 x1869759481779712 msgsize 328 00000100:00100000:1.0:1783144444.774671:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.774898:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779712 00000100:00100000:2.0:1783144444.774904:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779712 00000020:00000040:2.0:1783144444.774907:0:26140:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.774911:0:26140:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=45 00000100:00100000:2.0:1783144444.774948:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5064 00000100:00000040:2.0:1783144444.774958:0:26140:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 1 00000100:00000040:2.0:1783144444.774965:0:26140:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01588380 x1869759481779712/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.774978:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:2402:x1869759481779712:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783144444.774989:0:26140:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588380 x1869759481779712/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144444.774998:0:26140:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00010000:00080000:2.0:1783144444.775001:0:26140:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2b01588380 x1869759481779712/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.775019:0:26140:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588380 x1869759481779712/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.775027:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+45:2402:x1869759481779712:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 52us (364us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.775033:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5064 00000100:00000040:1.0:1783144444.775078:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01589880 x1869759481779840 msgsize 328 00000100:00100000:1.0:1783144444.775084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00080000:3.0:1783144444.775089:0:96764:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294968892 00010000:00080000:3.0:1783144444.775092:0:96764:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000100:00000040:1.0:1783144444.775103:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158b100 x1869759481779968 msgsize 328 00010000:00000040:3.0:1783144444.775104:0:96764:0:(ldlm_lib.c:2868:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:3.0:1783144444.775107:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1783144444.775107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00080000:3.0:1783144444.775109:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00000100:00100000:1.0:1783144444.775125:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779840 00010000:00080000:3.0:1783144444.775126:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2b01588380 x1869759481779712/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.775134:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00100000:1.0:1783144444.775185:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779840 00000020:00000040:1.0:1783144444.775188:0:26150:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.775190:0:26150:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=46 00000100:00000040:2.0:1783144444.775217:0:26140:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00000100:00100000:2.0:1783144444.775226:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481779968 00000100:00100000:2.0:1783144444.775228:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481779968 00000020:00000040:2.0:1783144444.775229:0:26140:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.775231:0:26140:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=47 00000100:00100000:1.0:1783144444.775281:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5065 00000100:00000040:1.0:1783144444.775284:0:26150:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 2 00000100:00000040:1.0:1783144444.775289:0:26150:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01589880 x1869759481779840/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.775301:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:2402:x1869759481779840:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783144444.775309:0:26150:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01589880 x1869759481779840/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783144444.775316:0:26150:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 3 00010000:00080000:1.0:1783144444.775320:0:26150:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2b01589880 x1869759481779840/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144444.775335:0:26150:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01589880 x1869759481779840/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.775343:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:2402:x1869759481779840:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 45us (264us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783144444.775349:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5065 00000100:00000040:1.0:1783144444.775351:0:26150:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 2 00000100:00100000:2.0:1783144444.775437:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5066 00000100:00000040:2.0:1783144444.775440:0:26140:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 3 00000100:00000040:2.0:1783144444.775444:0:26140:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158b100 x1869759481779968/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.775456:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:2402:x1869759481779968:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783144444.775472:0:26140:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158b100 x1869759481779968/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144444.775479:0:26140:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 4 00010000:00080000:2.0:1783144444.775483:0:26140:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2b0158b100 x1869759481779968/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.775491:0:26140:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158b100 x1869759481779968/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.775499:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+47:2402:x1869759481779968:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 46us (394us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.775505:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5066 00000100:00000040:2.0:1783144444.775508:0:26140:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 3 00000100:00000040:1.0:1783144444.778560:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b0158a680 x1869759481780096 msgsize 328 00000100:00100000:1.0:1783144444.778568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00000040:1.0:1783144444.778585:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2b01588700 x1869759481780224 msgsize 328 00000100:00100000:1.0:1783144444.778590:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.778593:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780096 00000100:00100000:2.0:1783144444.778600:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780096 00000020:00000040:2.0:1783144444.778602:0:26148:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.778605:0:26148:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=48 00000100:00000040:1.0:1783144444.778943:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2aeed26680 x1869759481780352 msgsize 328 00000100:00100000:1.0:1783144444.778949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00000040:1.0:1783144444.779565:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2affe18a80 x1869759481780480 msgsize 328 00000100:00100000:2.0:1783144444.779572:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780224 00000100:00100000:1.0:1783144444.779572:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144444.779579:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780224 00000020:00000040:2.0:1783144444.779581:0:26148:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.779585:0:26148:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=49 00000100:00100000:2.0:1783144444.779616:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780352 00000100:00100000:2.0:1783144444.779620:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780352 00000020:00000040:2.0:1783144444.779622:0:26148:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.779625:0:26148:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=50 00000100:00100000:2.0:1783144444.779648:0:26148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780480 00000100:00100000:2.0:1783144444.779651:0:26148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780480 00000020:00000040:2.0:1783144444.779653:0:26148:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:2.0:1783144444.779655:0:26148:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=51 00000100:00100000:2.0:1783144444.779682:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5067 00000100:00000040:2.0:1783144444.779692:0:26148:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 4 00000100:00000040:2.0:1783144444.779699:0:26148:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b0158a680 x1869759481780096/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.779712:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b0158a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780096:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783144444.779739:0:26148:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b0158a680 x1869759481780096/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144444.779747:0:26148:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 5 00010000:00080000:2.0:1783144444.779751:0:26148:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2b0158a680 x1869759481780096/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.779761:0:26148:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b0158a680 x1869759481780096/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.779770:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b0158a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780096:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 61us (1208us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.779776:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5067 00000100:00000040:2.0:1783144444.779779:0:26148:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 4 00000100:00100000:2.0:1783144444.779790:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5068 00000100:00000040:2.0:1783144444.779792:0:26148:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 5 00000100:00000040:2.0:1783144444.779796:0:26148:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2b01588700 x1869759481780224/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.779821:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2b01588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780224:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783144444.779829:0:26148:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2b01588700 x1869759481780224/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783144444.779835:0:26148:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 6 00010000:00080000:2.0:1783144444.779845:0:26148:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2b01588700 x1869759481780224/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.779854:0:26148:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2b01588700 x1869759481780224/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.779862:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2b01588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780224:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 45us (1275us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.779867:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5068 00000100:00000040:2.0:1783144444.779869:0:26148:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 5 00000100:00100000:2.0:1783144444.779880:0:26148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5069 00000100:00000040:2.0:1783144444.779883:0:26148:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 6 00000100:00000040:2.0:1783144444.779886:0:26148:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2aeed26680 x1869759481780352/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.779897:0:26148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780352:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783144444.779906:0:26148:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2aeed26680 x1869759481780352/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783144444.779910:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff9c2affe19c00 x1869759481780608 msgsize 328 00010000:00000040:2.0:1783144444.779915:0:26148:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 7 00010000:00080000:2.0:1783144444.779919:0:26148:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2aeed26680 x1869759481780352/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783144444.779933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00000040:3.0:1783144444.779943:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 6 00000100:00000040:2.0:1783144444.779943:0:26148:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2aeed26680 x1869759481780352/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.779955:0:26148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aeed26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780352:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 60us (1010us total) trans 0 rc 0/-999 00000020:00000040:3.0:1783144444.779958:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 50 00000100:00100000:1.0:1783144444.779963:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780608 00010000:00080000:3.0:1783144444.779964:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1783144444.779965:0:26148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5069 00000100:00100000:1.0:1783144444.779970:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780608 00000100:00000040:2.0:1783144444.779974:0:26148:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 5 00000020:00000040:1.0:1783144444.779975:0:26142:0:(genops.c:825:class_conn2export()) looking for export cookie 0xad8e53a423049f75 00000020:00000040:1.0:1783144444.779981:0:26142:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2ad3866000 refcount=51 00000100:00100000:3.0:1783144444.779985:0:26149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5070 00000100:00000040:3.0:1783144444.779990:0:26149:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 6 00000100:00000040:3.0:1783144444.779996:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2affe18a80 x1869759481780480/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144444.780012:0:26149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780480:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1783144444.780018:0:16470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5071 00000100:00000040:2.0:1783144444.780022:0:16470:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 7 00000020:00000040:3.0:1783144444.780026:0:26149:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2affe18a80 x1869759481780480/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.780030:0:16470:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2affe19c00 x1869759481780608/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783144444.780047:0:26149:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 8 00010000:00080000:3.0:1783144444.780053:0:26149:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2affe18a80 x1869759481780480/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783144444.780067:0:26149:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2affe18a80 x1869759481780480/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.780067:0:16470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2affe19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780608:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783144444.780085:0:16470:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2affe19c00 x1869759481780608/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783144444.780086:0:26149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780480:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 79us (519us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783144444.780100:0:26149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5070 00010000:00000040:2.0:1783144444.780104:0:16470:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9c2ad3866000 : new rpc_count 9 00000100:00000040:3.0:1783144444.780105:0:26149:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 8 00010000:00080000:2.0:1783144444.780112:0:16470:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2affe19c00 x1869759481780608/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783144444.780123:0:16470:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2affe19c00 x1869759481780608/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783144444.780130:0:16470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2affe19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2402:x1869759481780608:12345-192.168.203.4@tcp:101:ldlm_lock_repla.0 Request processed in 70us (517us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783144444.780135:0:16470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5071 00000100:00000040:2.0:1783144444.780137:0:16470:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 7 00010000:00080000:3.0:1783144444.780279:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783144444.780291:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2b01589880 x1869759481779840/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.780300:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783144444.780302:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 6 00000020:00000040:3.0:1783144444.780310:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 50 00010000:00080000:3.0:1783144444.780313:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783144444.780314:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783144444.780318:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2b0158b100 x1869759481779968/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.780325:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783144444.780326:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 5 00000020:00000040:3.0:1783144444.780331:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 49 00010000:00080000:3.0:1783144444.780333:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783144444.780334:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783144444.780338:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2b0158a680 x1869759481780096/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.780344:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783144444.780345:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 4 00000020:00000040:3.0:1783144444.780349:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 48 00010000:00080000:3.0:1783144444.780351:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783144444.780352:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783144444.780356:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2b01588700 x1869759481780224/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.780363:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783144444.780364:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 3 00000020:00000040:3.0:1783144444.780368:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 47 00010000:00080000:3.0:1783144444.780370:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783144444.780371:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783144444.780375:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2aeed26680 x1869759481780352/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.780391:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783144444.780392:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 2 00000020:00000040:3.0:1783144444.780398:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 46 00010000:00080000:3.0:1783144444.780399:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783144444.780401:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783144444.780405:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2affe18a80 x1869759481780480/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.780410:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783144444.780412:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 1 00000020:00000040:3.0:1783144444.780416:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 45 00010000:00080000:3.0:1783144444.780417:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783144444.780418:0:96764:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783144444.780422:0:96764:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.203.4@tcp: req@ffff9c2affe19c00 x1869759481780608/t0(0) o101->3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef@192.168.203.4@tcp:555/0 lens 328/0 e 0 to 0 dl 1783144455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783144444.780428:0:96764:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783144444.780429:0:96764:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9c2ad3866000 : new rpc_count 0 00000020:00000040:3.0:1783144444.780433:0:96764:0:(genops.c:900:class_export_put()) PUTting export ffff9c2ad3866000 : new refcount 44 00010000:00080000:3.0:1783144444.780435:0:96764:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1783144444.878806:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783144445.554154:0:97106:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783144445.901995:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783144445.966882:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144445.966900:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c20d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501433728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144445.966965:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144445.967070:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501433472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783144445.967094:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433728 00000100:00100000:0.0:1783144445.967100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144445.967103:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433728 00000100:00100000:1.0:1783144445.967196:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501433600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783144445.967226:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144445.967253:0:26788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433600 00000100:00100000:1.0:1783144445.967267:0:26788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433600 00000100:00100000:1.0:1783144445.967305:0:26788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1783144445.967315:0:26788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501433600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783144445.967349:0:26788:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783144445.967387:0:26788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501433600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144445.967394:0:26788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00080000:1.0:1783144445.967413:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144445.968940:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501433600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783144445.969315:0:23926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433472 00000100:00100000:3.0:1783144445.969320:0:23926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433472 00000100:00100000:3.0:1783144445.969358:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1783144445.969366:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501433728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783144445.969391:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1783144445.969434:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869759501433728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144445.969448:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1783144445.969462:0:23926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1783144445.969479:0:23926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29cab79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1869759501433472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783144445.969496:0:23926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:3.0:1783144445.969526:0:23926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29cab79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1869759501433472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144445.969532:0:23926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1783144445.969568:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c20d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1869759501433728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783144445.969595:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1869759501433472:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1783144446.012881:0:97158:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783144446.013063:0:97158:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1783144446.403071:0:97208:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783144446.403268:0:97208:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783144446.925850:0:9525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144447.076940:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144447.076987:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144447.077015:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144447.077045:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144447.077064:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780992 00000100:00100000:0.0:1783144447.077073:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780992 00000100:00100000:1.0:1783144447.077112:0:26139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481781120 00000100:00100000:0.0:1783144447.077129:0:66113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780864 00000100:00100000:0.0:1783144447.077133:0:66113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780864 00000100:00100000:0.0:1783144447.077156:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 907 00000100:00100000:0.0:1783144447.077165:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c56a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2405:x1869759481780992:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144447.077177:0:26139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481781120 00000100:00100000:0.0:1783144447.077238:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c56a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2405:x1869759481780992:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144447.077245:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 907 00000100:00100000:0.0:1783144447.077271:0:66113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 908 00000100:00100000:0.0:1783144447.077278:0:66113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2405:x1869759481780864:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1783144447.077280:0:94188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481780736 00000100:00100000:2.0:1783144447.077285:0:94188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481780736 00000100:00100000:0.0:1783144447.077310:0:66113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2405:x1869759481780864:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144447.077317:0:94188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:0.0:1783144447.077317:0:66113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 908 00000100:00100000:2.0:1783144447.077327:0:94188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481780736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144447.077331:0:26139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2118 00000100:00080000:0.0:1783144447.077337:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144447.077343:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144447.077346:0:26139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2405:x1869759481781120:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:0.0:1783144447.077346:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783144447.077358:0:94188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481780736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144447.077374:0:94188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 199 00000100:00100000:1.0:1783144447.077393:0:26139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2addaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2405:x1869759481781120:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144447.077401:0:26139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2118 00010000:00010000:2.0:1783144447.950747:0:9527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783144448.013873:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144448.013880:0:41298:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:1.0:1783144448.013900:0:41298:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783144448.013903:0:41298:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1783144448.013948:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501434240:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.014009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144448.014037:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501434752:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.014080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144448.014108:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783144448.014114:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501433856:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.014147:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144448.014181:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c3c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501434368:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.014206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144448.014227:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2ad05d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501434880:0@lo:400:kworker.0 00000100:00100000:0.0:1783144448.014231:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501434752 00000100:00100000:0.0:1783144448.014255:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501434752 00000100:00100000:1.0:1783144448.014263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144448.014296:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501434112:0@lo:400:kworker.0 00000100:00100000:0.0:1783144448.014305:0:26150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501434368 00000100:00100000:0.0:1783144448.014309:0:26150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501434368 00000100:00100000:1.0:1783144448.014326:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144448.014337:0:26150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:1.0:1783144448.014346:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501434624:0@lo:400:kworker.0 00000100:00100000:0.0:1783144448.014350:0:26150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501434752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.014371:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144448.014389:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29c615b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501435136:0@lo:400:kworker.0 00000100:00100000:3.0:1783144448.014463:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501433984:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.014592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144448.014628:0:26150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501434752:12345-0@lo:400:kworker.0 Request processed in 280us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.014633:0:26151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1783144448.014642:0:26150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:1.0:1783144448.014647:0:26151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501434368:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783144448.014667:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783144448.014684:0:26151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501434368:12345-0@lo:400:kworker.0 Request processed in 42us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.014691:0:26151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:1.0:1783144448.014713:0:94185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433856 00000100:00100000:1.0:1783144448.014717:0:94185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433856 00000100:00100000:1.0:1783144448.014760:0:94185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783144448.014767:0:94185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501433856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.014797:0:94185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501433856:12345-0@lo:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.014812:0:94185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783144448.014839:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501434880 00000100:00100000:1.0:1783144448.014843:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501434880 00000100:00100000:1.0:1783144448.014872:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501434112 00000100:00100000:1.0:1783144448.014875:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501434112 00000100:00080000:0.0:1783144448.014897:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144448.014907:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435136 00000100:00100000:1.0:1783144448.014911:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435136 00000100:00100000:1.0:1783144448.014944:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1783144448.014950:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501434880:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783144448.014952:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144448.014986:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501434880:12345-0@lo:400:kworker.0 Request processed in 36us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.014992:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1783144448.015004:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1783144448.015010:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501434112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.015050:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501434112:12345-0@lo:400:kworker.0 Request processed in 40us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.015057:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1783144448.015069:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1783144448.015076:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501435136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.015103:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501435136:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.015108:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1783144448.015139:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501434240 00000100:00100000:1.0:1783144448.015143:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501434240 00000100:00100000:0.0:1783144448.015144:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501434112:0@lo:400:kworker.0 00000100:00100000:0.0:1783144448.015168:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c615b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501435136:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.015175:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501434624 00000100:00100000:1.0:1783144448.015180:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501434624 00000100:00100000:0.0:1783144448.015268:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1783144448.015277:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501434240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144448.015315:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501434240:12345-0@lo:400:kworker.0 Request processed in 40us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144448.015322:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1783144448.015341:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:0.0:1783144448.015347:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501434624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783144448.015380:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501434624:12345-0@lo:400:kworker.0 Request processed in 33us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144448.015399:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1783144448.015422:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2addaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501433856:0@lo:400:kworker.0 00000100:00100000:0.0:1783144448.015432:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501434624:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.015452:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29c3c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501434368:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.015464:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2ad05d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501434880:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.015474:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501434240:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.015482:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501434752:0@lo:400:kworker.0 00000100:00100000:3.0:1783144448.015637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144448.015699:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29ca0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501434496:0@lo:400:kworker.0 00000100:00100000:3.0:1783144448.015739:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144448.019024:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501435008:0@lo:400:kworker.0 00000100:00100000:3.0:1783144448.019070:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783144448.020317:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501433984 00000100:00100000:1.0:1783144448.020324:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501433984 00000100:00100000:1.0:1783144448.020371:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501434496 00000100:00100000:1.0:1783144448.020374:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501434496 00000100:00100000:1.0:1783144448.020394:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1783144448.020403:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501433984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.020451:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501433984:12345-0@lo:400:kworker.0 Request processed in 50us (4814us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.020456:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1783144448.020470:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1783144448.020475:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c20d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501434496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.020500:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c20d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501434496:12345-0@lo:400:kworker.0 Request processed in 24us (4760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.020505:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00080000:1.0:1783144448.020521:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144448.022410:0:66947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435008 00000100:00100000:1.0:1783144448.022416:0:66947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435008 00000100:00100000:3.0:1783144448.022427:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501433984:0@lo:400:kworker.0 00000100:00100000:3.0:1783144448.022445:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29ca0d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501434496:0@lo:400:kworker.0 00000100:00100000:1.0:1783144448.022467:0:66947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1783144448.022475:0:66947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501435008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783144448.022510:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783144448.022524:0:66947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29ca609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501435008:12345-0@lo:400:kworker.0 Request processed in 49us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144448.022539:0:66947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1783144448.022563:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501435008:0@lo:400:kworker.0 00000100:00100000:3.0:1783144448.529427:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783144448.529447:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cab79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501435264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783144448.529520:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783144448.529615:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435264 00000100:00100000:0.0:1783144448.529621:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435264 00000100:00100000:0.0:1783144448.529678:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:0.0:1783144448.529687:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501435264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783144448.529714:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783144448.529774:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af5d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869759501435264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783144448.529781:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00100000:0.0:1783144448.529820:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cab79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1869759501435264:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1783144448.533972:0:96748:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968891 is committed 00000001:02000400:1.0:1783144448.960482:0:97400:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00010000:00010000:0.0:1783144448.974361:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783144449.040838:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144449.040845:0:35504:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1783144449.040882:0:35504:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783144449.040886:0:35504:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1783144449.040938:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2af5510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501435776:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.041037:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501436288:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041064:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.041089:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783144449.041095:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501435392:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041121:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.041145:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501435904:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.041257:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501436416:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.041307:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c29cead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501435648:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041331:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.041348:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501436160:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041369:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.041385:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef9f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501436672:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.041417:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144449.041710:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501435520:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.042714:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435776 00000100:00100000:2.0:1783144449.042734:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435776 00000100:00100000:2.0:1783144449.042777:0:78024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501436160 00000100:00100000:2.0:1783144449.042780:0:78024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501436160 00000100:00100000:2.0:1783144449.042804:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1783144449.042814:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501435776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.042870:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1869759501435776:12345-0@lo:400:kworker.0 Request processed in 57us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144449.042880:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1783144449.042903:0:78024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1783144449.042911:0:78024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501436160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.042944:0:78024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759501436160:12345-0@lo:400:kworker.0 Request processed in 34us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144449.042951:0:78024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1783144449.042973:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501436288 00000100:00100000:2.0:1783144449.042976:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501436288 00000100:00100000:2.0:1783144449.043556:0:26140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435904 00000100:00100000:2.0:1783144449.043561:0:26140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435904 00000100:00100000:2.0:1783144449.043589:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1783144449.043596:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501436288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.043630:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3648:x1869759501436288:12345-0@lo:400:kworker.0 Request processed in 35us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144449.043635:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1783144449.043648:0:26140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:2.0:1783144449.043654:0:26140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501435904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.043682:0:26140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1869759501435904:12345-0@lo:400:kworker.0 Request processed in 29us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144449.043696:0:26140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:2.0:1783144449.043714:0:94184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435392 00000100:00100000:2.0:1783144449.043718:0:94184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435392 00000100:00100000:2.0:1783144449.044111:0:94184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783144449.044118:0:94184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501435392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.044149:0:94184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e9e4714-8000-4c64-bed6-3cadd5fdfc80+24:3648:x1869759501435392:12345-0@lo:400:kworker.0 Request processed in 32us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144449.044156:0:94184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783144449.044186:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501436416 00000100:00100000:2.0:1783144449.044190:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501436416 00000100:00100000:2.0:1783144449.044211:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435648 00000100:00100000:2.0:1783144449.044213:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435648 00000100:00100000:2.0:1783144449.044277:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501436672 00000100:00100000:2.0:1783144449.044281:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501436672 00000100:00100000:1.0:1783144449.044295:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1783144449.044308:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501436416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144449.044347:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869759501436416:12345-0@lo:400:kworker.0 Request processed in 43us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144449.044353:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1783144449.044368:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1783144449.044374:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501435648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144449.044398:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759501435648:12345-0@lo:400:kworker.0 Request processed in 25us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144449.044403:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1783144449.044413:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1783144449.044418:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2aef9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501436672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144449.044440:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2aef9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759501436672:12345-0@lo:400:kworker.0 Request processed in 22us (3023us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144449.044445:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1783144449.047140:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144449.047171:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501436032:0@lo:400:kworker.0 00000100:00100000:3.0:1783144449.047208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783144449.047218:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c2aef9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501436544:0@lo:400:kworker.0 00000100:00100000:3.0:1783144449.047248:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783144449.047552:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501435520 00000100:00100000:2.0:1783144449.047558:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501435520 00000100:00100000:2.0:1783144449.047586:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501436032 00000100:00100000:2.0:1783144449.047589:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501436032 00000100:00100000:2.0:1783144449.047600:0:81077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501436544 00000100:00100000:2.0:1783144449.047602:0:81077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501436544 00000100:00100000:2.0:1783144449.047616:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1783144449.047625:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af6fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501435520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.047942:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af6fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869759501435520:12345-0@lo:400:kworker.0 Request processed in 316us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144449.047945:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1783144449.047955:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1783144449.047960:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af6fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501436032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.047981:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1783144449.047991:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af6fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501436544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783144449.048002:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af6fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869759501436032:12345-0@lo:400:kworker.0 Request processed in 46us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144449.048009:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1783144449.048193:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af6fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869759501436544:12345-0@lo:400:kworker.0 Request processed in 203us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144449.048206:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1783144449.048294:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c29cead9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759501435648:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.048307:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1869759501436160:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.048318:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef9f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759501436672:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.048348:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e9e4714-8000-4c64-bed6-3cadd5fdfc80:3648:1869759501435392:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.048356:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501435904:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.048363:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869759501436416:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.048370:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2af5510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1869759501435776:0@lo:400:kworker.0 00000100:00100000:2.0:1783144449.048376:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1869759501436288:0@lo:400:kworker.0 00000100:00100000:0.0:1783144449.052522:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2affdb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1869759501435520:0@lo:400:kworker.0 00000100:00100000:0.0:1783144449.053202:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869759501436032:0@lo:400:kworker.0 00000100:00100000:0.0:1783144449.053220:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9c2aef9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1869759501436544:0@lo:400:kworker.0 00000001:02000400:3.0:1783144449.653026:0:97448:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:2.0:1783144449.999603:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783144450.082387:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1783144450.082430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144450.082471:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481781376 00000100:00100000:1.0:1783144450.082471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1783144450.082481:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481781376 00000100:00100000:0.0:1783144450.082485:0:94183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481781248 00000100:00100000:0.0:1783144450.082491:0:94183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481781248 00000100:00100000:1.0:1783144450.082520:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1783144450.082535:0:94183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:0.0:1783144450.082551:0:94183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481781248:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144450.082555:0:26142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481781632 00000100:00100000:3.0:1783144450.082568:0:26142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481781632 00000100:00100000:2.0:1783144450.082570:0:66112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759481781504 00000100:00100000:2.0:1783144450.082576:0:66112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759481781504 00000100:00100000:1.0:1783144450.082599:0:81077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 921 00000100:00100000:0.0:1783144450.082607:0:94183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c29c47c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ed6386-b53d-4b75-b3e0-82656a667de7+10:2405:x1869759481781248:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783144450.082614:0:81077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2406:x1869759481781376:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1783144450.082616:0:94183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00080000:0.0:1783144450.082655:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783144450.082660:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783144450.082662:0:81077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+51:2406:x1869759481781376:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00080000:0.0:1783144450.082663:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783144450.082694:0:26142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2123 00000100:00100000:3.0:1783144450.082708:0:26142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2406:x1869759481781632:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1783144450.082770:0:81077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 921 00000100:00100000:2.0:1783144450.082780:0:66112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 922 00000100:00100000:2.0:1783144450.082794:0:66112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2af7b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2405:x1869759481781504:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1783144450.082816:0:26142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+7:2406:x1869759481781632:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 110us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783144450.082826:0:26142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2123 00000100:00100000:2.0:1783144450.082844:0:66112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2af7b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ffd53ae-6f2c-444b-b39a-1cd2cf2509ef+11:2405:x1869759481781504:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783144450.082854:0:66112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 922 00000001:02000400:0.0:1783144450.287371:0:97497:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success Debug log: 59702 lines, 59702 kept, 0 dropped, 0 bad.